[2025-10-31T17:00:02.179529] [INFO ] [MAIN ] Using last completed trading day: 2025-10-31 [2025-10-31T17:00:02.395237] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-31T17:00:02.395422] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-31T17:00:02.576912] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-31T17:00:02.577263] [WARN ] [STATE ] State set to: RUNNING [2025-10-31T17:00:02.577341] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-31T17:00:02.577384] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-31T17:00:02.577469] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-31T17:00:02.577507] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-31T17:00:04.275776] [DEBUG] [SYMBOL ] Found 2417 valid NYSE symbols. [2025-10-31T17:00:04.275961] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-31T17:00:04.276242] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-31T17:00:04.276850] [INFO ] [LOCAL ] Symbols cache updated with 2365 symbols. [2025-10-31T17:00:04.276907] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-31T17:00:04.276939] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-31T17:00:04.276994] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-31T17:00:04.277026] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-31T17:00:04.277054] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-31T17:00:04.277435] [DEBUG] [LOCAL ] Found 2365 symbols in cached list. [2025-10-31T17:00:04.277487] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-31T17:00:04.277666] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-31T17:00:04.277722] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2365 valid symbols. [2025-10-31T17:00:04.277755] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-31T17:00:04.277787] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-31T17:00:04.282997] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/TIXT.csv (symbol TIXT no longer active). [2025-10-31T17:00:04.302165] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/CCRD.csv (symbol CCRD no longer active). [2025-10-31T17:00:04.307118] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-31T17:00:04.312395] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/TIXT.csv (symbol TIXT no longer active). [2025-10-31T17:00:04.331089] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/CCRD.csv (symbol CCRD no longer active). [2025-10-31T17:00:04.336060] [INFO ] [LOCAL ] Deleted 4 obsolete data files. [2025-10-31T17:00:04.336119] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-31T17:00:04.336157] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-31T17:00:04.336187] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-31T17:00:04.336248] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-31T17:00:04.336707] [DEBUG] [LOCAL ] Found 2365 symbols in cached list. [2025-10-31T17:00:04.336760] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-31T17:00:04.336795] [INFO ] [MAIN ] Starting incremental update for 2365 symbols. [2025-10-31T17:00:04.336825] [INFO ] [MAIN ] Running in parallel mode [2025-10-31T17:00:04.336987] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2365 symbols [2025-10-31T17:00:04.969468] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:05.062273] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-31T17:00:05.100255] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:05.100438] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-10-31T17:00:05.093429] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-31T17:00:05.119931] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:05.120450] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-10-31T17:00:05.120687] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-31T17:00:05.101748] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:05.120372] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-31T17:00:05.121121] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-31T17:00:05.121597] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-31T17:00:05.121435] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-31T17:00:05.121777] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-31T17:00:05.121873] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-31T17:00:05.122236] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-31T17:00:05.122156] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-31T17:00:05.122076] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-31T17:00:05.122949] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-31T17:00:05.122582] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-31T17:00:05.122806] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-31T17:00:05.135005] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-31T17:00:05.146238] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-31T17:00:05.123118] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-31T17:00:05.156810] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-31T17:00:05.167490] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-31T17:00:05.146047] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-31T17:00:05.254851] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-31T17:00:06.566519] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:06.647001] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:06.695574] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:06.697101] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-31T17:00:06.697668] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-31T17:00:06.657519] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-31T17:00:06.719903] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:06.720688] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-31T17:00:07.078081] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-31T17:00:07.079067] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-31T17:00:07.309995] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-31T17:00:07.310932] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-31T17:00:07.553800] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-31T17:00:07.555006] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-31T17:00:07.687402] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T17:00:07.691207] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-31T17:00:07.815368] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-31T17:00:07.816335] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-31T17:00:08.015707] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-10-31T17:00:08.016692] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-31T17:00:08.140521] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T17:00:08.150595] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-31T17:00:08.201063] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.18 seconds). [2025-10-31T17:00:08.202102] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-31T17:00:08.366749] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-31T17:00:08.370682] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-31T17:00:08.412762] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-31T17:00:08.413594] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-31T17:00:08.666766] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-31T17:00:08.677126] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-31T17:00:08.717066] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-31T17:00:08.718154] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-31T17:00:08.943766] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-31T17:00:08.944668] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-31T17:00:09.375451] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T17:00:09.388754] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-31T17:00:09.391368] [INFO ] [REMOTE ] AAM: Full fetch complete (913 records). [2025-10-31T17:00:09.391615] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-31T17:00:09.390140] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-31T17:00:09.708818] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-31T17:00:09.709116] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:00:09.709896] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:00:09.711166] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-31T17:00:09.711313] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-31T17:00:09.723810] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-31T17:00:09.723670] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-31T17:00:09.724965] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-31T17:00:09.725041] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-31T17:00:09.725117] [INFO ] [MAIN ] Update Progress: 1/2365 symbols completed. AAM took 5.4s. Estimated remaining: 3h 32m 18s. Rate: 11.1 symbols/min [2025-10-31T17:00:09.987354] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:10.051004] [DEBUG] [LOCAL ] AAP: Loaded 51923 existing records from primary storage. [2025-10-31T17:00:10.051401] [INFO ] [MAIN ] AAP: Loaded 51923 existing records. [2025-10-31T17:00:10.276928] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:00:10.277828] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-31T17:00:10.281978] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-31T17:00:10.282899] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-31T17:00:10.283070] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-31T17:00:10.471467] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T17:00:10.568486] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-31T17:00:10.634637] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-31T17:00:10.657146] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-31T17:00:10.735850] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:10.736180] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-31T17:00:11.451546] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T17:00:11.457344] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-31T17:00:11.496629] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-31T17:00:11.507121] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-31T17:00:12.016387] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T17:00:12.026247] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-31T17:00:12.274030] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-31T17:00:12.279346] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-31T17:00:12.309527] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-31T17:00:12.320440] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-31T17:00:12.834821] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T17:00:12.845847] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-31T17:00:13.506508] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T17:00:13.513755] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-31T17:00:13.700043] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-31T17:00:13.709692] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-31T17:00:14.374871] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-31T17:00:14.386537] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-31T17:00:14.421419] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-31T17:00:14.436435] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-31T17:00:14.463812] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-31T17:00:14.468967] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-31T17:00:15.136817] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T17:00:15.142760] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-31T17:00:15.859691] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-31T17:00:15.870790] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-31T17:00:16.300818] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-31T17:00:16.313019] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-31T17:00:16.404777] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T17:00:16.409817] [INFO ] [REMOTE ] AAMI: Full fetch complete (33125 records). [2025-10-31T17:00:16.409950] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-31T17:00:16.410477] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:00:16.410557] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:00:16.410623] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:00:16.410713] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-31T17:00:16.410777] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-31T17:00:16.410814] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-31T17:00:16.410853] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-31T17:00:16.411284] [INFO ] [MAIN ] Update Progress: 2/2365 symbols completed. AAMI took 12.0s. Estimated remaining: 3h 57m 46s. Rate: 9.9 symbols/min [2025-10-31T17:00:16.579350] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:16.610844] [DEBUG] [LOCAL ] AAT: Loaded 30102 existing records from primary storage. [2025-10-31T17:00:16.611108] [INFO ] [MAIN ] AAT: Loaded 30102 existing records. [2025-10-31T17:00:16.796036] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:00:16.796421] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-31T17:00:16.796544] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-31T17:00:16.796906] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-31T17:00:16.796966] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-31T17:00:17.154251] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-31T17:00:17.206531] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-31T17:00:17.250850] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:17.251361] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-31T17:00:17.348419] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-31T17:00:17.360598] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-31T17:00:17.645397] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T17:00:17.656364] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-31T17:00:18.333270] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T17:00:18.338637] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-31T17:00:18.692392] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-31T17:00:18.703824] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-31T17:00:19.263240] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T17:00:19.269250] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-31T17:00:19.368770] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-31T17:00:19.381379] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-31T17:00:19.551898] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-31T17:00:19.563072] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-31T17:00:20.157792] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T17:00:20.164200] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-31T17:00:20.608193] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T17:00:20.620247] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-31T17:00:21.066427] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-31T17:00:21.078022] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-31T17:00:21.149600] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-31T17:00:21.157376] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-31T17:00:21.302871] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T17:00:21.321131] [INFO ] [REMOTE ] A: Full fetch complete (73529 records). [2025-10-31T17:00:21.321383] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-31T17:00:21.465144] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-31T17:00:21.507338] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-31T17:00:21.798214] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-31T17:00:21.798329] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-31T17:00:21.799323] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-31T17:00:21.799400] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-31T17:00:21.802152] [DEBUG] [LOCAL ] A: Trimmed 73529 records to 51183 (keeping 200 days of data) [2025-10-31T17:00:22.160588] [DEBUG] [LOCAL ] A: Primary data saved (51183 records). [2025-10-31T17:00:22.160845] [INFO ] [MAIN ] A: Full history saved. [2025-10-31T17:00:22.169396] [INFO ] [MAIN ] Update Progress: 3/2365 symbols completed. A took 17.8s. Estimated remaining: 3h 54m 0s. Rate: 10.1 symbols/min [2025-10-31T17:00:22.244131] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T17:00:22.290849] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-31T17:00:22.374839] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:22.375034] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-31T17:00:22.375074] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-31T17:00:22.375229] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-31T17:00:22.375273] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-31T17:00:22.375315] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-31T17:00:22.375348] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-31T17:00:22.750723] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:22.751201] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-31T17:00:22.784805] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-31T17:00:22.796938] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-31T17:00:22.932880] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:00:22.933189] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-31T17:00:22.933276] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:00:22.933324] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-31T17:00:22.933363] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:00:22.933402] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-31T17:00:22.933456] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-31T17:00:22.933491] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-31T17:00:22.933529] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-31T17:00:22.933575] [INFO ] [MAIN ] Update Progress: 4/2365 symbols completed. AAUC took 0.8s. Estimated remaining: 3h 2m 57s. Rate: 12.9 symbols/min [2025-10-31T17:00:23.135916] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-31T17:00:23.175346] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:23.197735] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T17:00:23.195336] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-31T17:00:23.205979] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-31T17:00:23.224376] [DEBUG] [LOCAL ] AB: Loaded 24123 existing records from primary storage. [2025-10-31T17:00:23.224626] [INFO ] [MAIN ] AB: Loaded 24123 existing records. [2025-10-31T17:00:23.412903] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:00:23.413157] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-31T17:00:23.413206] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-31T17:00:23.413565] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-31T17:00:23.413625] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-31T17:00:23.786538] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:23.786932] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-31T17:00:24.020314] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T17:00:24.031261] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-31T17:00:24.050871] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-31T17:00:24.061728] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-31T17:00:24.680395] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T17:00:24.687845] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-31T17:00:24.768159] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T17:00:24.774567] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-31T17:00:24.891323] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-31T17:00:24.903401] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-31T17:00:25.233155] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T17:00:25.244214] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-31T17:00:25.725331] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T17:00:25.734545] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-31T17:00:25.758486] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T17:00:25.766116] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-31T17:00:26.788040] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-31T17:00:26.825791] [INFO ] [REMOTE ] AA: Full fetch complete (77742 records). [2025-10-31T17:00:26.826084] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-31T17:00:26.828207] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T17:00:26.955721] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-31T17:00:27.105393] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T17:00:27.198040] [INFO ] [REMOTE ] AAT: Full fetch complete (43223 records). [2025-10-31T17:00:27.216476] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-31T17:00:27.384228] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-31T17:00:27.400493] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-31T17:00:27.441047] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-31T17:00:27.441446] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-31T17:00:27.464975] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-31T17:00:27.559335] [DEBUG] [LOCAL ] AA: Trimmed 77742 records to 54402 (keeping 200 days of data) [2025-10-31T17:00:27.579813] [INFO ] [REMOTE ] AAP: Full fetch complete (75006 records). [2025-10-31T17:00:27.585545] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-31T17:00:27.957012] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-31T17:00:27.967425] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-31T17:00:27.973085] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-31T17:00:27.978790] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-31T17:00:28.041899] [DEBUG] [LOCAL ] AAT: Trimmed 43223 records to 30351 (keeping 200 days of data) [2025-10-31T17:00:28.582692] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-31T17:00:28.599521] [DEBUG] [LOCAL ] AAT: Primary data saved (30351 records). [2025-10-31T17:00:28.588278] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-31T17:00:28.602332] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-31T17:00:28.606994] [INFO ] [MAIN ] Update Progress: 5/2365 symbols completed. AAT took 12.2s. Estimated remaining: 3h 10m 55s. Rate: 12.4 symbols/min [2025-10-31T17:00:28.613918] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-31T17:00:28.686055] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-31T17:00:28.825109] [DEBUG] [LOCAL ] AAP: Trimmed 75006 records to 52313 (keeping 200 days of data) [2025-10-31T17:00:28.824930] [DEBUG] [LOCAL ] AA: Primary data saved (54402 records). [2025-10-31T17:00:28.836544] [INFO ] [MAIN ] AA: Full history saved. [2025-10-31T17:00:28.838435] [INFO ] [MAIN ] Update Progress: 6/2365 symbols completed. AA took 24.5s. Estimated remaining: 2h 40m 33s. Rate: 14.7 symbols/min [2025-10-31T17:00:28.838335] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-31T17:00:28.953969] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:29.054888] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-31T17:00:29.201461] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:29.202669] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-31T17:00:29.204344] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-31T17:00:29.205792] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-31T17:00:29.206336] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-31T17:00:29.207903] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-31T17:00:29.208804] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-31T17:00:29.445346] [DEBUG] [LOCAL ] ABBV: Loaded 54064 existing records from primary storage. [2025-10-31T17:00:29.470723] [INFO ] [MAIN ] ABBV: Loaded 54064 existing records. [2025-10-31T17:00:29.851331] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:00:29.921169] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-31T17:00:29.967383] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-31T17:00:30.003902] [DEBUG] [LOCAL ] AAP: Primary data saved (52313 records). [2025-10-31T17:00:30.004180] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-31T17:00:30.021490] [INFO ] [MAIN ] Update Progress: 7/2365 symbols completed. AAP took 20.3s. Estimated remaining: 2h 24m 12s. Rate: 16.4 symbols/min [2025-10-31T17:00:30.033707] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:30.033894] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-31T17:00:30.050714] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-31T17:00:30.086961] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-31T17:00:30.280546] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T17:00:30.357915] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:30.388181] [DEBUG] [LOCAL ] ABEV: No existing data file found in primary storage. [2025-10-31T17:00:30.388741] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-31T17:00:30.388833] [WARN ] [MAIN ] ABEV: No existing data found, performing full refresh instead. [2025-10-31T17:00:30.408254] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-31T17:00:30.410580] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-31T17:00:30.459519] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-31T17:00:30.496158] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-31T17:00:30.801446] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:30.811276] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-31T17:00:31.018528] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:31.018893] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-31T17:00:31.116460] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T17:00:31.122871] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-31T17:00:31.269157] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T17:00:31.273791] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-31T17:00:31.944191] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-31T17:00:31.950302] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-31T17:00:32.147238] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-31T17:00:32.152895] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-31T17:00:32.399763] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-31T17:00:32.410002] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-31T17:00:32.682271] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-31T17:00:32.692678] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-31T17:00:32.864102] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T17:00:32.869159] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-31T17:00:32.969501] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T17:00:32.976561] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-31T17:00:33.667212] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-31T17:00:33.672725] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-31T17:00:33.775246] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T17:00:33.788157] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-31T17:00:33.959192] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-31T17:00:33.969073] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-31T17:00:34.133193] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T17:00:34.141060] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-31T17:00:34.683787] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T17:00:34.689381] [INFO ] [REMOTE ] AB: Full fetch complete (43639 records). [2025-10-31T17:00:34.689475] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-31T17:00:35.065156] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-31T17:00:35.065288] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-31T17:00:35.066216] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-31T17:00:35.066701] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-31T17:00:35.067767] [DEBUG] [LOCAL ] AB: Trimmed 43639 records to 24339 (keeping 200 days of data) [2025-10-31T17:00:35.188223] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T17:00:35.211286] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-31T17:00:35.265182] [DEBUG] [LOCAL ] AB: Primary data saved (24339 records). [2025-10-31T17:00:35.266878] [INFO ] [MAIN ] AB: Full history saved. [2025-10-31T17:00:35.266803] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T17:00:35.267036] [INFO ] [MAIN ] Update Progress: 8/2365 symbols completed. AB took 12.3s. Estimated remaining: 2h 31m 53s. Rate: 15.5 symbols/min [2025-10-31T17:00:35.322044] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-31T17:00:35.452139] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:35.469806] [DEBUG] [LOCAL ] ABG: Loaded 17447 existing records from primary storage. [2025-10-31T17:00:35.470047] [INFO ] [MAIN ] ABG: Loaded 17447 existing records. [2025-10-31T17:00:35.648151] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:00:35.648468] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-31T17:00:35.648546] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-31T17:00:35.648836] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-31T17:00:35.648954] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-31T17:00:35.842816] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-31T17:00:35.905951] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-31T17:00:36.057780] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:36.058183] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-31T17:00:36.075159] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-31T17:00:36.081360] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-31T17:00:36.765177] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-31T17:00:36.776564] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-31T17:00:36.799516] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-31T17:00:36.803782] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-31T17:00:37.125363] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T17:00:37.133425] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-31T17:00:37.607294] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T17:00:37.611452] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-31T17:00:37.678961] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-31T17:00:37.690050] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-31T17:00:37.966199] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T17:00:37.974049] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-31T17:00:38.049545] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-31T17:00:38.060681] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-31T17:00:38.259059] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T17:00:38.263814] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-31T17:00:38.986329] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T17:00:38.993161] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-31T17:00:39.158393] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-31T17:00:39.164932] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-31T17:00:39.242520] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-31T17:00:39.254501] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-31T17:00:39.342138] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T17:00:39.352602] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-31T17:00:39.830735] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T17:00:39.835359] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-31T17:00:40.153909] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-31T17:00:40.165448] [INFO ] [REMOTE ] ABCB: Full fetch complete (44984 records). [2025-10-31T17:00:40.165670] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-31T17:00:40.556884] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-31T17:00:40.557093] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-31T17:00:40.557668] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-31T17:00:40.557858] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-31T17:00:40.568854] [DEBUG] [LOCAL ] ABCB: Trimmed 44984 records to 30555 (keeping 200 days of data) [2025-10-31T17:00:40.568716] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T17:00:40.573529] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-31T17:00:40.762770] [DEBUG] [LOCAL ] ABCB: Primary data saved (30555 records). [2025-10-31T17:00:40.762990] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-31T17:00:40.763252] [INFO ] [MAIN ] Update Progress: 9/2365 symbols completed. ABCB took 11.9s. Estimated remaining: 2h 38m 56s. Rate: 14.8 symbols/min [2025-10-31T17:00:40.883895] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-31T17:00:40.937677] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-31T17:00:41.008864] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:41.024956] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-31T17:00:41.037268] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-31T17:00:41.063744] [DEBUG] [LOCAL ] ABM: Loaded 31797 existing records from primary storage. [2025-10-31T17:00:41.064005] [INFO ] [MAIN ] ABM: Loaded 31797 existing records. [2025-10-31T17:00:41.237103] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:00:41.237320] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-31T17:00:41.237370] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-31T17:00:41.237550] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-31T17:00:41.237597] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-31T17:00:41.536775] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T17:00:41.562315] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-31T17:00:41.617057] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:41.617367] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-31T17:00:42.399638] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T17:00:42.413120] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-31T17:00:42.427631] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-31T17:00:42.433272] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-31T17:00:42.508559] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-31T17:00:42.520472] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-31T17:00:42.632258] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T17:00:42.638392] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-31T17:00:43.098105] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T17:00:43.103740] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-31T17:00:43.369777] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-31T17:00:43.374994] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-31T17:00:43.873290] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T17:00:43.884711] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-31T17:00:44.030495] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T17:00:44.034959] [INFO ] [REMOTE ] ABG: Full fetch complete (26859 records). [2025-10-31T17:00:44.035102] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-31T17:00:44.424685] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-31T17:00:44.424904] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-31T17:00:44.448097] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-31T17:00:44.451593] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-31T17:00:44.452512] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T17:00:44.464391] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-31T17:00:44.464013] [DEBUG] [LOCAL ] ABG: Trimmed 26859 records to 17583 (keeping 200 days of data) [2025-10-31T17:00:44.496120] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-31T17:00:44.584552] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-31T17:00:44.617280] [DEBUG] [LOCAL ] ABG: Primary data saved (17583 records). [2025-10-31T17:00:44.617438] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-31T17:00:44.617525] [INFO ] [MAIN ] Update Progress: 10/2365 symbols completed. ABG took 9.3s. Estimated remaining: 2h 38m 6s. Rate: 14.9 symbols/min [2025-10-31T17:00:44.804617] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:44.859706] [DEBUG] [LOCAL ] ABR: Loaded 52159 existing records from primary storage. [2025-10-31T17:00:44.860008] [INFO ] [MAIN ] ABR: Loaded 52159 existing records. [2025-10-31T17:00:45.035606] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:00:45.035848] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-31T17:00:45.035912] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-31T17:00:45.036338] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-31T17:00:45.036396] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-31T17:00:45.387072] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:45.387388] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-31T17:00:45.579452] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T17:00:45.587495] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-31T17:00:45.642294] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-31T17:00:45.655031] [INFO ] [REMOTE ] ABEV: Full fetch complete (76938 records). [2025-10-31T17:00:45.655197] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-31T17:00:45.656062] [FATAL] [VALIDATOR ] ABEV: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:00:45.656174] [FATAL] [MAIN ] ABEV: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:00:45.656256] [WARN ] [MAIN ] ABEV: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:00:45.656349] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-31T17:00:45.656441] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-31T17:00:45.656496] [INFO ] [LOCAL ] ABEV: Starting deletion of derivative data. [2025-10-31T17:00:45.656566] [DEBUG] [LOCAL ] ABEV: No derivative data file found to delete. [2025-10-31T17:00:45.656672] [INFO ] [MAIN ] Update Progress: 11/2365 symbols completed. ABEV took 15.6s. Estimated remaining: 2h 27m 22s. Rate: 16.0 symbols/min [2025-10-31T17:00:45.833739] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:45.833898] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-31T17:00:45.833936] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-31T17:00:45.834043] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-31T17:00:45.834085] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-31T17:00:45.834129] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-31T17:00:45.834165] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-31T17:00:46.194697] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:46.195053] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-31T17:00:46.262046] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-31T17:00:46.273809] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-31T17:00:46.422299] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T17:00:46.428017] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-31T17:00:46.844852] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T17:00:46.855024] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-31T17:00:46.892952] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T17:00:46.904968] [INFO ] [REMOTE ] ABBV: Full fetch complete (77839 records). [2025-10-31T17:00:46.905114] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-31T17:00:47.292420] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-31T17:00:47.292512] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-31T17:00:47.293232] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-31T17:00:47.293346] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-31T17:00:47.294914] [DEBUG] [LOCAL ] ABBV: Trimmed 77839 records to 54454 (keeping 200 days of data) [2025-10-31T17:00:47.637967] [DEBUG] [LOCAL ] ABBV: Primary data saved (54454 records). [2025-10-31T17:00:47.638437] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-31T17:00:47.639934] [INFO ] [MAIN ] Update Progress: 12/2365 symbols completed. ABBV took 19.0s. Estimated remaining: 2h 21m 31s. Rate: 16.6 symbols/min [2025-10-31T17:00:47.833114] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:47.835777] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-31T17:00:47.836286] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-31T17:00:47.838279] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-31T17:00:47.838431] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-31T17:00:47.838555] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-31T17:00:47.845954] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-31T17:00:47.846337] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-31T17:00:47.846507] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-31T17:00:48.168219] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-31T17:00:48.254014] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:48.254363] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-31T17:00:48.249015] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-31T17:00:48.289429] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-31T17:00:48.299463] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-31T17:00:48.874151] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T17:00:48.881462] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-31T17:00:49.229946] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T17:00:49.234705] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-31T17:00:49.708849] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T17:00:49.723298] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-31T17:00:49.747375] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-31T17:00:49.783072] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-31T17:00:49.785958] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-31T17:00:49.825631] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T17:00:49.857639] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-31T17:00:50.657638] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-31T17:00:50.762471] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T17:00:50.807230] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T17:00:51.111074] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T17:00:51.457674] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-31T17:00:51.995604] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T17:00:52.257754] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-31T17:00:52.718564] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T17:00:52.725906] [INFO ] [REMOTE ] ABM: Full fetch complete (45094 records). [2025-10-31T17:00:52.726019] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-31T17:00:53.062729] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-31T17:00:53.102046] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-31T17:00:53.102114] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-31T17:00:53.102539] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-31T17:00:53.102579] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-31T17:00:53.103540] [DEBUG] [LOCAL ] ABM: Trimmed 45094 records to 32032 (keeping 200 days of data) [2025-10-31T17:00:53.289757] [DEBUG] [LOCAL ] ABM: Primary data saved (32032 records). [2025-10-31T17:00:53.289902] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-31T17:00:53.289985] [INFO ] [MAIN ] Update Progress: 13/2365 symbols completed. ABM took 12.5s. Estimated remaining: 2h 27m 37s. Rate: 15.9 symbols/min [2025-10-31T17:00:53.456135] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:00:53.456308] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-31T17:00:53.456347] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-31T17:00:53.456453] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-31T17:00:53.456494] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-31T17:00:53.456535] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-31T17:00:53.456567] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-31T17:00:53.820092] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:00:53.852811] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-31T17:00:53.862837] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-31T17:00:54.563794] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T17:00:54.657705] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-31T17:00:54.923403] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T17:00:55.457691] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-31T17:00:56.090698] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T17:00:56.257610] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-31T17:00:56.825027] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T17:00:57.066310] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-31T17:00:57.086751] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-31T17:00:57.857708] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-31T17:00:57.983405] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T17:00:58.657684] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-31T17:00:59.386364] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T17:00:59.457625] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-31T17:00:59.630628] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T17:01:00.257691] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-31T17:01:01.057611] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-31T17:01:01.136744] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-31T17:01:01.211710] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-31T17:01:01.857682] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-31T17:01:02.157612] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T17:01:02.579935] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T17:01:02.657606] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-31T17:01:03.457678] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-31T17:01:03.861622] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T17:01:04.258799] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-31T17:01:04.265069] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T17:01:05.057716] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-31T17:01:05.857688] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-31T17:01:05.901190] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-31T17:01:06.168317] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T17:01:06.657675] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-31T17:01:07.451039] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T17:01:07.461528] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-31T17:01:08.051219] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-31T17:01:08.257636] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-31T17:01:08.324948] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-31T17:01:09.057684] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-31T17:01:09.375744] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T17:01:09.726804] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T17:01:09.739546] [INFO ] [REMOTE ] ABT: Full fetch complete (77776 records). [2025-10-31T17:01:09.739732] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-31T17:01:09.862767] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-31T17:01:10.150664] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-31T17:01:10.150753] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-31T17:01:10.151616] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-31T17:01:10.151696] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-31T17:01:10.153184] [DEBUG] [LOCAL ] ABT: Trimmed 77776 records to 54405 (keeping 200 days of data) [2025-10-31T17:01:10.490190] [DEBUG] [LOCAL ] ABT: Primary data saved (54405 records). [2025-10-31T17:01:10.490364] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-31T17:01:10.490455] [INFO ] [MAIN ] Update Progress: 14/2365 symbols completed. ABT took 24.8s. Estimated remaining: 3h 5m 9s. Rate: 12.7 symbols/min [2025-10-31T17:01:10.672386] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-31T17:01:10.676606] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:01:10.692713] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T17:01:10.720329] [DEBUG] [LOCAL ] ACEL: Loaded 25593 existing records from primary storage. [2025-10-31T17:01:10.720618] [INFO ] [MAIN ] ACEL: Loaded 25593 existing records. [2025-10-31T17:01:10.899149] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:01:10.899377] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-31T17:01:10.899424] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-31T17:01:10.899754] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-31T17:01:10.899811] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-31T17:01:11.251969] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:01:11.457701] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-31T17:01:12.055171] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-31T17:01:12.257687] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-31T17:01:12.448511] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T17:01:12.452983] [INFO ] [REMOTE ] ACA: Full fetch complete (33833 records). [2025-10-31T17:01:12.453077] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-31T17:01:12.453544] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:01:12.453626] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:01:12.453706] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:01:12.453776] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-31T17:01:12.453838] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-31T17:01:12.453875] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-31T17:01:12.453914] [DEBUG] [LOCAL ] ACA: No derivative data file found to delete. [2025-10-31T17:01:12.453968] [INFO ] [MAIN ] Update Progress: 15/2365 symbols completed. ACA took 24.8s. Estimated remaining: 2h 57m 52s. Rate: 13.2 symbols/min [2025-10-31T17:01:12.626984] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:01:12.627197] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-31T17:01:12.627242] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-31T17:01:12.627354] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-31T17:01:12.627397] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-31T17:01:12.627440] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-31T17:01:12.627475] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-31T17:01:12.983359] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:01:13.057629] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-31T17:01:13.619955] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T17:01:13.857693] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-31T17:01:14.321236] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T17:01:14.657672] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-31T17:01:15.457627] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-31T17:01:15.576308] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T17:01:15.747782] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-31T17:01:15.758997] [INFO ] [REMOTE ] ABR: Full fetch complete (74966 records). [2025-10-31T17:01:15.759138] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-31T17:01:15.759888] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:01:15.759977] [FATAL] [MAIN ] ABR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:01:15.760020] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:01:15.760077] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-31T17:01:15.760210] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-31T17:01:15.760279] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-10-31T17:01:15.760492] [DEBUG] [LOCAL ] ABR: Deleted derivative data file. [2025-10-31T17:01:15.761683] [INFO ] [MAIN ] Update Progress: 16/2365 symbols completed. ABR took 31.1s. Estimated remaining: 2h 54m 46s. Rate: 13.4 symbols/min [2025-10-31T17:01:15.930896] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:01:15.983890] [DEBUG] [LOCAL ] ACI: Loaded 53669 existing records from primary storage. [2025-10-31T17:01:15.984203] [INFO ] [MAIN ] ACI: Loaded 53669 existing records. [2025-10-31T17:01:16.160472] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:01:16.160756] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-31T17:01:16.160828] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-31T17:01:16.161155] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-31T17:01:16.161212] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-31T17:01:16.262760] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-31T17:01:16.521825] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:01:17.057718] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-31T17:01:17.857626] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-31T17:01:18.051182] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-31T17:01:18.446012] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.99 seconds). [2025-10-31T17:01:18.657687] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-31T17:01:18.708480] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-31T17:01:19.356593] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T17:01:19.457675] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-31T17:01:20.257692] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-31T17:01:20.315066] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T17:01:20.799977] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-31T17:01:21.057710] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-31T17:01:21.534317] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T17:01:21.857689] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-31T17:01:22.657741] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-31T17:01:22.988971] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-31T17:01:23.311322] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T17:01:23.457712] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-31T17:01:23.707077] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-31T17:01:23.714446] [INFO ] [REMOTE ] ACCO: Full fetch complete (53357 records). [2025-10-31T17:01:23.714592] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-31T17:01:23.715220] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:01:23.715302] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:01:23.715345] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:01:23.715402] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-31T17:01:23.715458] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-31T17:01:23.715493] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-31T17:01:23.715577] [DEBUG] [LOCAL ] ACCO: No derivative data file found to delete. [2025-10-31T17:01:23.715639] [INFO ] [MAIN ] Update Progress: 17/2365 symbols completed. ACCO took 30.4s. Estimated remaining: 3h 2m 44s. Rate: 12.8 symbols/min [2025-10-31T17:01:23.886481] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:01:23.926182] [DEBUG] [LOCAL ] ACM: Loaded 42483 existing records from primary storage. [2025-10-31T17:01:23.926478] [INFO ] [MAIN ] ACM: Loaded 42483 existing records. [2025-10-31T17:01:24.102125] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:01:24.102323] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-31T17:01:24.102371] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-31T17:01:24.102617] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-31T17:01:24.102696] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-31T17:01:24.260826] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-31T17:01:24.459618] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:01:25.057713] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-31T17:01:25.494678] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-31T17:01:25.797812] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-31T17:01:25.857666] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-31T17:01:26.158775] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T17:01:26.657683] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-31T17:01:27.192492] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:01:27.457636] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-31T17:01:27.508921] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-31T17:01:28.257684] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-31T17:01:29.057675] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-31T17:01:29.631724] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T17:01:29.814350] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-31T17:01:29.857603] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-31T17:01:30.190909] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-31T17:01:30.657692] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-31T17:01:31.457724] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-31T17:01:31.882003] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-31T17:01:32.000699] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T17:01:32.230164] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-31T17:01:32.257634] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-31T17:01:33.030681] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T17:01:33.057623] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-31T17:01:33.825381] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T17:01:33.857639] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-31T17:01:34.657676] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-31T17:01:34.695671] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-31T17:01:35.457684] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-31T17:01:35.932402] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T17:01:36.257676] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-31T17:01:36.451711] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T17:01:37.057700] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-31T17:01:37.480930] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T17:01:37.857670] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-31T17:01:38.059317] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-31T17:01:38.065025] [INFO ] [REMOTE ] ACEL: Full fetch complete (38613 records). [2025-10-31T17:01:38.065172] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-31T17:01:38.437555] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-31T17:01:38.437627] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-31T17:01:38.438065] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-31T17:01:38.438126] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-31T17:01:38.438925] [DEBUG] [LOCAL ] ACEL: Trimmed 38613 records to 25783 (keeping 200 days of data) [2025-10-31T17:01:38.582970] [DEBUG] [LOCAL ] ACEL: Primary data saved (25783 records). [2025-10-31T17:01:38.583106] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-31T17:01:38.583185] [INFO ] [MAIN ] Update Progress: 18/2365 symbols completed. ACEL took 28.1s. Estimated remaining: 3h 24m 49s. Rate: 11.5 symbols/min [2025-10-31T17:01:38.664848] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-31T17:01:38.775698] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:01:38.825252] [DEBUG] [LOCAL ] ACN: Loaded 53815 existing records from primary storage. [2025-10-31T17:01:38.825604] [INFO ] [MAIN ] ACN: Loaded 53815 existing records. [2025-10-31T17:01:39.005513] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:01:39.005754] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-31T17:01:39.005805] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-31T17:01:39.006015] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-31T17:01:39.006071] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-31T17:01:39.358742] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:01:39.457682] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-31T17:01:39.804141] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-31T17:01:39.816576] [INFO ] [REMOTE ] ACI: Full fetch complete (77227 records). [2025-10-31T17:01:39.816753] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-31T17:01:40.260024] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-31T17:01:40.259013] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-31T17:01:40.287587] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-31T17:01:40.287755] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-31T17:01:40.289383] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-31T17:01:40.295613] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-31T17:01:40.298089] [DEBUG] [LOCAL ] ACI: Trimmed 77227 records to 54058 (keeping 200 days of data) [2025-10-31T17:01:40.647930] [DEBUG] [LOCAL ] ACI: Primary data saved (54058 records). [2025-10-31T17:01:40.648066] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-31T17:01:40.648862] [INFO ] [MAIN ] Update Progress: 19/2365 symbols completed. ACI took 24.9s. Estimated remaining: 3h 18m 12s. Rate: 11.8 symbols/min [2025-10-31T17:01:40.851019] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:01:40.851238] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-31T17:01:40.851308] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-31T17:01:40.851456] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-31T17:01:40.851533] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-31T17:01:40.851623] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-31T17:01:40.851715] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-31T17:01:41.091697] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-31T17:01:41.274015] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:01:41.857951] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-31T17:01:41.863028] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T17:01:41.911449] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-31T17:01:42.476409] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T17:01:42.657886] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-31T17:01:43.127159] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T17:01:43.457684] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-31T17:01:43.772168] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T17:01:44.257678] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-31T17:01:44.403321] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T17:01:45.057673] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-31T17:01:45.191550] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-31T17:01:45.857679] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-31T17:01:46.443077] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-31T17:01:46.657692] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-31T17:01:46.702084] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T17:01:47.457686] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-31T17:01:48.020760] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T17:01:48.257719] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-31T17:01:48.917502] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T17:01:49.057736] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-31T17:01:49.210768] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T17:01:49.857736] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-31T17:01:50.656068] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-31T17:01:50.664104] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-31T17:01:51.059390] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T17:01:51.457745] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-31T17:01:51.763054] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T17:01:52.257685] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-31T17:01:52.814500] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T17:01:53.057708] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-31T17:01:53.857672] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-31T17:01:54.512831] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-31T17:01:54.615722] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-31T17:01:54.657606] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-31T17:01:55.174201] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T17:01:55.183914] [INFO ] [REMOTE ] ACM: Full fetch complete (62909 records). [2025-10-31T17:01:55.184046] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-31T17:01:55.462853] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-31T17:01:55.576200] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-31T17:01:55.576288] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-31T17:01:55.576922] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-31T17:01:55.576993] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-31T17:01:55.578335] [DEBUG] [LOCAL ] ACM: Trimmed 62909 records to 42773 (keeping 200 days of data) [2025-10-31T17:01:55.840154] [DEBUG] [LOCAL ] ACM: Primary data saved (42773 records). [2025-10-31T17:01:55.840275] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-31T17:01:55.842416] [INFO ] [MAIN ] Update Progress: 20/2365 symbols completed. ACM took 32.1s. Estimated remaining: 3h 37m 54s. Rate: 10.8 symbols/min [2025-10-31T17:01:56.022830] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:01:56.032005] [DEBUG] [LOCAL ] ACR: Loaded 5256 existing records from primary storage. [2025-10-31T17:01:56.032230] [INFO ] [MAIN ] ACR: Loaded 5256 existing records. [2025-10-31T17:01:56.221772] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:01:56.222457] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-31T17:01:56.222581] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-31T17:01:56.222971] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-31T17:01:56.223045] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-31T17:01:56.262886] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-31T17:01:56.357666] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-31T17:01:56.647160] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:01:57.057715] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-31T17:01:57.377927] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:01:57.562385] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-31T17:01:57.591870] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-31T17:01:57.857709] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-31T17:01:58.300963] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-31T17:01:58.657690] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-31T17:01:59.191715] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T17:01:59.457719] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-31T17:02:00.257630] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-31T17:02:00.446086] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-31T17:02:01.057725] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-31T17:02:01.857712] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-31T17:02:02.051390] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T17:02:02.514477] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-31T17:02:02.527583] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-31T17:02:02.527800] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-31T17:02:02.529250] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:02:02.529369] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:02:02.529444] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:02:02.529521] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-31T17:02:02.529589] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-31T17:02:02.529666] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-31T17:02:02.529751] [DEBUG] [LOCAL ] ACHR: No derivative data file found to delete. [2025-10-31T17:02:02.529851] [INFO ] [MAIN ] Update Progress: 21/2365 symbols completed. ACHR took 50.1s. Estimated remaining: 3h 39m 53s. Rate: 10.7 symbols/min [2025-10-31T17:02:02.664172] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-31T17:02:02.755536] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:02.791424] [DEBUG] [LOCAL ] ACRE: Loaded 32623 existing records from primary storage. [2025-10-31T17:02:02.791727] [INFO ] [MAIN ] ACRE: Loaded 32623 existing records. [2025-10-31T17:02:03.023987] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:02:03.024802] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-31T17:02:03.024864] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-31T17:02:03.025483] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-31T17:02:03.025541] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-31T17:02:03.366458] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T17:02:03.460753] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-31T17:02:03.467029] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:03.507664] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-31T17:02:03.948687] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T17:02:04.257720] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-31T17:02:04.794877] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-31T17:02:05.057749] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-31T17:02:05.443331] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-31T17:02:05.857725] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-31T17:02:06.242170] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T17:02:06.657701] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-31T17:02:07.457725] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-31T17:02:07.812999] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T17:02:08.257723] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-31T17:02:09.064871] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-31T17:02:09.071375] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-31T17:02:09.302417] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T17:02:09.857700] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-31T17:02:10.135700] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-31T17:02:10.657742] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-31T17:02:11.457695] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-31T17:02:11.637695] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-31T17:02:11.806698] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-31T17:02:11.814866] [INFO ] [REMOTE ] ACP: Full fetch complete (46061 records). [2025-10-31T17:02:11.815004] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-31T17:02:12.233111] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-31T17:02:12.233193] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-31T17:02:12.233694] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-31T17:02:12.233763] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-31T17:02:12.235054] [DEBUG] [LOCAL ] ACP: Trimmed 46061 records to 31123 (keeping 200 days of data) [2025-10-31T17:02:12.284151] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-31T17:02:12.419031] [DEBUG] [LOCAL ] ACP: Primary data saved (31123 records). [2025-10-31T17:02:12.419265] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-31T17:02:12.419372] [INFO ] [MAIN ] Update Progress: 22/2365 symbols completed. ACP took 31.8s. Estimated remaining: 3h 47m 21s. Rate: 10.3 symbols/min [2025-10-31T17:02:12.617881] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:02:12.616597] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:12.638395] [DEBUG] [LOCAL ] ACV: Loaded 7373 existing records from primary storage. [2025-10-31T17:02:12.638577] [INFO ] [MAIN ] ACV: Loaded 7373 existing records. [2025-10-31T17:02:12.828074] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:02:12.828414] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-31T17:02:12.828477] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-31T17:02:12.829405] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-31T17:02:12.829464] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-31T17:02:13.062696] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-31T17:02:13.205140] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:13.247387] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-31T17:02:13.259052] [INFO ] [REMOTE ] ACN: Full fetch complete (77035 records). [2025-10-31T17:02:13.259199] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-31T17:02:13.260093] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:02:13.260188] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:02:13.260231] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:02:13.260308] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-31T17:02:13.260388] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-31T17:02:13.260466] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-10-31T17:02:13.260611] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-10-31T17:02:13.262854] [INFO ] [MAIN ] Update Progress: 23/2365 symbols completed. ACN took 34.7s. Estimated remaining: 3h 38m 48s. Rate: 10.7 symbols/min [2025-10-31T17:02:13.458239] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:13.508239] [DEBUG] [LOCAL ] ACVA: Loaded 49412 existing records from primary storage. [2025-10-31T17:02:13.508552] [INFO ] [MAIN ] ACVA: Loaded 49412 existing records. [2025-10-31T17:02:13.690617] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:02:13.690865] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-31T17:02:13.690914] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-31T17:02:13.691106] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-31T17:02:13.691154] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-31T17:02:13.865748] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-31T17:02:14.070727] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:14.155060] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T17:02:14.499066] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T17:02:14.657681] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-31T17:02:15.208367] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-31T17:02:15.457702] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-31T17:02:15.926994] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-31T17:02:16.257734] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-31T17:02:16.662815] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-31T17:02:17.057672] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-31T17:02:17.590746] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T17:02:17.592817] [INFO ] [REMOTE ] ACR: Full fetch complete (8549 records). [2025-10-31T17:02:17.592903] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-31T17:02:17.593383] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:02:17.593479] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:02:17.593563] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:02:17.593677] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-31T17:02:17.593774] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-31T17:02:17.593827] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-10-31T17:02:17.593974] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-10-31T17:02:17.594064] [INFO ] [MAIN ] Update Progress: 24/2365 symbols completed. ACR took 21.8s. Estimated remaining: 3h 36m 38s. Rate: 10.8 symbols/min [2025-10-31T17:02:17.775250] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:17.775441] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-31T17:02:17.775480] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-31T17:02:17.775612] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-31T17:02:17.775683] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-31T17:02:17.775745] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-31T17:02:17.775780] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-31T17:02:17.862858] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-31T17:02:18.157334] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:18.657736] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-31T17:02:18.953720] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T17:02:19.457694] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-31T17:02:19.603102] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:02:19.603448] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-31T17:02:19.603534] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:02:19.603586] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-31T17:02:19.603669] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:02:19.603743] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-31T17:02:19.603805] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-31T17:02:19.603840] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-31T17:02:19.603879] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-31T17:02:19.603923] [INFO ] [MAIN ] Update Progress: 25/2365 symbols completed. AD took 2.0s. Estimated remaining: 3h 31m 1s. Rate: 11.1 symbols/min [2025-10-31T17:02:19.809805] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:19.837478] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T17:02:19.882988] [DEBUG] [LOCAL ] ADC: Loaded 46596 existing records from primary storage. [2025-10-31T17:02:19.883320] [INFO ] [MAIN ] ADC: Loaded 46596 existing records. [2025-10-31T17:02:20.070110] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:02:20.070375] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-31T17:02:20.070429] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-31T17:02:20.070762] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-31T17:02:20.070818] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-31T17:02:20.262822] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-31T17:02:20.450240] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:21.057737] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-31T17:02:21.557043] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T17:02:21.657088] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-31T17:02:21.857676] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-31T17:02:22.657678] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-31T17:02:23.088014] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T17:02:23.457728] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-31T17:02:23.825306] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-31T17:02:24.257833] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-31T17:02:24.401184] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T17:02:25.057707] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-31T17:02:25.248496] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T17:02:25.857621] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-31T17:02:25.885940] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T17:02:26.657735] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-31T17:02:27.019594] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:02:27.047565] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-31T17:02:27.457670] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-31T17:02:27.957599] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-31T17:02:28.257732] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-31T17:02:29.057708] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-31T17:02:29.310315] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-31T17:02:29.857700] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-31T17:02:30.551772] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T17:02:30.657708] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-31T17:02:30.820855] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-31T17:02:31.457693] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-31T17:02:31.911861] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T17:02:32.257678] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-31T17:02:32.350525] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T17:02:33.057740] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-31T17:02:33.733050] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-31T17:02:33.857668] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-31T17:02:34.177242] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:02:34.657691] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-31T17:02:35.163547] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T17:02:35.457691] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-31T17:02:35.515324] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-31T17:02:35.522291] [INFO ] [REMOTE ] ACRE: Full fetch complete (48688 records). [2025-10-31T17:02:35.522397] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-31T17:02:35.899624] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-31T17:02:35.899738] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-31T17:02:35.900242] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-31T17:02:35.900303] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-31T17:02:35.901427] [DEBUG] [LOCAL ] ACRE: Trimmed 48688 records to 32786 (keeping 200 days of data) [2025-10-31T17:02:36.080591] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-31T17:02:36.093548] [DEBUG] [LOCAL ] ACRE: Primary data saved (32786 records). [2025-10-31T17:02:36.093638] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-31T17:02:36.094712] [INFO ] [MAIN ] Update Progress: 26/2365 symbols completed. ACRE took 33.6s. Estimated remaining: 3h 47m 32s. Rate: 10.3 symbols/min [2025-10-31T17:02:36.262201] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:36.260684] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-31T17:02:36.263241] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-31T17:02:36.263293] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-31T17:02:36.263372] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-31T17:02:36.263409] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-31T17:02:36.263451] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-31T17:02:36.263482] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-31T17:02:36.627959] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:37.057702] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-31T17:02:37.577524] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T17:02:37.857668] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-31T17:02:38.006809] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T17:02:38.657690] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-31T17:02:38.965151] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T17:02:39.457701] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-31T17:02:39.891382] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T17:02:40.257712] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-31T17:02:40.866048] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T17:02:41.057724] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-31T17:02:41.564360] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T17:02:41.857676] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-31T17:02:42.350057] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-31T17:02:42.551684] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T17:02:42.563620] [INFO ] [REMOTE ] ACVA: Full fetch complete (71186 records). [2025-10-31T17:02:42.563842] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-31T17:02:42.662875] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-31T17:02:42.981944] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-31T17:02:42.982042] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-31T17:02:42.982787] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-31T17:02:42.982855] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-31T17:02:42.984360] [DEBUG] [LOCAL ] ACVA: Trimmed 71186 records to 49783 (keeping 200 days of data) [2025-10-31T17:02:43.259170] [DEBUG] [LOCAL ] ACVA: Primary data saved (49783 records). [2025-10-31T17:02:43.259302] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-31T17:02:43.259383] [INFO ] [MAIN ] Update Progress: 27/2365 symbols completed. ACVA took 30.0s. Estimated remaining: 3h 49m 22s. Rate: 10.2 symbols/min [2025-10-31T17:02:43.445667] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:43.445896] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-10-31T17:02:43.445951] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-10-31T17:02:43.446112] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-31T17:02:43.446189] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-31T17:02:43.446252] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-31T17:02:43.446302] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-31T17:02:43.462809] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-31T17:02:43.845746] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:43.881733] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T17:02:44.257735] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-31T17:02:44.267416] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T17:02:44.270611] [INFO ] [REMOTE ] ACV: Full fetch complete (10744 records). [2025-10-31T17:02:44.270737] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-31T17:02:44.632792] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-31T17:02:44.632885] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-31T17:02:44.633071] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-31T17:02:44.633111] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-31T17:02:44.633518] [DEBUG] [LOCAL ] ACV: Trimmed 10744 records to 7443 (keeping 200 days of data) [2025-10-31T17:02:44.676852] [DEBUG] [LOCAL ] ACV: Primary data saved (7443 records). [2025-10-31T17:02:44.676983] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-31T17:02:44.677060] [INFO ] [MAIN ] Update Progress: 28/2365 symbols completed. ACV took 32.3s. Estimated remaining: 3h 43m 3s. Rate: 10.5 symbols/min [2025-10-31T17:02:44.856039] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:44.899510] [DEBUG] [LOCAL ] ADNT: Loaded 46161 existing records from primary storage. [2025-10-31T17:02:44.899819] [INFO ] [MAIN ] ADNT: Loaded 46161 existing records. [2025-10-31T17:02:45.062812] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-31T17:02:45.094269] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:02:45.094520] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-31T17:02:45.094585] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-31T17:02:45.095022] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-31T17:02:45.095264] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-31T17:02:45.485406] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:45.834602] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T17:02:45.845795] [INFO ] [REMOTE ] ADC: Full fetch complete (66853 records). [2025-10-31T17:02:45.845964] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-31T17:02:45.862746] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-31T17:02:46.245258] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-31T17:02:46.245359] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-31T17:02:46.246050] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-31T17:02:46.246164] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-31T17:02:46.247507] [DEBUG] [LOCAL ] ADC: Trimmed 66853 records to 46954 (keeping 200 days of data) [2025-10-31T17:02:46.397541] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T17:02:46.572683] [DEBUG] [LOCAL ] ADC: Primary data saved (46954 records). [2025-10-31T17:02:46.572830] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-31T17:02:46.572911] [INFO ] [MAIN ] Update Progress: 29/2365 symbols completed. ADC took 27.0s. Estimated remaining: 3h 37m 48s. Rate: 10.7 symbols/min [2025-10-31T17:02:46.667528] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-31T17:02:46.750058] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:02:46.796704] [DEBUG] [LOCAL ] ADT: Loaded 53812 existing records from primary storage. [2025-10-31T17:02:46.797010] [INFO ] [MAIN ] ADT: Loaded 53812 existing records. [2025-10-31T17:02:46.988741] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:02:46.989026] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-31T17:02:46.989104] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-31T17:02:46.989392] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-31T17:02:46.989451] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-31T17:02:47.420483] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:02:47.459571] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-31T17:02:47.462689] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T17:02:47.862168] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T17:02:48.257684] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-31T17:02:48.901108] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T17:02:49.057716] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-31T17:02:49.419882] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T17:02:49.857662] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-31T17:02:50.538941] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T17:02:50.657632] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-31T17:02:51.035385] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T17:02:51.457702] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-31T17:02:52.177343] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-31T17:02:52.257726] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-31T17:02:52.829697] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T17:02:53.057697] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-31T17:02:53.520313] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T17:02:53.857730] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-31T17:02:54.369356] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-31T17:02:54.657698] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-31T17:02:55.457635] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-31T17:02:55.541990] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T17:02:55.580780] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-31T17:02:56.257704] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-31T17:02:56.806317] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T17:02:57.057735] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-31T17:02:57.709588] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T17:02:57.857713] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-31T17:02:58.559938] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-31T17:02:58.657670] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-31T17:02:59.225589] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T17:02:59.457671] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-31T17:02:59.786501] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:03:00.257681] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-31T17:03:00.744382] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T17:03:01.057688] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-31T17:03:01.515260] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T17:03:01.857798] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-31T17:03:02.657699] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-31T17:03:02.808270] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-31T17:03:02.837939] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-31T17:03:03.457671] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-31T17:03:04.229130] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-31T17:03:04.257629] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-31T17:03:04.694801] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T17:03:05.057703] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-31T17:03:05.679768] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-31T17:03:05.857691] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-31T17:03:06.365310] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T17:03:06.657692] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-31T17:03:07.002782] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T17:03:07.457692] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-31T17:03:07.732267] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T17:03:08.257689] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-31T17:03:09.057622] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-31T17:03:09.095509] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-31T17:03:09.280152] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T17:03:09.857719] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-31T17:03:10.657737] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-31T17:03:10.871443] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-31T17:03:11.453608] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T17:03:11.463247] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-31T17:03:11.465380] [INFO ] [REMOTE ] ADNT: Full fetch complete (67480 records). [2025-10-31T17:03:11.465593] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-31T17:03:11.940666] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-31T17:03:11.940823] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-31T17:03:11.941564] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-31T17:03:11.941667] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-31T17:03:11.943148] [DEBUG] [LOCAL ] ADNT: Trimmed 67480 records to 46443 (keeping 200 days of data) [2025-10-31T17:03:12.067533] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T17:03:12.260668] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-31T17:03:12.273285] [DEBUG] [LOCAL ] ADNT: Primary data saved (46443 records). [2025-10-31T17:03:12.273731] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-31T17:03:12.274420] [INFO ] [MAIN ] Update Progress: 30/2365 symbols completed. ADNT took 27.6s. Estimated remaining: 4h 3m 48s. Rate: 9.6 symbols/min [2025-10-31T17:03:12.483861] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:03:12.512174] [DEBUG] [LOCAL ] ADX: Loaded 27752 existing records from primary storage. [2025-10-31T17:03:12.512475] [INFO ] [MAIN ] ADX: Loaded 27752 existing records. [2025-10-31T17:03:12.705211] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T17:03:12.710029] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:03:12.710296] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-31T17:03:12.717948] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-31T17:03:12.718622] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-31T17:03:12.718713] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-31T17:03:13.067984] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-31T17:03:13.091581] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:03:13.715475] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T17:03:13.857684] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-31T17:03:14.586010] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-31T17:03:14.657619] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-31T17:03:15.463164] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-31T17:03:15.485096] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T17:03:15.497530] [INFO ] [REMOTE ] ADT: Full fetch complete (77379 records). [2025-10-31T17:03:15.497696] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-31T17:03:15.885486] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-31T17:03:15.885586] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-31T17:03:15.886301] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-31T17:03:15.886365] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-31T17:03:15.887765] [DEBUG] [LOCAL ] ADT: Trimmed 77379 records to 54196 (keeping 200 days of data) [2025-10-31T17:03:16.194041] [DEBUG] [LOCAL ] ADT: Primary data saved (54196 records). [2025-10-31T17:03:16.194169] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-31T17:03:16.194244] [INFO ] [MAIN ] Update Progress: 31/2365 symbols completed. ADT took 29.6s. Estimated remaining: 4h 0m 45s. Rate: 9.7 symbols/min [2025-10-31T17:03:16.264717] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-31T17:03:16.369072] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:03:16.412198] [DEBUG] [LOCAL ] AEE: Loaded 50215 existing records from primary storage. [2025-10-31T17:03:16.412498] [INFO ] [MAIN ] AEE: Loaded 50215 existing records. [2025-10-31T17:03:16.595369] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:03:16.595852] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-31T17:03:16.595957] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-31T17:03:16.596456] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-31T17:03:16.596585] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-31T17:03:16.929195] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-31T17:03:16.988492] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-31T17:03:17.040561] [INFO ] [REMOTE ] ADM: Full fetch complete (77470 records). [2025-10-31T17:03:17.040360] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:03:17.049079] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-31T17:03:17.063276] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-31T17:03:17.453890] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-31T17:03:17.454047] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-31T17:03:17.454905] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-31T17:03:17.454981] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-31T17:03:17.456733] [DEBUG] [LOCAL ] ADM: Trimmed 77470 records to 54151 (keeping 200 days of data) [2025-10-31T17:03:17.660733] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T17:03:17.806252] [DEBUG] [LOCAL ] ADM: Primary data saved (54151 records). [2025-10-31T17:03:17.806414] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-31T17:03:17.806503] [INFO ] [MAIN ] Update Progress: 32/2365 symbols completed. ADM took 34.5s. Estimated remaining: 3h 55m 5s. Rate: 9.9 symbols/min [2025-10-31T17:03:17.870771] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-31T17:03:17.979978] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:03:17.980153] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-31T17:03:17.980202] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-31T17:03:17.980308] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-31T17:03:17.980349] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-31T17:03:17.980388] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-31T17:03:17.980420] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-31T17:03:18.324889] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:03:18.657693] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-31T17:03:18.702943] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-31T17:03:19.356459] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T17:03:19.367754] [INFO ] [REMOTE ] ADCT: Full fetch complete (51554 records). [2025-10-31T17:03:19.367987] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-31T17:03:19.462863] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-31T17:03:19.743219] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T17:03:19.818475] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-31T17:03:19.818566] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-31T17:03:19.819112] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-31T17:03:19.819176] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-31T17:03:19.820361] [DEBUG] [LOCAL ] ADCT: Trimmed 51554 records to 36390 (keeping 200 days of data) [2025-10-31T17:03:20.016454] [DEBUG] [LOCAL ] ADCT: Primary data saved (36390 records). [2025-10-31T17:03:20.016596] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-31T17:03:20.016698] [INFO ] [MAIN ] Update Progress: 33/2365 symbols completed. ADCT took 43.9s. Estimated remaining: 3h 50m 28s. Rate: 10.1 symbols/min [2025-10-31T17:03:20.187291] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:03:20.230151] [DEBUG] [LOCAL ] AEG: Loaded 49719 existing records from primary storage. [2025-10-31T17:03:20.230515] [INFO ] [MAIN ] AEG: Loaded 49719 existing records. [2025-10-31T17:03:20.262816] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-31T17:03:20.413577] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:03:20.413848] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-31T17:03:20.413895] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-31T17:03:20.414153] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-31T17:03:20.414192] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-31T17:03:20.770167] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:03:20.944817] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T17:03:21.057675] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-31T17:03:21.256543] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T17:03:21.857736] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-31T17:03:22.438864] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-31T17:03:22.548713] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-31T17:03:22.657701] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-31T17:03:23.156615] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T17:03:23.457678] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-31T17:03:24.257668] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-31T17:03:24.947165] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T17:03:25.057704] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-31T17:03:25.224812] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T17:03:25.857727] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-31T17:03:26.473705] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T17:03:26.657675] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-31T17:03:26.749131] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T17:03:27.457697] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-31T17:03:28.002148] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T17:03:28.257626] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-31T17:03:28.394054] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T17:03:29.057683] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-31T17:03:29.544468] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T17:03:29.582194] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-31T17:03:29.857664] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-31T17:03:30.657722] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-31T17:03:30.927744] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T17:03:31.167710] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-31T17:03:31.457628] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-31T17:03:32.257635] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-31T17:03:32.560946] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T17:03:33.057670] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-31T17:03:33.120174] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-31T17:03:33.579796] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T17:03:33.857730] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-31T17:03:34.429535] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-31T17:03:34.657704] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-31T17:03:35.457688] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-31T17:03:35.671805] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T17:03:35.960308] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-31T17:03:36.257702] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-31T17:03:37.057712] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-31T17:03:37.687212] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T17:03:37.857688] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-31T17:03:38.562251] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-31T17:03:38.657781] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-31T17:03:39.169372] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-31T17:03:39.201798] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T17:03:39.457711] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-31T17:03:39.959328] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-31T17:03:40.257709] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-31T17:03:40.785999] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T17:03:40.788161] [INFO ] [REMOTE ] AEFC: Full fetch complete (11596 records). [2025-10-31T17:03:40.788233] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-31T17:03:41.062884] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-31T17:03:41.169940] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-31T17:03:41.170023] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-31T17:03:41.170268] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-31T17:03:41.170307] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-31T17:03:41.170784] [DEBUG] [LOCAL ] AEFC: Trimmed 11596 records to 7580 (keeping 200 days of data) [2025-10-31T17:03:41.218434] [DEBUG] [LOCAL ] AEFC: Primary data saved (7580 records). [2025-10-31T17:03:41.218639] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-31T17:03:41.218776] [INFO ] [MAIN ] Update Progress: 34/2365 symbols completed. AEFC took 23.4s. Estimated remaining: 4h 7m 49s. Rate: 9.4 symbols/min [2025-10-31T17:03:41.403447] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:03:41.462589] [DEBUG] [LOCAL ] AEM: Loaded 53860 existing records from primary storage. [2025-10-31T17:03:41.463074] [INFO ] [MAIN ] AEM: Loaded 53860 existing records. [2025-10-31T17:03:41.643089] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:03:41.643380] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-31T17:03:41.643430] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-31T17:03:41.643848] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-31T17:03:41.643906] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-31T17:03:41.862896] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-31T17:03:42.020126] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:03:42.324479] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T17:03:42.331222] [INFO ] [REMOTE ] ADX: Full fetch complete (41569 records). [2025-10-31T17:03:42.331313] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-31T17:03:42.662808] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-31T17:03:42.710803] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-31T17:03:42.710878] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-31T17:03:42.711306] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-31T17:03:42.711345] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-31T17:03:42.712289] [DEBUG] [LOCAL ] ADX: Trimmed 41569 records to 27962 (keeping 200 days of data) [2025-10-31T17:03:42.887068] [DEBUG] [LOCAL ] ADX: Primary data saved (27962 records). [2025-10-31T17:03:42.887252] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-31T17:03:42.887354] [INFO ] [MAIN ] Update Progress: 35/2365 symbols completed. ADX took 30.6s. Estimated remaining: 4h 2m 29s. Rate: 9.6 symbols/min [2025-10-31T17:03:43.068048] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:03:43.123825] [DEBUG] [LOCAL ] AEO: Loaded 53953 existing records from primary storage. [2025-10-31T17:03:43.124344] [INFO ] [MAIN ] AEO: Loaded 53953 existing records. [2025-10-31T17:03:43.308736] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:03:43.309260] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-31T17:03:43.309328] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-31T17:03:43.320523] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-31T17:03:43.326498] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-31T17:03:43.405367] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T17:03:43.457880] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-31T17:03:43.726320] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:03:44.012503] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T17:03:44.257760] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-31T17:03:45.057678] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-31T17:03:45.367680] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-31T17:03:45.566940] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-31T17:03:45.583142] [INFO ] [REMOTE ] AEE: Full fetch complete (72610 records). [2025-10-31T17:03:45.583470] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-31T17:03:45.584360] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:03:45.584505] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:03:45.584586] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:03:45.584696] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-31T17:03:45.584775] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-31T17:03:45.584869] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-31T17:03:45.585155] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-10-31T17:03:45.585274] [INFO ] [MAIN ] Update Progress: 36/2365 symbols completed. AEE took 29.4s. Estimated remaining: 3h 58m 34s. Rate: 9.8 symbols/min [2025-10-31T17:03:45.756694] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:03:45.800775] [DEBUG] [LOCAL ] AER: Loaded 48002 existing records from primary storage. [2025-10-31T17:03:45.801103] [INFO ] [MAIN ] AER: Loaded 48002 existing records. [2025-10-31T17:03:45.862815] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-31T17:03:45.997531] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:03:46.009560] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-31T17:03:46.009730] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-31T17:03:46.010240] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-31T17:03:46.010300] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-31T17:03:46.011343] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-31T17:03:46.388169] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:03:46.657729] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-31T17:03:47.388238] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-31T17:03:47.457855] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-31T17:03:48.257612] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-31T17:03:48.901738] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-31T17:03:48.946313] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-31T17:03:49.057709] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-31T17:03:49.441821] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T17:03:49.857679] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-31T17:03:50.522201] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-31T17:03:50.657675] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-31T17:03:51.435357] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T17:03:51.457686] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-31T17:03:52.257267] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-31T17:03:52.263014] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-31T17:03:52.982913] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T17:03:53.057682] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-31T17:03:53.500997] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T17:03:53.857731] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-31T17:03:54.487351] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T17:03:54.657700] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-31T17:03:55.188832] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-31T17:03:55.457690] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-31T17:03:56.212990] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-31T17:03:56.257626] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-31T17:03:56.798560] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T17:03:57.057686] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-31T17:03:57.857684] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-31T17:03:58.553720] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T17:03:58.657615] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-31T17:03:58.987852] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-31T17:03:59.457618] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-31T17:03:59.633684] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-31T17:03:59.931908] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T17:04:00.257671] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-31T17:04:01.057623] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-31T17:04:01.200223] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-31T17:04:01.857717] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-31T17:04:02.349980] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-31T17:04:02.657705] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-31T17:04:03.276044] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-31T17:04:03.287001] [INFO ] [REMOTE ] AEG: Full fetch complete (70658 records). [2025-10-31T17:04:03.287149] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-31T17:04:03.463514] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-31T17:04:03.680912] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-31T17:04:03.680994] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-31T17:04:03.681732] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-31T17:04:03.681829] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-31T17:04:03.683187] [DEBUG] [LOCAL ] AEG: Trimmed 70658 records to 50087 (keeping 200 days of data) [2025-10-31T17:04:03.791476] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-31T17:04:04.000913] [DEBUG] [LOCAL ] AEG: Primary data saved (50087 records). [2025-10-31T17:04:04.001043] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-31T17:04:04.002007] [INFO ] [MAIN ] Update Progress: 37/2365 symbols completed. AEG took 44.0s. Estimated remaining: 4h 11m 19s. Rate: 9.3 symbols/min [2025-10-31T17:04:04.228689] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-31T17:04:04.257673] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-31T17:04:05.057711] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-31T17:04:05.234615] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-31T17:04:05.857721] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-31T17:04:05.902122] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T17:04:06.662731] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-31T17:04:06.681189] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-31T17:04:07.457682] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-31T17:04:07.696010] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-31T17:04:07.708411] [INFO ] [REMOTE ] AEO: Full fetch complete (77653 records). [2025-10-31T17:04:07.708575] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-31T17:04:08.124481] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-31T17:04:08.124735] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-31T17:04:08.125458] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-31T17:04:08.125533] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-31T17:04:08.127180] [DEBUG] [LOCAL ] AEO: Trimmed 77653 records to 54343 (keeping 200 days of data) [2025-10-31T17:04:08.241005] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-31T17:04:08.258219] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-31T17:04:08.490594] [DEBUG] [LOCAL ] AEO: Primary data saved (54343 records). [2025-10-31T17:04:08.490766] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-31T17:04:08.491443] [INFO ] [MAIN ] Update Progress: 38/2365 symbols completed. AEO took 25.6s. Estimated remaining: 4h 9m 11s. Rate: 9.3 symbols/min [2025-10-31T17:04:09.212200] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-31T17:04:09.223615] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-31T17:04:09.631947] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T17:04:09.848961] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T17:04:09.860405] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-31T17:04:09.862332] [INFO ] [REMOTE ] AEM: Full fetch complete (77528 records). [2025-10-31T17:04:09.862442] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-31T17:04:10.252552] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-31T17:04:10.252628] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-31T17:04:10.253348] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-31T17:04:10.253398] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-31T17:04:10.254782] [DEBUG] [LOCAL ] AEM: Trimmed 77528 records to 54249 (keeping 200 days of data) [2025-10-31T17:04:10.583823] [DEBUG] [LOCAL ] AEM: Primary data saved (54249 records). [2025-10-31T17:04:10.583965] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-31T17:04:10.585442] [INFO ] [MAIN ] Update Progress: 39/2365 symbols completed. AEM took 29.4s. Estimated remaining: 4h 4m 47s. Rate: 9.5 symbols/min [2025-10-31T17:04:11.363449] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T17:04:11.374263] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-31T17:04:12.636565] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T17:04:12.648836] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-31T17:04:13.930809] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T17:04:13.941709] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-31T17:04:14.527937] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T17:04:14.538487] [INFO ] [REMOTE ] AER: Full fetch complete (69955 records). [2025-10-31T17:04:14.538625] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-31T17:04:14.918299] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-31T17:04:14.918374] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-31T17:04:14.919024] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-31T17:04:14.919086] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-31T17:04:14.920353] [DEBUG] [LOCAL ] AER: Trimmed 69955 records to 48373 (keeping 200 days of data) [2025-10-31T17:04:15.209730] [DEBUG] [LOCAL ] AER: Primary data saved (48373 records). [2025-10-31T17:04:15.209859] [INFO ] [MAIN ] AER: Full history saved. [2025-10-31T17:04:15.210890] [INFO ] [MAIN ] Update Progress: 40/2365 symbols completed. AER took 29.6s. Estimated remaining: 4h 3m 2s. Rate: 9.6 symbols/min [2025-10-31T17:04:15.833460] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:15.858114] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:15.942513] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:15.951607] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-31T17:04:15.969987] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-31T17:04:15.974076] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:15.974451] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-10-31T17:04:15.974870] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-31T17:04:15.974962] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-31T17:04:15.975211] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-31T17:04:15.975277] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-31T17:04:15.975082] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-10-31T17:04:16.020437] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-31T17:04:16.042895] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-31T17:04:16.064154] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-31T17:04:16.074836] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-31T17:04:16.292135] [DEBUG] [LOCAL ] AESI: Loaded 50144 existing records from primary storage. [2025-10-31T17:04:16.327573] [INFO ] [MAIN ] AESI: Loaded 50144 existing records. [2025-10-31T17:04:16.437813] [DEBUG] [LOCAL ] AES: Loaded 54053 existing records from primary storage. [2025-10-31T17:04:16.559152] [INFO ] [MAIN ] AES: Loaded 54053 existing records. [2025-10-31T17:04:16.870582] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:16.926828] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-31T17:04:17.040301] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:04:17.084060] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-31T17:04:17.088026] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-31T17:04:17.148390] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:04:17.144787] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-31T17:04:17.156442] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:04:17.176828] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-31T17:04:17.176672] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-31T17:04:17.184107] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-31T17:04:17.183962] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-31T17:04:17.183784] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:17.213452] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-31T17:04:17.204391] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:04:17.224306] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-31T17:04:17.230402] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-31T17:04:17.247071] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:04:17.247309] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-31T17:04:17.263236] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-31T17:04:17.263051] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-31T17:04:17.273666] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-31T17:04:17.293016] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-31T17:04:17.310744] [INFO ] [MAIN ] Update Progress: 41/2365 symbols completed. AEXA took 2.1s. Estimated remaining: 3h 58m 59s. Rate: 9.7 symbols/min [2025-10-31T17:04:18.040845] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:18.124261] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:18.136469] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-31T17:04:18.134968] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:18.138182] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T17:04:18.138434] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-31T17:04:18.141792] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-31T17:04:18.185286] [DEBUG] [LOCAL ] AFG: Loaded 31572 existing records from primary storage. [2025-10-31T17:04:18.185723] [INFO ] [MAIN ] AFG: Loaded 31572 existing records. [2025-10-31T17:04:18.369116] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:04:18.369384] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-31T17:04:18.369433] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-31T17:04:18.369778] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-31T17:04:18.369836] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-31T17:04:18.764747] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:18.765121] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-31T17:04:18.774059] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T17:04:18.776961] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-31T17:04:19.415722] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-31T17:04:19.419293] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-31T17:04:19.459055] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T17:04:19.472515] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-31T17:04:19.762791] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T17:04:19.855864] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-31T17:04:19.944173] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-31T17:04:20.257702] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-31T17:04:20.768734] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T17:04:21.057680] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-31T17:04:21.244297] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T17:04:21.857666] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-31T17:04:22.443411] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T17:04:22.468614] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-31T17:04:22.657691] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-31T17:04:23.457734] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-31T17:04:23.996433] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T17:04:24.257636] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-31T17:04:25.015098] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-31T17:04:25.057619] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-31T17:04:25.391250] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-31T17:04:25.597750] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-31T17:04:25.857687] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-31T17:04:26.657683] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-31T17:04:27.183585] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T17:04:27.387497] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-31T17:04:27.457617] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-31T17:04:28.257695] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-31T17:04:28.851565] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T17:04:29.057631] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-31T17:04:29.857623] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-31T17:04:30.089381] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-31T17:04:30.464051] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-31T17:04:30.657681] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-31T17:04:31.003734] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T17:04:31.457707] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-31T17:04:32.050149] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T17:04:32.257629] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-31T17:04:32.348792] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-31T17:04:33.057687] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-31T17:04:33.162752] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T17:04:33.653761] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-31T17:04:33.857823] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-31T17:04:34.657697] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-31T17:04:35.273598] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T17:04:35.277141] [INFO ] [REMOTE ] AFB: Full fetch complete (16238 records). [2025-10-31T17:04:35.277360] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-31T17:04:35.278063] [FATAL] [VALIDATOR ] AFB: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:04:35.278208] [FATAL] [MAIN ] AFB: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:04:35.278311] [WARN ] [MAIN ] AFB: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:04:35.278401] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-31T17:04:35.278598] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-31T17:04:35.278726] [INFO ] [LOCAL ] AFB: Starting deletion of derivative data. [2025-10-31T17:04:35.278946] [DEBUG] [LOCAL ] AFB: No derivative data file found to delete. [2025-10-31T17:04:35.279069] [INFO ] [MAIN ] Update Progress: 42/2365 symbols completed. AFB took 20.1s. Estimated remaining: 4h 9m 46s. Rate: 9.3 symbols/min [2025-10-31T17:04:35.460338] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-31T17:04:35.504618] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:35.507588] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-31T17:04:35.523301] [DEBUG] [LOCAL ] AFGB: Loaded 2106 existing records from primary storage. [2025-10-31T17:04:35.523498] [INFO ] [MAIN ] AFGB: Loaded 2106 existing records. [2025-10-31T17:04:35.703104] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:04:35.703308] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-31T17:04:35.703355] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-31T17:04:35.703540] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-31T17:04:35.703601] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-31T17:04:36.082715] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:36.257681] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-31T17:04:36.582106] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:04:37.057672] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-31T17:04:37.857667] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-31T17:04:37.972778] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-31T17:04:38.108716] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-31T17:04:38.304836] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-31T17:04:38.657688] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-31T17:04:38.946259] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-31T17:04:39.457688] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-31T17:04:40.257721] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-31T17:04:40.638954] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-31T17:04:40.817043] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T17:04:41.057684] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-31T17:04:41.857694] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-31T17:04:42.120118] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T17:04:42.252533] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-31T17:04:42.657723] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-31T17:04:42.975417] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-31T17:04:43.457690] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-31T17:04:44.257711] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-31T17:04:44.585479] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-31T17:04:45.057672] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-31T17:04:45.444837] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-31T17:04:45.549469] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T17:04:45.857695] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-31T17:04:46.657722] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-31T17:04:47.011664] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-31T17:04:47.355608] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T17:04:47.457690] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-31T17:04:47.786159] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-31T17:04:48.257724] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-31T17:04:49.057689] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-31T17:04:49.434815] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-31T17:04:49.685556] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-31T17:04:49.857688] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-31T17:04:50.657733] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-31T17:04:51.457687] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-31T17:04:51.587526] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-31T17:04:51.599846] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-31T17:04:51.600001] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-31T17:04:51.898802] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-31T17:04:51.911660] [INFO ] [REMOTE ] AFGB: Full fetch complete (3364 records). [2025-10-31T17:04:51.911874] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-31T17:04:52.128934] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-31T17:04:52.155577] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-31T17:04:52.180972] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-31T17:04:52.217571] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-31T17:04:52.277880] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-31T17:04:52.320778] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 54443 (keeping 200 days of data) [2025-10-31T17:04:52.458685] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-31T17:04:52.467002] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-31T17:04:52.467294] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-31T17:04:52.495431] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-31T17:04:52.500540] [DEBUG] [LOCAL ] AFGB: Trimmed 3364 records to 2114 (keeping 200 days of data) [2025-10-31T17:04:52.549913] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-31T17:04:52.567736] [DEBUG] [LOCAL ] AFGB: Primary data saved (2114 records). [2025-10-31T17:04:52.569519] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-31T17:04:52.569841] [INFO ] [MAIN ] Update Progress: 43/2365 symbols completed. AFGB took 17.3s. Estimated remaining: 4h 19m 25s. Rate: 9.0 symbols/min [2025-10-31T17:04:52.846014] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:52.848180] [DEBUG] [LOCAL ] AFGC: No existing data file found in primary storage. [2025-10-31T17:04:52.848523] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-10-31T17:04:52.856203] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-31T17:04:52.858006] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-31T17:04:52.859912] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-31T17:04:52.860203] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-31T17:04:53.063432] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-31T17:04:53.359298] [DEBUG] [LOCAL ] AES: Primary data saved (54443 records). [2025-10-31T17:04:53.369590] [INFO ] [MAIN ] AES: Full history saved. [2025-10-31T17:04:53.383218] [INFO ] [MAIN ] Update Progress: 44/2365 symbols completed. AES took 38.2s. Estimated remaining: 4h 14m 7s. Rate: 9.1 symbols/min [2025-10-31T17:04:53.382967] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:53.568903] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:53.569227] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-31T17:04:53.569325] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-31T17:04:53.569580] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-31T17:04:53.569682] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-31T17:04:53.569771] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-31T17:04:53.569825] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-31T17:04:53.694107] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T17:04:53.727976] [INFO ] [REMOTE ] AFG: Full fetch complete (46593 records). [2025-10-31T17:04:53.750948] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-31T17:04:53.761183] [FATAL] [VALIDATOR ] AFG: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:04:53.775568] [FATAL] [MAIN ] AFG: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:04:53.777114] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:04:53.822558] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-31T17:04:53.854580] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-31T17:04:53.859806] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-31T17:04:53.870540] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-10-31T17:04:53.882264] [DEBUG] [LOCAL ] AFG: Deleted derivative data file. [2025-10-31T17:04:53.887860] [INFO ] [MAIN ] Update Progress: 45/2365 symbols completed. AFG took 36.6s. Estimated remaining: 4h 8m 48s. Rate: 9.3 symbols/min [2025-10-31T17:04:54.014107] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:54.157346] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:54.161821] [DEBUG] [LOCAL ] AFGE: Loaded 2193 existing records from primary storage. [2025-10-31T17:04:54.161959] [INFO ] [MAIN ] AFGE: Loaded 2193 existing records. [2025-10-31T17:04:54.267858] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-31T17:04:54.362697] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:04:54.362915] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-31T17:04:54.362967] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-31T17:04:54.363098] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-31T17:04:54.363134] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-31T17:04:54.672129] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-31T17:04:54.710906] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:54.789501] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-31T17:04:54.802247] [INFO ] [REMOTE ] AESI: Full fetch complete (71718 records). [2025-10-31T17:04:54.802415] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-31T17:04:54.803305] [FATAL] [VALIDATOR ] AESI: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:04:54.803419] [FATAL] [MAIN ] AESI: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:04:54.803465] [WARN ] [MAIN ] AESI: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:04:54.803534] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-31T17:04:54.803602] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-10-31T17:04:54.803668] [INFO ] [LOCAL ] AESI: Starting deletion of derivative data. [2025-10-31T17:04:54.803826] [DEBUG] [LOCAL ] AESI: Deleted derivative data file. [2025-10-31T17:04:54.803916] [INFO ] [MAIN ] Update Progress: 46/2365 symbols completed. AESI took 39.6s. Estimated remaining: 4h 4m 3s. Rate: 9.5 symbols/min [2025-10-31T17:04:55.003355] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-31T17:04:55.008928] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:04:55.069170] [DEBUG] [LOCAL ] AFL: Loaded 53530 existing records from primary storage. [2025-10-31T17:04:55.069663] [INFO ] [MAIN ] AFL: Loaded 53530 existing records. [2025-10-31T17:04:55.270000] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:04:55.270266] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-31T17:04:55.270318] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-31T17:04:55.270703] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-31T17:04:55.270762] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-31T17:04:55.465766] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-31T17:04:55.637766] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:04:56.031844] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-31T17:04:56.257701] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-31T17:04:56.675515] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-31T17:04:57.057686] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-31T17:04:57.377451] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-31T17:04:57.857683] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-31T17:04:58.657689] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-31T17:04:58.965316] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T17:04:59.267514] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T17:04:59.457638] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-31T17:04:59.756583] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-31T17:05:00.257672] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-31T17:05:00.702181] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-31T17:05:01.057736] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-31T17:05:01.570768] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-31T17:05:01.857713] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-31T17:05:02.182778] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-31T17:05:02.657713] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-31T17:05:03.457679] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-31T17:05:03.887451] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T17:05:04.257704] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-31T17:05:04.671820] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-31T17:05:04.684981] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T17:05:05.057705] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-31T17:05:05.463623] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-31T17:05:05.857699] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-31T17:05:06.163522] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-31T17:05:06.657713] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-31T17:05:07.035570] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-31T17:05:07.457702] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-31T17:05:07.817280] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-31T17:05:08.257680] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-31T17:05:08.675318] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-31T17:05:09.057682] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-31T17:05:09.444372] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-31T17:05:09.857669] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-31T17:05:10.283665] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-31T17:05:10.657709] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-31T17:05:11.457682] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-31T17:05:11.916268] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-31T17:05:11.919120] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T17:05:12.257679] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-31T17:05:13.057715] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-31T17:05:13.383739] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-31T17:05:13.536511] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T17:05:13.857664] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-31T17:05:14.122191] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-31T17:05:14.657705] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-31T17:05:14.927162] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-31T17:05:15.457634] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-31T17:05:15.917708] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-31T17:05:15.918809] [INFO ] [REMOTE ] AFGC: Full fetch complete (3557 records). [2025-10-31T17:05:15.918876] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-31T17:05:16.267191] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-31T17:05:16.310544] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-31T17:05:16.310619] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-31T17:05:16.310773] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-31T17:05:16.310826] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-31T17:05:16.311202] [DEBUG] [LOCAL ] AFGC: Trimmed 3557 records to 2598 (keeping 200 days of data) [2025-10-31T17:05:16.326688] [DEBUG] [LOCAL ] AFGC: Primary data saved (2598 records). [2025-10-31T17:05:16.326749] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-31T17:05:16.326806] [INFO ] [MAIN ] Update Progress: 47/2365 symbols completed. AFGC took 23.8s. Estimated remaining: 4h 16m 27s. Rate: 9.0 symbols/min [2025-10-31T17:05:16.497744] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:05:16.548775] [DEBUG] [LOCAL ] AG: Loaded 54033 existing records from primary storage. [2025-10-31T17:05:16.549074] [INFO ] [MAIN ] AG: Loaded 54033 existing records. [2025-10-31T17:05:16.729301] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:05:16.729521] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-31T17:05:16.729568] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-31T17:05:16.729950] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-31T17:05:16.730007] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-31T17:05:17.075626] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-31T17:05:17.080177] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:05:17.409248] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-31T17:05:17.755922] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T17:05:17.857712] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-31T17:05:18.657690] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-31T17:05:18.981772] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-31T17:05:18.982578] [INFO ] [REMOTE ] AFGD: Full fetch complete (2630 records). [2025-10-31T17:05:18.982674] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-31T17:05:19.346057] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-31T17:05:19.346197] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-31T17:05:19.346332] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-31T17:05:19.346373] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-31T17:05:19.346754] [DEBUG] [LOCAL ] AFGD: Trimmed 2630 records to 1724 (keeping 200 days of data) [2025-10-31T17:05:19.357171] [DEBUG] [LOCAL ] AFGD: Primary data saved (1724 records). [2025-10-31T17:05:19.357243] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-31T17:05:19.357307] [INFO ] [MAIN ] Update Progress: 48/2365 symbols completed. AFGD took 26.0s. Estimated remaining: 4h 13m 26s. Rate: 9.1 symbols/min [2025-10-31T17:05:19.460471] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-31T17:05:19.540189] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:05:19.580959] [DEBUG] [LOCAL ] AGCO: Loaded 42102 existing records from primary storage. [2025-10-31T17:05:19.581343] [INFO ] [MAIN ] AGCO: Loaded 42102 existing records. [2025-10-31T17:05:19.763222] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:05:19.763424] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-31T17:05:19.763470] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-31T17:05:19.763850] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-31T17:05:19.763907] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-31T17:05:19.894902] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T17:05:19.907055] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-31T17:05:20.156931] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:05:20.257694] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-31T17:05:21.057672] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-31T17:05:21.517827] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T17:05:21.857717] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-31T17:05:22.304608] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-31T17:05:22.350798] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T17:05:22.657686] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-31T17:05:23.457692] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-31T17:05:24.153217] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-31T17:05:24.257667] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-31T17:05:24.540130] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T17:05:25.057673] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-31T17:05:25.334105] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-31T17:05:25.552042] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T17:05:25.857711] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-31T17:05:26.657674] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-31T17:05:27.004288] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T17:05:27.017020] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-31T17:05:27.017798] [INFO ] [REMOTE ] AFGE: Full fetch complete (3204 records). [2025-10-31T17:05:27.017866] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-31T17:05:27.018217] [FATAL] [VALIDATOR ] AFGE: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:05:27.018298] [FATAL] [MAIN ] AFGE: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:05:27.018341] [WARN ] [MAIN ] AFGE: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:05:27.018409] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-31T17:05:27.018470] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-10-31T17:05:27.018505] [INFO ] [LOCAL ] AFGE: Starting deletion of derivative data. [2025-10-31T17:05:27.018753] [DEBUG] [LOCAL ] AFGE: Deleted derivative data file. [2025-10-31T17:05:27.018845] [INFO ] [MAIN ] Update Progress: 49/2365 symbols completed. AFGE took 33.1s. Estimated remaining: 4h 14m 12s. Rate: 9.1 symbols/min [2025-10-31T17:05:27.184065] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:05:27.203252] [DEBUG] [LOCAL ] AGD: Loaded 19029 existing records from primary storage. [2025-10-31T17:05:27.203479] [INFO ] [MAIN ] AGD: Loaded 19029 existing records. [2025-10-31T17:05:27.377327] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:05:27.377506] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-31T17:05:27.377551] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-31T17:05:27.377777] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-31T17:05:27.377833] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-31T17:05:27.462800] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-31T17:05:27.737808] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:05:28.257672] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-31T17:05:29.057621] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-31T17:05:29.102334] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-31T17:05:29.779246] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T17:05:29.857684] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-31T17:05:29.902756] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T17:05:30.657685] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-31T17:05:31.198081] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-31T17:05:31.198966] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T17:05:31.457674] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-31T17:05:32.201491] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-31T17:05:32.213709] [INFO ] [REMOTE ] AFL: Full fetch complete (77066 records). [2025-10-31T17:05:32.213877] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-31T17:05:32.266840] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-31T17:05:32.605551] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-31T17:05:32.605625] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-31T17:05:32.606352] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-31T17:05:32.606403] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-31T17:05:32.607802] [DEBUG] [LOCAL ] AFL: Trimmed 77066 records to 53920 (keeping 200 days of data) [2025-10-31T17:05:32.931983] [DEBUG] [LOCAL ] AFL: Primary data saved (53920 records). [2025-10-31T17:05:32.932137] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-31T17:05:32.933223] [INFO ] [MAIN ] Update Progress: 50/2365 symbols completed. AFL took 38.1s. Estimated remaining: 4h 13m 34s. Rate: 9.1 symbols/min [2025-10-31T17:05:33.072238] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-31T17:05:33.109898] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:05:33.165681] [DEBUG] [LOCAL ] AGI: Loaded 53811 existing records from primary storage. [2025-10-31T17:05:33.166042] [INFO ] [MAIN ] AGI: Loaded 53811 existing records. [2025-10-31T17:05:33.367924] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:05:33.368171] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-31T17:05:33.368218] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-31T17:05:33.368727] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-31T17:05:33.368794] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-31T17:05:33.731208] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:05:33.732302] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T17:05:33.769812] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T17:05:33.857603] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-31T17:05:34.503952] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T17:05:34.657604] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-31T17:05:35.457679] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-31T17:05:36.257688] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-31T17:05:36.319863] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-31T17:05:36.886463] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T17:05:36.907313] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-31T17:05:37.057697] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-31T17:05:37.857684] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-31T17:05:38.356128] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T17:05:38.547421] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T17:05:38.657677] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-31T17:05:39.426478] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T17:05:39.457613] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-31T17:05:40.257711] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-31T17:05:40.981094] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-31T17:05:41.057679] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-31T17:05:41.658688] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-31T17:05:41.857704] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-31T17:05:42.656379] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-31T17:05:42.668420] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-31T17:05:42.685602] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T17:05:43.457736] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-31T17:05:43.877614] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T17:05:44.257690] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-31T17:05:45.066080] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-31T17:05:45.086265] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-31T17:05:45.593171] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T17:05:45.857697] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-31T17:05:46.657622] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-31T17:05:47.425896] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T17:05:47.457609] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-31T17:05:47.603532] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-31T17:05:47.615601] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-31T17:05:48.257704] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-31T17:05:48.353413] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-31T17:05:48.358513] [INFO ] [REMOTE ] AGD: Full fetch complete (26011 records). [2025-10-31T17:05:48.358592] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-31T17:05:48.734805] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-31T17:05:48.734880] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-31T17:05:48.735190] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-31T17:05:48.735228] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-31T17:05:48.735875] [DEBUG] [LOCAL ] AGD: Trimmed 26011 records to 19111 (keeping 200 days of data) [2025-10-31T17:05:48.845124] [DEBUG] [LOCAL ] AGD: Primary data saved (19111 records). [2025-10-31T17:05:48.845262] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-31T17:05:48.845338] [INFO ] [MAIN ] Update Progress: 51/2365 symbols completed. AGD took 21.8s. Estimated remaining: 4h 20m 31s. Rate: 8.9 symbols/min [2025-10-31T17:05:49.009029] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:05:49.057808] [DEBUG] [LOCAL ] AGL: Loaded 52953 existing records from primary storage. [2025-10-31T17:05:49.057880] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-31T17:05:49.058366] [INFO ] [MAIN ] AGL: Loaded 52953 existing records. [2025-10-31T17:05:49.235055] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:05:49.235274] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-31T17:05:49.235320] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-31T17:05:49.235564] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-31T17:05:49.235619] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-31T17:05:49.581026] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:05:49.857672] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-31T17:05:50.330537] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T17:05:50.403564] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-31T17:05:50.415621] [INFO ] [REMOTE ] AG: Full fetch complete (77800 records). [2025-10-31T17:05:50.415775] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-31T17:05:50.664164] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-31T17:05:50.809797] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-31T17:05:50.809872] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-31T17:05:50.810618] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-31T17:05:50.810694] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-31T17:05:50.812113] [DEBUG] [LOCAL ] AG: Trimmed 77800 records to 54423 (keeping 200 days of data) [2025-10-31T17:05:51.130596] [DEBUG] [LOCAL ] AG: Primary data saved (54423 records). [2025-10-31T17:05:51.130879] [INFO ] [MAIN ] AG: Full history saved. [2025-10-31T17:05:51.130989] [INFO ] [MAIN ] Update Progress: 52/2365 symbols completed. AG took 34.8s. Estimated remaining: 4h 17m 6s. Rate: 9.0 symbols/min [2025-10-31T17:05:51.304780] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:05:51.305028] [DEBUG] [LOCAL ] AGM: No existing data file found in primary storage. [2025-10-31T17:05:51.305092] [WARN ] [MAIN ] AGM: No existing data found, performing full refresh instead. [2025-10-31T17:05:51.305333] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-31T17:05:51.305412] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-31T17:05:51.305519] [DEBUG] [LOCAL ] AGM: No primary data file found to delete. [2025-10-31T17:05:51.305780] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-31T17:05:51.439220] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T17:05:51.470996] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-31T17:05:51.712371] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:05:51.787484] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T17:05:52.257694] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-31T17:05:52.767813] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T17:05:52.902052] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:05:53.057727] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-31T17:05:53.857728] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-31T17:05:54.238060] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T17:05:54.253028] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T17:05:54.657663] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-31T17:05:55.457682] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-31T17:05:55.893380] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T17:05:56.257738] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-31T17:05:56.532385] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T17:05:57.057665] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-31T17:05:57.625891] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T17:05:57.857685] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-31T17:05:58.362166] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T17:05:58.372505] [INFO ] [REMOTE ] AGCO: Full fetch complete (61385 records). [2025-10-31T17:05:58.372636] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-31T17:05:58.665314] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-31T17:05:58.767033] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-31T17:05:58.767121] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-31T17:05:58.767897] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-31T17:05:58.767993] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-31T17:05:58.769216] [DEBUG] [LOCAL ] AGCO: Trimmed 61385 records to 42460 (keeping 200 days of data) [2025-10-31T17:05:59.023960] [DEBUG] [LOCAL ] AGCO: Primary data saved (42460 records). [2025-10-31T17:05:59.024236] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-31T17:05:59.025438] [INFO ] [MAIN ] Update Progress: 53/2365 symbols completed. AGCO took 39.7s. Estimated remaining: 4h 17m 52s. Rate: 9.0 symbols/min [2025-10-31T17:05:59.197626] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:05:59.226833] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T17:05:59.258634] [DEBUG] [LOCAL ] AGO: Loaded 27333 existing records from primary storage. [2025-10-31T17:05:59.258917] [INFO ] [MAIN ] AGO: Loaded 27333 existing records. [2025-10-31T17:05:59.437126] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:05:59.437364] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-31T17:05:59.437417] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-31T17:05:59.437625] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-31T17:05:59.437723] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-31T17:05:59.468147] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-31T17:05:59.799707] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:05:59.988612] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T17:06:00.055465] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T17:06:00.257621] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-31T17:06:01.057731] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-31T17:06:01.857628] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-31T17:06:01.901805] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-31T17:06:02.509934] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T17:06:02.657717] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-31T17:06:03.457630] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-31T17:06:03.500379] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-31T17:06:03.934432] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T17:06:04.258024] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-31T17:06:04.262939] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T17:06:05.057691] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-31T17:06:05.594719] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T17:06:05.857686] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-31T17:06:06.372386] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T17:06:06.377121] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T17:06:06.657672] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-31T17:06:07.421517] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-31T17:06:07.457614] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-31T17:06:08.031847] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-31T17:06:08.257665] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-31T17:06:09.057667] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-31T17:06:09.521855] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T17:06:09.561845] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T17:06:09.857697] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-31T17:06:10.657676] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-31T17:06:11.092936] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T17:06:11.111589] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-31T17:06:11.457730] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-31T17:06:12.173304] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T17:06:12.176113] [INFO ] [REMOTE ] AGM: Full fetch complete (13234 records). [2025-10-31T17:06:12.176185] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-31T17:06:12.262801] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-31T17:06:12.552054] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-31T17:06:12.552138] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-31T17:06:12.552400] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-31T17:06:12.552475] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-31T17:06:12.553153] [DEBUG] [LOCAL ] AGM: Trimmed 13234 records to 10547 (keeping 200 days of data) [2025-10-31T17:06:12.619975] [DEBUG] [LOCAL ] AGM: Primary data saved (10547 records). [2025-10-31T17:06:12.620116] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-31T17:06:12.620229] [INFO ] [MAIN ] Update Progress: 54/2365 symbols completed. AGM took 21.5s. Estimated remaining: 4h 22m 41s. Rate: 8.8 symbols/min [2025-10-31T17:06:12.788676] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:06:12.817702] [DEBUG] [LOCAL ] AGRO: Loaded 32145 existing records from primary storage. [2025-10-31T17:06:12.817988] [INFO ] [MAIN ] AGRO: Loaded 32145 existing records. [2025-10-31T17:06:12.989502] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:06:12.989744] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-31T17:06:12.989794] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-31T17:06:12.990007] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-31T17:06:12.990066] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-31T17:06:13.062835] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-31T17:06:13.347638] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:06:13.825433] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-31T17:06:13.857625] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-31T17:06:14.611962] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-31T17:06:14.657676] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-31T17:06:14.693602] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T17:06:15.457688] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-31T17:06:16.025908] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T17:06:16.101143] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-31T17:06:16.257688] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-31T17:06:17.057690] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-31T17:06:17.260748] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T17:06:17.857702] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-31T17:06:18.657639] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-31T17:06:18.710360] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-31T17:06:19.414762] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-31T17:06:19.426347] [INFO ] [REMOTE ] AGL: Full fetch complete (75631 records). [2025-10-31T17:06:19.426490] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-31T17:06:19.427288] [FATAL] [VALIDATOR ] AGL: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:06:19.427374] [FATAL] [MAIN ] AGL: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:06:19.427416] [WARN ] [MAIN ] AGL: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:06:19.427481] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-31T17:06:19.427545] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-31T17:06:19.427581] [INFO ] [LOCAL ] AGL: Starting deletion of derivative data. [2025-10-31T17:06:19.427879] [DEBUG] [LOCAL ] AGL: Deleted derivative data file. [2025-10-31T17:06:19.428000] [INFO ] [MAIN ] Update Progress: 55/2365 symbols completed. AGL took 30.6s. Estimated remaining: 4h 22m 34s. Rate: 8.8 symbols/min [2025-10-31T17:06:19.459566] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-31T17:06:19.603355] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:06:19.622181] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T17:06:19.658103] [DEBUG] [LOCAL ] AGX: Loaded 32319 existing records from primary storage. [2025-10-31T17:06:19.658376] [INFO ] [MAIN ] AGX: Loaded 32319 existing records. [2025-10-31T17:06:19.834446] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:06:19.834688] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-31T17:06:19.834745] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-31T17:06:19.835276] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-31T17:06:19.835331] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-31T17:06:20.186704] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:06:20.257671] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-31T17:06:21.040238] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T17:06:21.052373] [INFO ] [REMOTE ] AGI: Full fetch complete (77030 records). [2025-10-31T17:06:21.052525] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-31T17:06:21.053339] [FATAL] [VALIDATOR ] AGI: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:06:21.053426] [FATAL] [MAIN ] AGI: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:06:21.053487] [WARN ] [MAIN ] AGI: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:06:21.053573] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-31T17:06:21.053684] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-31T17:06:21.053751] [INFO ] [LOCAL ] AGI: Starting deletion of derivative data. [2025-10-31T17:06:21.053904] [DEBUG] [LOCAL ] AGI: Deleted derivative data file. [2025-10-31T17:06:21.054429] [INFO ] [MAIN ] Update Progress: 56/2365 symbols completed. AGI took 48.1s. Estimated remaining: 4h 18m 53s. Rate: 8.9 symbols/min [2025-10-31T17:06:21.065683] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-31T17:06:21.229255] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:06:21.271423] [DEBUG] [LOCAL ] AHH: Loaded 39931 existing records from primary storage. [2025-10-31T17:06:21.271748] [INFO ] [MAIN ] AHH: Loaded 39931 existing records. [2025-10-31T17:06:21.446231] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:06:21.446600] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-31T17:06:21.446686] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-31T17:06:21.446875] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-31T17:06:21.446916] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-31T17:06:21.816550] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:06:21.840537] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-31T17:06:21.865818] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-31T17:06:21.869806] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-31T17:06:22.657625] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-31T17:06:22.876958] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:06:23.457676] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-31T17:06:23.770244] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:06:24.257707] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-31T17:06:24.926262] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T17:06:25.057685] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-31T17:06:25.517688] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T17:06:25.857627] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-31T17:06:25.970511] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T17:06:26.657672] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-31T17:06:27.076020] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T17:06:27.457702] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-31T17:06:27.728625] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T17:06:27.737215] [INFO ] [REMOTE ] AGO: Full fetch complete (39552 records). [2025-10-31T17:06:27.737365] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-31T17:06:28.122756] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-31T17:06:28.122828] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-31T17:06:28.123250] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-31T17:06:28.123290] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-31T17:06:28.124217] [DEBUG] [LOCAL ] AGO: Trimmed 39552 records to 27543 (keeping 200 days of data) [2025-10-31T17:06:28.263637] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-31T17:06:28.291367] [DEBUG] [LOCAL ] AGO: Primary data saved (27543 records). [2025-10-31T17:06:28.291458] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-31T17:06:28.291531] [INFO ] [MAIN ] Update Progress: 57/2365 symbols completed. AGO took 29.3s. Estimated remaining: 4h 19m 7s. Rate: 8.9 symbols/min [2025-10-31T17:06:28.460472] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:06:28.460719] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-31T17:06:28.460789] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-31T17:06:28.461021] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-31T17:06:28.461094] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-31T17:06:28.461235] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-31T17:06:28.461293] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-31T17:06:28.797382] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-31T17:06:28.862418] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:06:29.057688] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-31T17:06:29.857725] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-31T17:06:30.166518] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-31T17:06:30.329710] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-31T17:06:30.657708] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-31T17:06:30.813894] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-31T17:06:31.457691] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-31T17:06:31.846113] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T17:06:32.257704] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-31T17:06:32.559197] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T17:06:33.057677] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-31T17:06:33.800119] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-31T17:06:33.857636] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-31T17:06:33.951225] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-31T17:06:34.015003] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:06:34.015301] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-31T17:06:34.015397] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:06:34.015465] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-31T17:06:34.015527] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:06:34.015597] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-31T17:06:34.015683] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-31T17:06:34.015739] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-31T17:06:34.015781] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-31T17:06:34.015828] [INFO ] [MAIN ] Update Progress: 58/2365 symbols completed. AHL took 5.7s. Estimated remaining: 4h 18m 20s. Rate: 8.9 symbols/min [2025-10-31T17:06:34.186756] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:06:34.231660] [DEBUG] [LOCAL ] AHR: Loaded 49186 existing records from primary storage. [2025-10-31T17:06:34.231979] [INFO ] [MAIN ] AHR: Loaded 49186 existing records. [2025-10-31T17:06:34.410244] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:06:34.410446] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-31T17:06:34.410492] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-31T17:06:34.410751] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-31T17:06:34.410807] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-31T17:06:34.662882] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-31T17:06:34.774554] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:06:35.457619] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-31T17:06:36.067780] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T17:06:36.257706] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-31T17:06:36.366278] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T17:06:37.057684] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-31T17:06:37.363630] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T17:06:37.825374] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T17:06:37.857606] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-31T17:06:38.657713] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-31T17:06:38.893266] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T17:06:38.901766] [INFO ] [REMOTE ] AGRO: Full fetch complete (48531 records). [2025-10-31T17:06:38.902012] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-31T17:06:39.327190] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-31T17:06:39.327342] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-31T17:06:39.328040] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-31T17:06:39.328110] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-31T17:06:39.329720] [DEBUG] [LOCAL ] AGRO: Trimmed 48531 records to 32372 (keeping 200 days of data) [2025-10-31T17:06:39.457934] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-31T17:06:39.539320] [DEBUG] [LOCAL ] AGRO: Primary data saved (32372 records). [2025-10-31T17:06:39.539530] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-31T17:06:39.539630] [INFO ] [MAIN ] Update Progress: 59/2365 symbols completed. AGRO took 26.9s. Estimated remaining: 4h 17m 26s. Rate: 9.0 symbols/min [2025-10-31T17:06:39.727877] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:06:39.751110] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T17:06:39.765965] [DEBUG] [LOCAL ] AHT: Loaded 6463 existing records from primary storage. [2025-10-31T17:06:39.766201] [INFO ] [MAIN ] AHT: Loaded 6463 existing records. [2025-10-31T17:06:39.938470] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:06:39.938635] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-31T17:06:39.938718] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-31T17:06:39.938864] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-31T17:06:39.938918] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-31T17:06:40.272549] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-31T17:06:40.312325] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:06:41.010185] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T17:06:41.057721] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-31T17:06:41.520947] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-31T17:06:41.857697] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-31T17:06:42.017284] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T17:06:42.657752] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-31T17:06:42.825734] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T17:06:43.182950] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-31T17:06:43.457718] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-31T17:06:44.257692] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-31T17:06:44.521779] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T17:06:45.057671] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-31T17:06:45.857625] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-31T17:06:46.148304] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-31T17:06:46.199488] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:06:46.206071] [INFO ] [REMOTE ] AGX: Full fetch complete (48290 records). [2025-10-31T17:06:46.206173] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-31T17:06:46.574787] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-31T17:06:46.574863] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-31T17:06:46.575330] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-31T17:06:46.575369] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-31T17:06:46.576341] [DEBUG] [LOCAL ] AGX: Trimmed 48290 records to 32530 (keeping 200 days of data) [2025-10-31T17:06:46.665679] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-31T17:06:46.779713] [DEBUG] [LOCAL ] AGX: Primary data saved (32530 records). [2025-10-31T17:06:46.779839] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-31T17:06:46.779915] [INFO ] [MAIN ] Update Progress: 60/2365 symbols completed. AGX took 27.4s. Estimated remaining: 4h 17m 41s. Rate: 8.9 symbols/min [2025-10-31T17:06:46.962777] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:06:47.016261] [DEBUG] [LOCAL ] AI: Loaded 54156 existing records from primary storage. [2025-10-31T17:06:47.016594] [INFO ] [MAIN ] AI: Loaded 54156 existing records. [2025-10-31T17:06:47.201920] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:06:47.202241] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-31T17:06:47.202501] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-31T17:06:47.208610] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-31T17:06:47.222543] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-31T17:06:47.230338] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-31T17:06:47.303906] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T17:06:47.468192] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-31T17:06:47.591518] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:06:47.907762] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-31T17:06:48.257665] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-31T17:06:49.057691] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-31T17:06:49.497583] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T17:06:49.857678] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-31T17:06:50.349537] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T17:06:50.657639] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-31T17:06:51.457632] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-31T17:06:51.734844] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-31T17:06:51.857706] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-31T17:06:51.965251] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T17:06:52.257669] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-31T17:06:52.646617] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T17:06:53.057674] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-31T17:06:53.857686] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-31T17:06:54.657622] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-31T17:06:54.894904] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-31T17:06:54.929604] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T17:06:55.457711] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-31T17:06:55.859341] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T17:06:56.257687] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-31T17:06:56.825094] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-31T17:06:57.057700] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-31T17:06:57.205115] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-31T17:06:57.857710] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-31T17:06:58.192092] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-31T17:06:58.229027] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T17:06:58.657743] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-31T17:06:59.457728] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-31T17:07:00.257693] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-31T17:07:00.410831] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-31T17:07:01.057610] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-31T17:07:01.245546] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-31T17:07:01.857693] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-31T17:07:02.237417] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-31T17:07:02.246599] [INFO ] [REMOTE ] AHH: Full fetch complete (59136 records). [2025-10-31T17:07:02.246820] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-31T17:07:02.370024] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T17:07:02.671464] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-31T17:07:02.691612] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-31T17:07:02.691724] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-31T17:07:02.692306] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-31T17:07:02.692442] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-31T17:07:02.693691] [DEBUG] [LOCAL ] AHH: Trimmed 59136 records to 40199 (keeping 200 days of data) [2025-10-31T17:07:02.917031] [DEBUG] [LOCAL ] AHH: Primary data saved (40199 records). [2025-10-31T17:07:02.917143] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-31T17:07:02.917830] [INFO ] [MAIN ] Update Progress: 61/2365 symbols completed. AHH took 41.9s. Estimated remaining: 4h 23m 30s. Rate: 8.7 symbols/min [2025-10-31T17:07:03.082164] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:03.131344] [DEBUG] [LOCAL ] AIG: Loaded 53837 existing records from primary storage. [2025-10-31T17:07:03.131634] [INFO ] [MAIN ] AIG: Loaded 53837 existing records. [2025-10-31T17:07:03.303187] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:07:03.303382] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-31T17:07:03.303428] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-31T17:07:03.303635] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-31T17:07:03.303728] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-31T17:07:03.470474] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-31T17:07:03.652463] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:03.877895] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-31T17:07:03.996851] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T17:07:04.257709] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-31T17:07:04.266542] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T17:07:04.268863] [INFO ] [REMOTE ] AHT: Full fetch complete (9056 records). [2025-10-31T17:07:04.268942] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-31T17:07:04.616974] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-31T17:07:04.617045] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-31T17:07:04.617192] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-31T17:07:04.617229] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-31T17:07:04.617604] [DEBUG] [LOCAL ] AHT: Trimmed 9056 records to 6540 (keeping 200 days of data) [2025-10-31T17:07:04.652412] [DEBUG] [LOCAL ] AHT: Primary data saved (6540 records). [2025-10-31T17:07:04.652490] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-31T17:07:04.652556] [INFO ] [MAIN ] Update Progress: 62/2365 symbols completed. AHT took 25.1s. Estimated remaining: 4h 20m 13s. Rate: 8.9 symbols/min [2025-10-31T17:07:04.816567] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:04.816744] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-31T17:07:04.816787] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-31T17:07:04.816889] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-31T17:07:04.816929] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-31T17:07:04.816969] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-31T17:07:04.817000] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-31T17:07:05.062952] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-31T17:07:05.165991] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:05.589631] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T17:07:05.857703] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-31T17:07:06.657616] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-31T17:07:06.804910] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-31T17:07:07.457697] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-31T17:07:07.609635] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:07:07.609972] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-31T17:07:07.610218] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:07:07.610366] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-31T17:07:07.610437] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:07:07.610507] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-31T17:07:07.610569] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-31T17:07:07.610608] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-31T17:07:07.610684] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-31T17:07:07.610752] [INFO ] [MAIN ] Update Progress: 63/2365 symbols completed. AII took 3.0s. Estimated remaining: 4h 17m 46s. Rate: 8.9 symbols/min [2025-10-31T17:07:07.791617] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:07.825816] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-31T17:07:07.851781] [DEBUG] [LOCAL ] AIN: Loaded 24354 existing records from primary storage. [2025-10-31T17:07:07.860950] [INFO ] [MAIN ] AIN: Loaded 24354 existing records. [2025-10-31T17:07:07.946820] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T17:07:08.064041] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:07:08.064239] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-31T17:07:08.064284] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-31T17:07:08.064447] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-31T17:07:08.064484] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-31T17:07:08.263839] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-31T17:07:08.415192] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:09.057666] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-31T17:07:09.668133] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T17:07:09.679153] [INFO ] [REMOTE ] AHR: Full fetch complete (70929 records). [2025-10-31T17:07:09.679287] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-31T17:07:09.863773] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-31T17:07:10.081892] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-31T17:07:10.082029] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-31T17:07:10.082783] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-31T17:07:10.082849] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-31T17:07:10.084357] [DEBUG] [LOCAL ] AHR: Trimmed 70929 records to 49541 (keeping 200 days of data) [2025-10-31T17:07:10.374512] [DEBUG] [LOCAL ] AHR: Primary data saved (49541 records). [2025-10-31T17:07:10.374674] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-31T17:07:10.375602] [INFO ] [MAIN ] Update Progress: 64/2365 symbols completed. AHR took 36.4s. Estimated remaining: 4h 15m 17s. Rate: 9.0 symbols/min [2025-10-31T17:07:10.553701] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:10.568393] [DEBUG] [LOCAL ] AIO: Loaded 12827 existing records from primary storage. [2025-10-31T17:07:10.568639] [INFO ] [MAIN ] AIO: Loaded 12827 existing records. [2025-10-31T17:07:10.664846] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-31T17:07:10.763532] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:07:10.763785] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-31T17:07:10.763833] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-31T17:07:10.764011] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-31T17:07:10.764052] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-31T17:07:10.981619] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T17:07:11.148825] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:11.185273] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-31T17:07:11.457681] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-31T17:07:12.257613] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-31T17:07:12.285450] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T17:07:12.502743] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-31T17:07:12.970324] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T17:07:13.057705] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-31T17:07:13.688309] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T17:07:13.857686] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-31T17:07:14.469876] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-31T17:07:14.657733] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-31T17:07:15.457668] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-31T17:07:16.257700] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-31T17:07:16.654948] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-31T17:07:17.057678] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-31T17:07:17.570296] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-31T17:07:17.756975] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T17:07:17.857611] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-31T17:07:17.894326] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-31T17:07:18.657640] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-31T17:07:19.457621] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-31T17:07:19.540005] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:07:19.740961] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-31T17:07:20.049503] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T17:07:20.257687] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-31T17:07:20.904061] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T17:07:21.057702] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-31T17:07:21.857677] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-31T17:07:22.587310] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T17:07:22.657764] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-31T17:07:23.175796] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-31T17:07:23.190923] [INFO ] [REMOTE ] AI: Full fetch complete (77914 records). [2025-10-31T17:07:23.191095] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-31T17:07:23.466385] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-31T17:07:23.694882] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-31T17:07:23.695003] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-31T17:07:23.696294] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-31T17:07:23.696396] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-31T17:07:23.698676] [DEBUG] [LOCAL ] AI: Trimmed 77914 records to 54545 (keeping 200 days of data) [2025-10-31T17:07:24.167503] [DEBUG] [LOCAL ] AI: Primary data saved (54545 records). [2025-10-31T17:07:24.173729] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T17:07:24.176715] [INFO ] [MAIN ] AI: Full history saved. [2025-10-31T17:07:24.178001] [INFO ] [MAIN ] Update Progress: 65/2365 symbols completed. AI took 37.4s. Estimated remaining: 4h 19m 24s. Rate: 8.9 symbols/min [2025-10-31T17:07:24.261134] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-31T17:07:24.379804] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:24.380132] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-10-31T17:07:24.380230] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-10-31T17:07:24.380503] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-31T17:07:24.380581] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-31T17:07:24.410971] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-31T17:07:24.411089] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-31T17:07:24.484087] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-31T17:07:24.801602] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:24.856138] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-31T17:07:25.057673] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-31T17:07:25.857637] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-31T17:07:25.934816] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T17:07:26.657687] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-31T17:07:26.717472] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-31T17:07:26.721443] [INFO ] [REMOTE ] AIO: Full fetch complete (20109 records). [2025-10-31T17:07:26.721548] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-31T17:07:27.108592] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-31T17:07:27.108701] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-31T17:07:27.108981] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-31T17:07:27.109020] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-31T17:07:27.109539] [DEBUG] [LOCAL ] AIO: Trimmed 20109 records to 12928 (keeping 200 days of data) [2025-10-31T17:07:27.186301] [DEBUG] [LOCAL ] AIO: Primary data saved (12928 records). [2025-10-31T17:07:27.186445] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-31T17:07:27.186520] [INFO ] [MAIN ] Update Progress: 66/2365 symbols completed. AIO took 16.8s. Estimated remaining: 4h 17m 6s. Rate: 8.9 symbols/min [2025-10-31T17:07:27.351549] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:27.377024] [DEBUG] [LOCAL ] AIT: Loaded 26298 existing records from primary storage. [2025-10-31T17:07:27.377261] [INFO ] [MAIN ] AIT: Loaded 26298 existing records. [2025-10-31T17:07:27.465009] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-31T17:07:27.554061] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:07:27.554258] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-31T17:07:27.554307] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-31T17:07:27.554479] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-31T17:07:27.554519] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-31T17:07:27.915703] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:28.135453] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-31T17:07:28.257672] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-31T17:07:28.509496] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T17:07:29.057682] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-31T17:07:29.857632] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-31T17:07:29.901176] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-31T17:07:29.953476] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-31T17:07:30.657627] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-31T17:07:30.713195] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-31T17:07:31.457694] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-31T17:07:31.511340] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-31T17:07:32.257688] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-31T17:07:32.525625] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T17:07:33.057627] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-31T17:07:33.161910] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-31T17:07:33.857622] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-31T17:07:33.995926] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T17:07:34.624966] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T17:07:34.657628] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-31T17:07:35.457715] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-31T17:07:36.062208] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T17:07:36.198506] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-31T17:07:36.257610] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-31T17:07:37.056853] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T17:07:37.061486] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-31T17:07:37.857628] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-31T17:07:38.054286] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T17:07:38.657696] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-31T17:07:39.279912] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T17:07:39.457695] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-31T17:07:39.698696] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T17:07:40.257693] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-31T17:07:40.440553] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T17:07:41.057690] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-31T17:07:41.102815] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-31T17:07:41.857705] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-31T17:07:42.365060] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T17:07:42.657629] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-31T17:07:42.822991] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T17:07:43.457610] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-31T17:07:43.539563] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-31T17:07:44.257637] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-31T17:07:44.408619] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-31T17:07:44.880029] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T17:07:44.892104] [INFO ] [REMOTE ] AIG: Full fetch complete (77562 records). [2025-10-31T17:07:44.892250] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-31T17:07:45.071798] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-31T17:07:45.293103] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-31T17:07:45.293181] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-31T17:07:45.293901] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-31T17:07:45.293964] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-31T17:07:45.295357] [DEBUG] [LOCAL ] AIG: Trimmed 77562 records to 54227 (keeping 200 days of data) [2025-10-31T17:07:45.614513] [DEBUG] [LOCAL ] AIG: Primary data saved (54227 records). [2025-10-31T17:07:45.614635] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-31T17:07:45.615607] [INFO ] [MAIN ] Update Progress: 67/2365 symbols completed. AIG took 42.7s. Estimated remaining: 4h 23m 41s. Rate: 8.7 symbols/min [2025-10-31T17:07:45.789542] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:45.834071] [DEBUG] [LOCAL ] AIV: Loaded 42131 existing records from primary storage. [2025-10-31T17:07:45.834459] [INFO ] [MAIN ] AIV: Loaded 42131 existing records. [2025-10-31T17:07:45.866075] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-31T17:07:46.023555] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:07:46.023886] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-31T17:07:46.024065] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-31T17:07:46.024411] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-31T17:07:46.024465] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-31T17:07:46.214241] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T17:07:46.406279] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:46.661432] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-31T17:07:46.664843] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-31T17:07:47.457698] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-31T17:07:47.735134] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T17:07:48.257617] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-31T17:07:48.402443] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-31T17:07:48.408507] [INFO ] [REMOTE ] AIN: Full fetch complete (34001 records). [2025-10-31T17:07:48.408605] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-31T17:07:48.774417] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-31T17:07:48.774494] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-31T17:07:48.774876] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-31T17:07:48.774938] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-31T17:07:48.775714] [DEBUG] [LOCAL ] AIN: Trimmed 34001 records to 24586 (keeping 200 days of data) [2025-10-31T17:07:48.918680] [DEBUG] [LOCAL ] AIN: Primary data saved (24586 records). [2025-10-31T17:07:48.918798] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-31T17:07:48.918878] [INFO ] [MAIN ] Update Progress: 68/2365 symbols completed. AIN took 41.3s. Estimated remaining: 4h 21m 33s. Rate: 8.8 symbols/min [2025-10-31T17:07:49.060639] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-31T17:07:49.117079] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:49.133193] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-31T17:07:49.164199] [DEBUG] [LOCAL ] AIZ: Loaded 28894 existing records from primary storage. [2025-10-31T17:07:49.164479] [INFO ] [MAIN ] AIZ: Loaded 28894 existing records. [2025-10-31T17:07:49.341678] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:07:49.341907] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-31T17:07:49.341953] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-31T17:07:49.342144] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-31T17:07:49.342200] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-31T17:07:49.687228] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:49.857668] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-31T17:07:50.469025] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T17:07:50.657685] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-31T17:07:50.871750] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T17:07:51.311345] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T17:07:51.457694] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-31T17:07:52.250691] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T17:07:52.257954] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-31T17:07:53.057623] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-31T17:07:53.216241] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T17:07:53.857676] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-31T17:07:54.148097] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T17:07:54.657662] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-31T17:07:55.051993] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T17:07:55.061015] [INFO ] [REMOTE ] AIR: Full fetch complete (39944 records). [2025-10-31T17:07:55.061275] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-31T17:07:55.062058] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:07:55.062156] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:07:55.062202] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:07:55.062284] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-31T17:07:55.062359] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-31T17:07:55.062398] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-31T17:07:55.062440] [DEBUG] [LOCAL ] AIR: No derivative data file found to delete. [2025-10-31T17:07:55.062506] [INFO ] [MAIN ] Update Progress: 69/2365 symbols completed. AIR took 30.9s. Estimated remaining: 4h 21m 4s. Rate: 8.8 symbols/min [2025-10-31T17:07:55.245963] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:55.253231] [DEBUG] [LOCAL ] AIZN: Loaded 3626 existing records from primary storage. [2025-10-31T17:07:55.253450] [INFO ] [MAIN ] AIZN: Loaded 3626 existing records. [2025-10-31T17:07:55.428309] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:07:55.428545] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-31T17:07:55.428593] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-31T17:07:55.428746] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-31T17:07:55.428800] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-31T17:07:55.462837] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-31T17:07:55.787195] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:55.802217] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:07:55.807720] [INFO ] [REMOTE ] AIT: Full fetch complete (38718 records). [2025-10-31T17:07:55.807821] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-31T17:07:55.808494] [FATAL] [VALIDATOR ] AIT: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:07:55.808579] [FATAL] [MAIN ] AIT: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:07:55.808621] [WARN ] [MAIN ] AIT: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:07:55.808694] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-31T17:07:55.808763] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-10-31T17:07:55.808799] [INFO ] [LOCAL ] AIT: Starting deletion of derivative data. [2025-10-31T17:07:55.808960] [DEBUG] [LOCAL ] AIT: Deleted derivative data file. [2025-10-31T17:07:55.809048] [INFO ] [MAIN ] Update Progress: 70/2365 symbols completed. AIT took 28.6s. Estimated remaining: 4h 17m 38s. Rate: 8.9 symbols/min [2025-10-31T17:07:55.979306] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:07:56.022257] [DEBUG] [LOCAL ] AJG: Loaded 46589 existing records from primary storage. [2025-10-31T17:07:56.022589] [INFO ] [MAIN ] AJG: Loaded 46589 existing records. [2025-10-31T17:07:56.198722] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:07:56.198959] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-31T17:07:56.199010] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-31T17:07:56.199391] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-31T17:07:56.199448] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-31T17:07:56.262960] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-31T17:07:56.561721] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:07:56.583213] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T17:07:56.842135] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-31T17:07:57.057638] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-31T17:07:57.857743] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-31T17:07:58.345538] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T17:07:58.657683] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-31T17:07:59.199424] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T17:07:59.457710] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-31T17:07:59.786344] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T17:08:00.257669] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-31T17:08:01.057732] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-31T17:08:01.341851] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-31T17:08:01.698163] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T17:08:01.857694] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-31T17:08:02.142296] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T17:08:02.657677] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-31T17:08:03.260142] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-31T17:08:03.457716] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-31T17:08:03.610365] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T17:08:04.257690] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-31T17:08:04.770288] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T17:08:05.057679] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-31T17:08:05.282332] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-31T17:08:05.857639] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-31T17:08:05.963835] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T17:08:06.247744] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-31T17:08:06.657692] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-31T17:08:07.127828] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-31T17:08:07.457667] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-31T17:08:08.257626] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-31T17:08:08.427759] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T17:08:09.057692] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-31T17:08:09.290249] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T17:08:09.857621] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-31T17:08:09.919304] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T17:08:10.223341] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T17:08:10.657848] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-31T17:08:11.457706] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-31T17:08:11.750698] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-31T17:08:11.756703] [INFO ] [REMOTE ] AIZ: Full fetch complete (42649 records). [2025-10-31T17:08:11.756842] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-31T17:08:12.156317] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-31T17:08:12.156391] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-31T17:08:12.156986] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-31T17:08:12.157053] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-31T17:08:12.158144] [DEBUG] [LOCAL ] AIZ: Trimmed 42649 records to 29093 (keeping 200 days of data) [2025-10-31T17:08:12.258000] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-31T17:08:12.338045] [DEBUG] [LOCAL ] AIZ: Primary data saved (29093 records). [2025-10-31T17:08:12.338173] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-31T17:08:12.338252] [INFO ] [MAIN ] Update Progress: 71/2365 symbols completed. AIZ took 23.4s. Estimated remaining: 4h 22m 47s. Rate: 8.7 symbols/min [2025-10-31T17:08:12.521955] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:08:12.522161] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-31T17:08:12.522207] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-31T17:08:12.522318] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-31T17:08:12.522361] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-31T17:08:12.522405] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-31T17:08:12.522439] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-31T17:08:12.644219] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T17:08:12.926204] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T17:08:12.968478] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:08:13.057614] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-31T17:08:13.479007] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-31T17:08:13.857699] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-31T17:08:14.219831] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-31T17:08:14.657698] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-31T17:08:15.457669] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-31T17:08:15.820538] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-31T17:08:15.854973] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T17:08:16.257667] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-31T17:08:17.057674] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-31T17:08:17.459896] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T17:08:17.497186] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-31T17:08:17.857693] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-31T17:08:18.172110] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T17:08:18.657696] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-31T17:08:19.457692] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-31T17:08:19.844331] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T17:08:20.257686] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-31T17:08:20.664285] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T17:08:21.057614] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-31T17:08:21.305975] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-31T17:08:21.317290] [INFO ] [REMOTE ] AIV: Full fetch complete (60339 records). [2025-10-31T17:08:21.317418] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-31T17:08:21.423047] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-31T17:08:21.706664] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-31T17:08:21.706757] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-31T17:08:21.707385] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-31T17:08:21.707462] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-31T17:08:21.709077] [DEBUG] [LOCAL ] AIV: Trimmed 60339 records to 42489 (keeping 200 days of data) [2025-10-31T17:08:21.870919] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-31T17:08:21.953300] [DEBUG] [LOCAL ] AIV: Primary data saved (42489 records). [2025-10-31T17:08:21.953429] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-31T17:08:21.954020] [INFO ] [MAIN ] Update Progress: 72/2365 symbols completed. AIV took 36.3s. Estimated remaining: 4h 24m 8s. Rate: 8.7 symbols/min [2025-10-31T17:08:22.126047] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:08:22.169790] [DEBUG] [LOCAL ] AKR: Loaded 46317 existing records from primary storage. [2025-10-31T17:08:22.170069] [INFO ] [MAIN ] AKR: Loaded 46317 existing records. [2025-10-31T17:08:22.356152] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:08:22.356379] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-31T17:08:22.356434] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-31T17:08:22.356613] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-31T17:08:22.356685] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-31T17:08:22.662806] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-31T17:08:22.723186] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:08:23.002680] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-31T17:08:23.055282] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T17:08:23.457682] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-31T17:08:24.257634] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-31T17:08:24.806470] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T17:08:24.819367] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-31T17:08:24.821308] [INFO ] [REMOTE ] AIZN: Full fetch complete (5474 records). [2025-10-31T17:08:24.821403] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-31T17:08:25.062869] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-31T17:08:25.183513] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-31T17:08:25.183585] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-31T17:08:25.183746] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-31T17:08:25.183806] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-31T17:08:25.184162] [DEBUG] [LOCAL ] AIZN: Trimmed 5474 records to 3660 (keeping 200 days of data) [2025-10-31T17:08:25.206123] [DEBUG] [LOCAL ] AIZN: Primary data saved (3660 records). [2025-10-31T17:08:25.206198] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-31T17:08:25.206271] [INFO ] [MAIN ] Update Progress: 73/2365 symbols completed. AIZN took 30.1s. Estimated remaining: 4h 22m 6s. Rate: 8.7 symbols/min [2025-10-31T17:08:25.382294] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:08:25.421812] [DEBUG] [LOCAL ] AL: Loaded 45059 existing records from primary storage. [2025-10-31T17:08:25.422101] [INFO ] [MAIN ] AL: Loaded 45059 existing records. [2025-10-31T17:08:25.614428] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:08:25.614684] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-31T17:08:25.614742] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-31T17:08:25.614953] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-31T17:08:25.615008] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-31T17:08:25.862691] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-31T17:08:25.967028] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:08:26.293677] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T17:08:26.382503] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T17:08:26.657724] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-31T17:08:26.943015] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-31T17:08:27.457719] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-31T17:08:28.257723] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-31T17:08:28.693000] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T17:08:29.057679] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-31T17:08:29.329680] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T17:08:29.857684] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-31T17:08:30.505681] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T17:08:30.516153] [INFO ] [REMOTE ] AJG: Full fetch complete (68731 records). [2025-10-31T17:08:30.516286] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-31T17:08:30.662874] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-31T17:08:30.921536] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-31T17:08:30.921713] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-31T17:08:30.922492] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-31T17:08:30.922587] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-31T17:08:30.924156] [DEBUG] [LOCAL ] AJG: Trimmed 68731 records to 46977 (keeping 200 days of data) [2025-10-31T17:08:31.037387] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T17:08:31.252493] [DEBUG] [LOCAL ] AJG: Primary data saved (46977 records). [2025-10-31T17:08:31.252702] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-31T17:08:31.254063] [INFO ] [MAIN ] Update Progress: 74/2365 symbols completed. AJG took 35.4s. Estimated remaining: 4h 21m 34s. Rate: 8.8 symbols/min [2025-10-31T17:08:31.436180] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:08:31.436426] [DEBUG] [LOCAL ] ALB: No existing data file found in primary storage. [2025-10-31T17:08:31.436478] [WARN ] [MAIN ] ALB: No existing data found, performing full refresh instead. [2025-10-31T17:08:31.436593] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-31T17:08:31.436636] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-31T17:08:31.436736] [DEBUG] [LOCAL ] ALB: No primary data file found to delete. [2025-10-31T17:08:31.436776] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-31T17:08:31.470181] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-31T17:08:31.810200] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-31T17:08:31.807769] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:08:31.984288] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T17:08:32.257687] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-31T17:08:32.551573] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-31T17:08:33.057681] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-31T17:08:33.857750] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-31T17:08:34.657733] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-31T17:08:34.946789] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-31T17:08:34.978995] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T17:08:35.457719] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-31T17:08:36.126836] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-31T17:08:36.257665] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-31T17:08:36.890592] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-31T17:08:37.057667] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-31T17:08:37.599029] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-31T17:08:37.857704] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-31T17:08:38.296147] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T17:08:38.657665] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-31T17:08:39.457623] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-31T17:08:39.586113] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-31T17:08:39.793335] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-31T17:08:40.013851] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T17:08:40.257680] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-31T17:08:41.057626] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-31T17:08:41.475447] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T17:08:41.784163] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-31T17:08:41.785679] [INFO ] [REMOTE ] AKA: Full fetch complete (2805 records). [2025-10-31T17:08:41.785746] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-31T17:08:41.862743] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-31T17:08:41.961499] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-31T17:08:41.961727] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:08:41.961794] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:08:41.961861] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-31T17:08:41.961932] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-31T17:08:41.961986] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-31T17:08:41.962028] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-31T17:08:41.962083] [INFO ] [MAIN ] Update Progress: 75/2365 symbols completed. AKA took 29.6s. Estimated remaining: 4h 23m 25s. Rate: 8.7 symbols/min [2025-10-31T17:08:42.126511] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:08:42.172304] [DEBUG] [LOCAL ] ALC: Loaded 51499 existing records from primary storage. [2025-10-31T17:08:42.172589] [INFO ] [MAIN ] ALC: Loaded 51499 existing records. [2025-10-31T17:08:42.350113] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:08:42.350256] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-31T17:08:42.350326] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-31T17:08:42.351225] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-31T17:08:42.351283] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-31T17:08:42.662860] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-31T17:08:42.701361] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:08:43.457718] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-31T17:08:43.493233] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-31T17:08:43.908762] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-31T17:08:44.257672] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-31T17:08:44.793633] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T17:08:45.057679] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-31T17:08:45.674018] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T17:08:45.857623] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-31T17:08:46.407713] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-31T17:08:46.657672] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-31T17:08:47.457616] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-31T17:08:47.618668] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-31T17:08:48.031092] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T17:08:48.257687] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-31T17:08:48.675638] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T17:08:49.057693] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-31T17:08:49.385554] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T17:08:49.857717] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-31T17:08:50.425816] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T17:08:50.657734] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-31T17:08:51.272835] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-31T17:08:51.457634] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-31T17:08:52.262735] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-31T17:08:52.279997] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-31T17:08:52.951290] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T17:08:52.962250] [INFO ] [REMOTE ] AL: Full fetch complete (63931 records). [2025-10-31T17:08:52.962401] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-31T17:08:53.062868] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-31T17:08:53.346811] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-31T17:08:53.346944] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-31T17:08:53.347551] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-31T17:08:53.347592] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-31T17:08:53.348840] [DEBUG] [LOCAL ] AL: Trimmed 63931 records to 45397 (keeping 200 days of data) [2025-10-31T17:08:53.644425] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T17:08:53.643556] [DEBUG] [LOCAL ] AL: Primary data saved (45397 records). [2025-10-31T17:08:53.654458] [INFO ] [MAIN ] AL: Full history saved. [2025-10-31T17:08:53.655711] [INFO ] [MAIN ] Update Progress: 76/2365 symbols completed. AL took 28.4s. Estimated remaining: 4h 25m 42s. Rate: 8.6 symbols/min [2025-10-31T17:08:53.820525] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:08:53.851749] [DEBUG] [LOCAL ] ALE: Loaded 31988 existing records from primary storage. [2025-10-31T17:08:53.852024] [INFO ] [MAIN ] ALE: Loaded 31988 existing records. [2025-10-31T17:08:53.862988] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-31T17:08:54.030844] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:08:54.031055] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-31T17:08:54.031101] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-31T17:08:54.031335] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-31T17:08:54.031373] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-31T17:08:54.410877] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:08:54.442478] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T17:08:54.657696] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-31T17:08:55.457699] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-31T17:08:55.668170] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-31T17:08:55.900032] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T17:08:56.257719] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-31T17:08:56.589159] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:08:57.057682] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-31T17:08:57.857766] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-31T17:08:57.979457] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-31T17:08:58.064292] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T17:08:58.657619] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-31T17:08:59.195793] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T17:08:59.457685] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-31T17:09:00.119144] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T17:09:00.257617] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-31T17:09:00.770953] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-31T17:09:01.057706] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-31T17:09:01.303622] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T17:09:01.857699] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-31T17:09:02.657704] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-31T17:09:03.020854] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T17:09:03.258847] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-31T17:09:03.457706] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-31T17:09:03.972901] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:09:04.257741] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-31T17:09:05.057735] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-31T17:09:05.611266] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-31T17:09:05.623173] [INFO ] [REMOTE ] ALB: Full fetch complete (77126 records). [2025-10-31T17:09:05.623297] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-31T17:09:05.858147] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-31T17:09:06.063360] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-31T17:09:06.067574] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-31T17:09:06.067501] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T17:09:06.068479] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-31T17:09:06.068673] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-31T17:09:06.076277] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-31T17:09:06.087278] [DEBUG] [LOCAL ] ALB: Trimmed 77126 records to 54123 (keeping 200 days of data) [2025-10-31T17:09:06.087184] [INFO ] [REMOTE ] AKR: Full fetch complete (65251 records). [2025-10-31T17:09:06.087442] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-31T17:09:06.088545] [FATAL] [VALIDATOR ] AKR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:09:06.088703] [FATAL] [MAIN ] AKR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:09:06.088786] [WARN ] [MAIN ] AKR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:09:06.088875] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-31T17:09:06.088950] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-10-31T17:09:06.088995] [INFO ] [LOCAL ] AKR: Starting deletion of derivative data. [2025-10-31T17:09:06.089183] [DEBUG] [LOCAL ] AKR: Deleted derivative data file. [2025-10-31T17:09:06.089578] [INFO ] [MAIN ] Update Progress: 77/2365 symbols completed. AKR took 44.1s. Estimated remaining: 4h 28m 18s. Rate: 8.5 symbols/min [2025-10-31T17:09:06.412908] [DEBUG] [LOCAL ] ALB: Primary data saved (54123 records). [2025-10-31T17:09:06.413039] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-31T17:09:06.413107] [INFO ] [MAIN ] Update Progress: 78/2365 symbols completed. ALB took 35.2s. Estimated remaining: 4h 24m 54s. Rate: 8.6 symbols/min [2025-10-31T17:09:06.657669] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-31T17:09:07.515895] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-31T17:09:07.527211] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-31T17:09:07.679280] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-31T17:09:08.257633] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-31T17:09:09.049218] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T17:09:09.061167] [INFO ] [REMOTE ] ALC: Full fetch complete (74013 records). [2025-10-31T17:09:09.061320] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-31T17:09:09.465521] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-31T17:09:09.465684] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-31T17:09:09.466559] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-31T17:09:09.466717] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-31T17:09:09.488182] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T17:09:09.495866] [DEBUG] [LOCAL ] ALC: Trimmed 74013 records to 51876 (keeping 200 days of data) [2025-10-31T17:09:09.497149] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-31T17:09:09.804216] [DEBUG] [LOCAL ] ALC: Primary data saved (51876 records). [2025-10-31T17:09:09.804349] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-31T17:09:09.804424] [INFO ] [MAIN ] Update Progress: 79/2365 symbols completed. ALC took 27.8s. Estimated remaining: 4h 23m 4s. Rate: 8.7 symbols/min [2025-10-31T17:09:10.507625] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-31T17:09:10.516202] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-31T17:09:11.620613] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T17:09:11.629734] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-31T17:09:13.132926] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T17:09:13.145639] [INFO ] [REMOTE ] ALE: Full fetch complete (44494 records). [2025-10-31T17:09:13.145905] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-31T17:09:13.538484] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-31T17:09:13.538560] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-31T17:09:13.539042] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-31T17:09:13.539103] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-31T17:09:13.540040] [DEBUG] [LOCAL ] ALE: Trimmed 44494 records to 32228 (keeping 200 days of data) [2025-10-31T17:09:13.725583] [DEBUG] [LOCAL ] ALE: Primary data saved (32228 records). [2025-10-31T17:09:13.725750] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-31T17:09:13.725834] [INFO ] [MAIN ] Update Progress: 80/2365 symbols completed. ALE took 20.1s. Estimated remaining: 4h 21m 32s. Rate: 8.7 symbols/min [2025-10-31T17:09:14.324040] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:09:14.364504] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:09:14.407974] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:09:14.442732] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:09:14.438483] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-31T17:09:14.443073] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-31T17:09:14.443680] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-31T17:09:14.443738] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-31T17:09:14.443784] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-31T17:09:14.443817] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-31T17:09:14.575554] [DEBUG] [LOCAL ] ALG: Loaded 9513 existing records from primary storage. [2025-10-31T17:09:14.576342] [INFO ] [MAIN ] ALG: Loaded 9513 existing records. [2025-10-31T17:09:14.728464] [DEBUG] [LOCAL ] ALEX: Loaded 30448 existing records from primary storage. [2025-10-31T17:09:14.795596] [INFO ] [MAIN ] ALEX: Loaded 30448 existing records. [2025-10-31T17:09:15.061489] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:09:15.110515] [DEBUG] [LOCAL ] ALIT: Loaded 53146 existing records from primary storage. [2025-10-31T17:09:15.124145] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-31T17:09:15.137527] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-31T17:09:15.143124] [INFO ] [MAIN ] ALIT: Loaded 53146 existing records. [2025-10-31T17:09:15.169396] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-31T17:09:15.273320] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:09:15.289055] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-31T17:09:15.318804] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:09:15.324569] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-31T17:09:15.319017] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-31T17:09:15.335046] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-31T17:09:15.393126] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-31T17:09:15.396413] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-31T17:09:15.579456] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:09:15.625891] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:09:15.650237] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-31T17:09:15.659833] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-31T17:09:15.665387] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-31T17:09:15.665222] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:09:15.670727] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-31T17:09:15.682018] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-31T17:09:15.681901] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-31T17:09:15.702942] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:09:15.799207] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-31T17:09:15.864562] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-31T17:09:15.936291] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-31T17:09:16.033983] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-31T17:09:16.083350] [INFO ] [MAIN ] Update Progress: 81/2365 symbols completed. ALH took 2.4s. Estimated remaining: 4h 19m 18s. Rate: 8.8 symbols/min [2025-10-31T17:09:16.381451] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:09:16.404452] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-31T17:09:16.488872] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:09:16.527169] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-31T17:09:16.622679] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:09:16.744701] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:09:16.745193] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-31T17:09:16.788380] [DEBUG] [LOCAL ] ALK: Loaded 53474 existing records from primary storage. [2025-10-31T17:09:16.788744] [INFO ] [MAIN ] ALK: Loaded 53474 existing records. [2025-10-31T17:09:16.973231] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:09:16.973438] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-31T17:09:16.973486] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-31T17:09:16.973827] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-31T17:09:16.973882] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-31T17:09:17.340007] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:09:17.347434] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-31T17:09:17.349114] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:09:17.352190] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-31T17:09:17.370034] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T17:09:17.376243] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-31T17:09:17.962364] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-31T17:09:17.965127] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-31T17:09:18.090133] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T17:09:18.095560] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-31T17:09:18.191509] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T17:09:18.511983] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T17:09:18.620100] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T17:09:18.657607] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-31T17:09:19.250597] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:09:19.457711] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-31T17:09:19.980757] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T17:09:20.257694] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-31T17:09:20.810132] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-31T17:09:20.836361] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-31T17:09:21.057717] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-31T17:09:21.857632] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-31T17:09:22.055110] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-31T17:09:22.462583] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-31T17:09:22.657681] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-31T17:09:23.307724] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T17:09:23.457685] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-31T17:09:24.257713] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-31T17:09:24.378609] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-31T17:09:24.783559] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T17:09:25.057697] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-31T17:09:25.857673] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-31T17:09:26.376968] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-31T17:09:26.657617] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-31T17:09:27.265084] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T17:09:27.457687] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-31T17:09:28.067406] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T17:09:28.257621] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-31T17:09:28.987425] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T17:09:29.057685] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-31T17:09:29.525478] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-31T17:09:29.857714] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-31T17:09:30.582187] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T17:09:30.657638] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-31T17:09:31.176580] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-31T17:09:31.269919] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-31T17:09:31.457735] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-31T17:09:32.043106] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-31T17:09:32.257683] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-31T17:09:32.907359] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T17:09:32.909936] [INFO ] [REMOTE ] ALG: Full fetch complete (14985 records). [2025-10-31T17:09:32.910038] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-31T17:09:33.062690] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-31T17:09:33.276255] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-31T17:09:33.276331] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-31T17:09:33.276571] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-31T17:09:33.276612] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-31T17:09:33.277105] [DEBUG] [LOCAL ] ALG: Trimmed 14985 records to 9664 (keeping 200 days of data) [2025-10-31T17:09:33.335194] [DEBUG] [LOCAL ] ALG: Primary data saved (9664 records). [2025-10-31T17:09:33.335316] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-31T17:09:33.335389] [INFO ] [MAIN ] Update Progress: 82/2365 symbols completed. ALG took 19.6s. Estimated remaining: 4h 24m 2s. Rate: 8.6 symbols/min [2025-10-31T17:09:33.501590] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:09:33.545955] [DEBUG] [LOCAL ] ALL: Loaded 49729 existing records from primary storage. [2025-10-31T17:09:33.546244] [INFO ] [MAIN ] ALL: Loaded 49729 existing records. [2025-10-31T17:09:33.727185] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:09:33.727393] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-31T17:09:33.727452] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-31T17:09:33.727829] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-31T17:09:33.727889] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-31T17:09:33.869378] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-31T17:09:34.086126] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:09:34.105144] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T17:09:34.657685] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-31T17:09:35.201998] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T17:09:35.457717] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-31T17:09:35.692217] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T17:09:36.257668] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-31T17:09:36.909486] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T17:09:37.057629] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-31T17:09:37.103698] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-31T17:09:37.857675] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-31T17:09:38.657681] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-31T17:09:38.881711] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-31T17:09:39.207552] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T17:09:39.457623] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-31T17:09:39.717123] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T17:09:40.257694] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-31T17:09:40.822085] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T17:09:41.057688] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-31T17:09:41.785687] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-31T17:09:41.857703] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-31T17:09:42.193022] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:09:42.200223] [INFO ] [REMOTE ] ALEX: Full fetch complete (44406 records). [2025-10-31T17:09:42.200332] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-31T17:09:42.200945] [FATAL] [VALIDATOR ] ALEX: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:09:42.201030] [FATAL] [MAIN ] ALEX: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:09:42.201073] [WARN ] [MAIN ] ALEX: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:09:42.201140] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-31T17:09:42.201228] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-10-31T17:09:42.201285] [INFO ] [LOCAL ] ALEX: Starting deletion of derivative data. [2025-10-31T17:09:42.201407] [DEBUG] [LOCAL ] ALEX: Deleted derivative data file. [2025-10-31T17:09:42.201479] [INFO ] [MAIN ] Update Progress: 83/2365 symbols completed. ALEX took 28.5s. Estimated remaining: 4h 24m 48s. Rate: 8.6 symbols/min [2025-10-31T17:09:42.367761] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:09:42.415679] [DEBUG] [LOCAL ] ALLE: Loaded 43964 existing records from primary storage. [2025-10-31T17:09:42.416039] [INFO ] [MAIN ] ALLE: Loaded 43964 existing records. [2025-10-31T17:09:42.590181] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:09:42.590409] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-31T17:09:42.590475] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-31T17:09:42.590840] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-31T17:09:42.590896] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-31T17:09:42.663351] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-31T17:09:42.936199] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:09:43.208950] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T17:09:43.457725] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-31T17:09:44.257683] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-31T17:09:44.471220] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-31T17:09:45.027606] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-31T17:09:45.057625] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-31T17:09:45.857618] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-31T17:09:46.064639] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-31T17:09:46.077450] [INFO ] [REMOTE ] ALIT: Full fetch complete (76626 records). [2025-10-31T17:09:46.077586] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-31T17:09:46.476340] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-31T17:09:46.476519] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-31T17:09:46.477297] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-31T17:09:46.477466] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-31T17:09:46.479316] [DEBUG] [LOCAL ] ALIT: Trimmed 76626 records to 53532 (keeping 200 days of data) [2025-10-31T17:09:46.610601] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T17:09:46.674435] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-31T17:09:46.814545] [DEBUG] [LOCAL ] ALIT: Primary data saved (53532 records). [2025-10-31T17:09:46.814709] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-31T17:09:46.814798] [INFO ] [MAIN ] Update Progress: 84/2365 symbols completed. ALIT took 33.1s. Estimated remaining: 4h 23m 37s. Rate: 8.7 symbols/min [2025-10-31T17:09:46.987063] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:09:47.034723] [DEBUG] [LOCAL ] ALLY: Loaded 53578 existing records from primary storage. [2025-10-31T17:09:47.035022] [INFO ] [MAIN ] ALLY: Loaded 53578 existing records. [2025-10-31T17:09:47.212969] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:09:47.213240] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-31T17:09:47.213351] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-31T17:09:47.213609] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-31T17:09:47.213703] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-31T17:09:47.462772] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-31T17:09:47.545271] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-31T17:09:47.619271] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:09:47.987974] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T17:09:48.257700] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-31T17:09:48.681011] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T17:09:49.057675] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-31T17:09:49.716845] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T17:09:49.857708] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-31T17:09:50.492482] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T17:09:50.657681] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-31T17:09:51.457629] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-31T17:09:51.592750] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-31T17:09:52.098814] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-31T17:09:52.257677] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-31T17:09:52.965173] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T17:09:53.057631] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-31T17:09:53.771560] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-31T17:09:53.857675] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-31T17:09:54.519155] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T17:09:54.657631] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-31T17:09:55.366357] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-31T17:09:55.457605] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-31T17:09:55.877487] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T17:09:56.257688] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-31T17:09:56.638082] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T17:09:57.057716] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-31T17:09:57.712745] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T17:09:57.857626] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-31T17:09:58.144725] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T17:09:58.657681] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-31T17:09:59.054637] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T17:09:59.457664] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-31T17:10:00.002441] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T17:10:00.257661] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-31T17:10:00.661096] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T17:10:01.057681] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-31T17:10:01.857677] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-31T17:10:02.228370] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T17:10:02.644572] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-31T17:10:02.661470] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-31T17:10:02.663254] [INFO ] [REMOTE ] ALK: Full fetch complete (77047 records). [2025-10-31T17:10:02.663360] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-31T17:10:03.090660] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-31T17:10:03.090747] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-31T17:10:03.091448] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-31T17:10:03.091613] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-31T17:10:03.093141] [DEBUG] [LOCAL ] ALK: Trimmed 77047 records to 53863 (keeping 200 days of data) [2025-10-31T17:10:03.320094] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-31T17:10:03.444626] [DEBUG] [LOCAL ] ALK: Primary data saved (53863 records). [2025-10-31T17:10:03.444784] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-31T17:10:03.444860] [INFO ] [MAIN ] Update Progress: 85/2365 symbols completed. ALK took 47.3s. Estimated remaining: 4h 27m 50s. Rate: 8.5 symbols/min [2025-10-31T17:10:03.465522] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-31T17:10:03.619826] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:03.658576] [DEBUG] [LOCAL ] ALSN: Loaded 43366 existing records from primary storage. [2025-10-31T17:10:03.658912] [INFO ] [MAIN ] ALSN: Loaded 43366 existing records. [2025-10-31T17:10:03.872600] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:03.872823] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-31T17:10:03.872868] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-31T17:10:03.873098] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-31T17:10:03.873135] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-31T17:10:04.236767] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:04.262788] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-31T17:10:04.282169] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-31T17:10:04.912860] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T17:10:04.956512] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T17:10:04.967841] [INFO ] [REMOTE ] ALL: Full fetch complete (72201 records). [2025-10-31T17:10:04.968057] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-31T17:10:05.062799] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-31T17:10:05.382274] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-31T17:10:05.382353] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-31T17:10:05.383030] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-31T17:10:05.383094] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-31T17:10:05.384434] [DEBUG] [LOCAL ] ALL: Trimmed 72201 records to 50082 (keeping 200 days of data) [2025-10-31T17:10:05.690663] [DEBUG] [LOCAL ] ALL: Primary data saved (50082 records). [2025-10-31T17:10:05.690797] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-31T17:10:05.691466] [INFO ] [MAIN ] Update Progress: 86/2365 symbols completed. ALL took 32.4s. Estimated remaining: 4h 25m 36s. Rate: 8.6 symbols/min [2025-10-31T17:10:05.855626] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:05.857691] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-31T17:10:05.879241] [DEBUG] [LOCAL ] ALTG: Loaded 22843 existing records from primary storage. [2025-10-31T17:10:05.879480] [INFO ] [MAIN ] ALTG: Loaded 22843 existing records. [2025-10-31T17:10:06.050513] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:06.050743] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-31T17:10:06.050796] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-31T17:10:06.050998] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-31T17:10:06.051037] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-31T17:10:06.403022] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:06.633694] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-31T17:10:06.657618] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-31T17:10:07.457744] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-31T17:10:07.752396] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-31T17:10:07.943536] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T17:10:08.226348] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-31T17:10:08.257719] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-31T17:10:09.057755] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-31T17:10:09.666316] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T17:10:09.857695] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-31T17:10:10.657638] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-31T17:10:10.690328] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T17:10:10.699728] [INFO ] [REMOTE ] ALLE: Full fetch complete (64811 records). [2025-10-31T17:10:10.699850] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-31T17:10:10.892624] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T17:10:11.113090] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-31T17:10:11.113168] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-31T17:10:11.113799] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-31T17:10:11.113862] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-31T17:10:11.115095] [DEBUG] [LOCAL ] ALLE: Trimmed 64811 records to 44193 (keeping 200 days of data) [2025-10-31T17:10:11.382824] [DEBUG] [LOCAL ] ALLE: Primary data saved (44193 records). [2025-10-31T17:10:11.382946] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-31T17:10:11.385234] [INFO ] [MAIN ] Update Progress: 87/2365 symbols completed. ALLE took 29.2s. Estimated remaining: 4h 24m 55s. Rate: 8.6 symbols/min [2025-10-31T17:10:11.462744] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-31T17:10:11.552317] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:11.563581] [DEBUG] [LOCAL ] ALUR: Loaded 9125 existing records from primary storage. [2025-10-31T17:10:11.563821] [INFO ] [MAIN ] ALUR: Loaded 9125 existing records. [2025-10-31T17:10:11.786531] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:11.786945] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-31T17:10:11.787056] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-31T17:10:11.787307] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-31T17:10:11.787386] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-31T17:10:12.016529] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T17:10:12.207368] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:12.257612] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-31T17:10:13.048079] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-31T17:10:13.058711] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-31T17:10:13.352000] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T17:10:13.857711] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-31T17:10:14.123243] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T17:10:14.653951] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T17:10:14.658081] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-31T17:10:15.457682] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-31T17:10:16.257703] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-31T17:10:16.512382] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-31T17:10:16.524691] [INFO ] [REMOTE ] ALLY: Full fetch complete (77233 records). [2025-10-31T17:10:16.524810] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-31T17:10:16.914066] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-31T17:10:16.914218] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-31T17:10:16.914964] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-31T17:10:16.915027] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-31T17:10:16.916634] [DEBUG] [LOCAL ] ALLY: Trimmed 77233 records to 53965 (keeping 200 days of data) [2025-10-31T17:10:16.941420] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-31T17:10:17.067459] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-31T17:10:17.080492] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T17:10:17.287896] [DEBUG] [LOCAL ] ALLY: Primary data saved (53965 records). [2025-10-31T17:10:17.288059] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-31T17:10:17.289541] [INFO ] [MAIN ] Update Progress: 88/2365 symbols completed. ALLY took 30.5s. Estimated remaining: 4h 24m 20s. Rate: 8.6 symbols/min [2025-10-31T17:10:17.466949] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:17.512552] [DEBUG] [LOCAL ] ALV: Loaded 42323 existing records from primary storage. [2025-10-31T17:10:17.512862] [INFO ] [MAIN ] ALV: Loaded 42323 existing records. [2025-10-31T17:10:17.685693] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:17.685926] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-31T17:10:17.685971] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-31T17:10:17.686172] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-31T17:10:17.686226] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-31T17:10:17.858206] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-31T17:10:18.037124] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:18.332505] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T17:10:18.480084] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-31T17:10:18.657689] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-31T17:10:19.457673] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-31T17:10:19.838988] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T17:10:20.257672] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-31T17:10:20.886919] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:10:21.057680] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-31T17:10:21.651705] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T17:10:21.857675] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-31T17:10:22.263160] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T17:10:22.657627] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-31T17:10:22.798204] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-31T17:10:23.457678] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-31T17:10:24.102177] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-31T17:10:24.112901] [INFO ] [REMOTE ] ALSN: Full fetch complete (62966 records). [2025-10-31T17:10:24.124863] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T17:10:24.124352] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-31T17:10:24.271852] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-31T17:10:24.517066] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-31T17:10:24.517141] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-31T17:10:24.517749] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-31T17:10:24.517810] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-31T17:10:24.519038] [DEBUG] [LOCAL ] ALSN: Trimmed 62966 records to 43706 (keeping 200 days of data) [2025-10-31T17:10:24.772766] [DEBUG] [LOCAL ] ALSN: Primary data saved (43706 records). [2025-10-31T17:10:24.772887] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-31T17:10:24.772960] [INFO ] [MAIN ] Update Progress: 89/2365 symbols completed. ALSN took 21.3s. Estimated remaining: 4h 24m 26s. Rate: 8.6 symbols/min [2025-10-31T17:10:24.942180] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:24.952744] [DEBUG] [LOCAL ] ALX: Loaded 7671 existing records from primary storage. [2025-10-31T17:10:24.952933] [INFO ] [MAIN ] ALX: Loaded 7671 existing records. [2025-10-31T17:10:25.061376] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-31T17:10:25.141987] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:25.142540] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-31T17:10:25.142713] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-31T17:10:25.143227] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-31T17:10:25.143304] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-31T17:10:25.397483] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T17:10:25.541076] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:25.857682] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-31T17:10:26.275590] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T17:10:26.326635] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T17:10:26.657712] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-31T17:10:27.457701] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-31T17:10:27.826593] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T17:10:28.206741] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-31T17:10:28.257632] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-31T17:10:29.057677] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-31T17:10:29.451446] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-31T17:10:29.496050] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T17:10:29.857634] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-31T17:10:30.201436] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-31T17:10:30.657685] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-31T17:10:31.457684] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-31T17:10:31.877834] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-31T17:10:32.024429] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T17:10:32.257639] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-31T17:10:32.798277] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-31T17:10:33.057730] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-31T17:10:33.857681] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-31T17:10:34.263035] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T17:10:34.660585] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-31T17:10:34.664002] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-31T17:10:35.340059] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T17:10:35.457683] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-31T17:10:36.257670] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-31T17:10:36.329308] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-31T17:10:37.057709] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-31T17:10:37.625242] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-31T17:10:37.658594] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T17:10:37.857672] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-31T17:10:38.443247] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-31T17:10:38.657708] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-31T17:10:39.457748] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-31T17:10:39.570277] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T17:10:40.049250] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T17:10:40.257699] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-31T17:10:40.790200] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-31T17:10:41.057661] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-31T17:10:41.857630] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-31T17:10:42.313814] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T17:10:42.600924] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T17:10:42.657684] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-31T17:10:43.418350] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-31T17:10:43.423726] [INFO ] [REMOTE ] ALTG: Full fetch complete (33318 records). [2025-10-31T17:10:43.423817] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-31T17:10:43.462914] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-31T17:10:43.843352] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-31T17:10:43.843473] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-31T17:10:43.843991] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-31T17:10:43.844060] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-31T17:10:43.845440] [DEBUG] [LOCAL ] ALTG: Trimmed 33318 records to 22968 (keeping 200 days of data) [2025-10-31T17:10:43.976996] [DEBUG] [LOCAL ] ALTG: Primary data saved (22968 records). [2025-10-31T17:10:43.977176] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-31T17:10:43.977273] [INFO ] [MAIN ] Update Progress: 90/2365 symbols completed. ALTG took 38.3s. Estimated remaining: 4h 29m 29s. Rate: 8.4 symbols/min [2025-10-31T17:10:44.160347] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:44.170580] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T17:10:44.173990] [INFO ] [REMOTE ] ALX: Full fetch complete (8595 records). [2025-10-31T17:10:44.174073] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-31T17:10:44.262732] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-31T17:10:44.550164] [DEBUG] [LOCAL ] AM: Loaded 52129 existing records from primary storage. [2025-10-31T17:10:44.572309] [INFO ] [MAIN ] AM: Loaded 52129 existing records. [2025-10-31T17:10:44.572199] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-31T17:10:44.614707] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-31T17:10:44.641259] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-31T17:10:44.647146] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-31T17:10:44.674444] [DEBUG] [LOCAL ] ALX: Trimmed 8595 records to 7743 (keeping 200 days of data) [2025-10-31T17:10:44.791214] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:44.795907] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-31T17:10:44.800750] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-31T17:10:44.802328] [DEBUG] [LOCAL ] ALX: Primary data saved (7743 records). [2025-10-31T17:10:44.802436] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-31T17:10:44.802608] [INFO ] [MAIN ] Update Progress: 91/2365 symbols completed. ALX took 20.0s. Estimated remaining: 4h 26m 45s. Rate: 8.5 symbols/min [2025-10-31T17:10:44.814107] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-31T17:10:44.839159] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-31T17:10:44.921338] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T17:10:45.065757] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-31T17:10:45.164941] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:45.385876] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:45.386933] [DEBUG] [LOCAL ] AMBC: Loaded 35563 existing records from primary storage. [2025-10-31T17:10:45.387136] [INFO ] [MAIN ] AMBC: Loaded 35563 existing records. [2025-10-31T17:10:45.567407] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:45.567583] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-31T17:10:45.567629] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-31T17:10:45.567970] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-31T17:10:45.568025] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-31T17:10:45.862912] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-31T17:10:45.926149] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:46.306391] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T17:10:46.507728] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T17:10:46.657673] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-31T17:10:47.457679] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-31T17:10:48.091705] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T17:10:48.257619] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-31T17:10:48.823238] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-31T17:10:48.825452] [INFO ] [REMOTE ] ALUR: Full fetch complete (17869 records). [2025-10-31T17:10:48.825546] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-31T17:10:49.061244] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-31T17:10:49.202420] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-31T17:10:49.202616] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-31T17:10:49.202928] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-31T17:10:49.203004] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-31T17:10:49.231250] [DEBUG] [LOCAL ] ALUR: Trimmed 17869 records to 9155 (keeping 200 days of data) [2025-10-31T17:10:49.233471] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-31T17:10:49.279894] [INFO ] [REMOTE ] ALV: Full fetch complete (62315 records). [2025-10-31T17:10:49.284030] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-31T17:10:49.395790] [DEBUG] [LOCAL ] ALUR: Primary data saved (9155 records). [2025-10-31T17:10:49.395932] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-31T17:10:49.396266] [INFO ] [MAIN ] Update Progress: 92/2365 symbols completed. ALUR took 38.0s. Estimated remaining: 4h 25m 37s. Rate: 8.6 symbols/min [2025-10-31T17:10:49.759397] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:49.853850] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-31T17:10:49.853929] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-31T17:10:49.854484] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-31T17:10:49.854524] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-31T17:10:49.855804] [DEBUG] [LOCAL ] ALV: Trimmed 62315 records to 42598 (keeping 200 days of data) [2025-10-31T17:10:49.866250] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-31T17:10:49.995142] [DEBUG] [LOCAL ] AMBP: Loaded 44694 existing records from primary storage. [2025-10-31T17:10:50.002794] [INFO ] [MAIN ] AMBP: Loaded 44694 existing records. [2025-10-31T17:10:50.281562] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:50.286821] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-31T17:10:50.287674] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-31T17:10:50.296313] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-31T17:10:50.296636] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-31T17:10:50.506542] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T17:10:50.505827] [DEBUG] [LOCAL ] ALV: Primary data saved (42598 records). [2025-10-31T17:10:50.545805] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-31T17:10:50.585767] [INFO ] [MAIN ] Update Progress: 93/2365 symbols completed. ALV took 33.3s. Estimated remaining: 4h 23m 8s. Rate: 8.6 symbols/min [2025-10-31T17:10:50.662739] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-31T17:10:50.894056] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:50.925081] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:50.925204] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-31T17:10:50.925259] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-31T17:10:50.925372] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-31T17:10:50.925413] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-31T17:10:50.925455] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-31T17:10:50.925488] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-31T17:10:51.290090] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:51.315807] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-31T17:10:51.457602] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-31T17:10:51.666277] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T17:10:52.257633] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-31T17:10:52.429589] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:10:52.429914] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-31T17:10:52.429999] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:10:52.430048] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-31T17:10:52.430108] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:10:52.430178] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-31T17:10:52.430244] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-31T17:10:52.430281] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-31T17:10:52.430320] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-31T17:10:52.430365] [INFO ] [MAIN ] Update Progress: 94/2365 symbols completed. AMBQ took 1.8s. Estimated remaining: 4h 20m 58s. Rate: 8.7 symbols/min [2025-10-31T17:10:52.596546] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:10:52.649474] [DEBUG] [LOCAL ] AMC: Loaded 54158 existing records from primary storage. [2025-10-31T17:10:52.649931] [INFO ] [MAIN ] AMC: Loaded 54158 existing records. [2025-10-31T17:10:52.827144] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:10:52.827418] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-31T17:10:52.827514] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-31T17:10:52.827763] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-31T17:10:52.827822] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-31T17:10:53.029071] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-31T17:10:53.068077] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-31T17:10:53.223971] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:10:53.857682] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-31T17:10:54.289886] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:10:54.657675] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-31T17:10:55.175001] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T17:10:55.457709] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-31T17:10:55.868257] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T17:10:56.257674] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-31T17:10:57.057677] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-31T17:10:57.292879] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T17:10:57.379144] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-31T17:10:57.857664] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-31T17:10:58.657636] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-31T17:10:58.898979] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-31T17:10:59.457731] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-31T17:10:59.912379] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-31T17:11:00.209378] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-31T17:11:00.257712] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-31T17:11:00.576976] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-31T17:11:01.057730] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-31T17:11:01.534113] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T17:11:01.857676] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-31T17:11:02.124632] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T17:11:02.657716] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-31T17:11:03.381055] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T17:11:03.457673] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-31T17:11:04.013385] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T17:11:04.257684] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-31T17:11:05.057679] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-31T17:11:05.470383] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T17:11:05.508758] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-31T17:11:05.857687] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-31T17:11:06.224251] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T17:11:06.657672] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-31T17:11:06.906204] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T17:11:07.457669] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-31T17:11:07.812021] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T17:11:08.257704] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-31T17:11:09.057633] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-31T17:11:09.428258] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T17:11:09.632430] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-31T17:11:09.857627] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-31T17:11:10.001446] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T17:11:10.657685] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-31T17:11:11.417813] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-31T17:11:11.457622] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-31T17:11:12.257673] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-31T17:11:12.316126] [DEBUG] [REMOTE ] AMBP: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-31T17:11:12.316422] [WARN ] [REMOTE ] AMBP: No data returned for month 2025-08 [2025-10-31T17:11:12.316505] [FATAL] [REMOTE ] AMBP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:11:12.316620] [FATAL] [MAIN ] AMBP: Failed to fetch primary data. [2025-10-31T17:11:12.316726] [WARN ] [MAIN ] AMBP: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:11:12.316809] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-31T17:11:12.316886] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-10-31T17:11:12.316936] [INFO ] [LOCAL ] AMBP: Starting deletion of derivative data. [2025-10-31T17:11:12.317091] [DEBUG] [LOCAL ] AMBP: Deleted derivative data file. [2025-10-31T17:11:12.317189] [INFO ] [MAIN ] Update Progress: 95/2365 symbols completed. AMBP took 22.9s. Estimated remaining: 4h 26m 1s. Rate: 8.5 symbols/min [2025-10-31T17:11:12.484428] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:11:12.535678] [DEBUG] [LOCAL ] AMCR: Loaded 54060 existing records from primary storage. [2025-10-31T17:11:12.535978] [INFO ] [MAIN ] AMCR: Loaded 54060 existing records. [2025-10-31T17:11:12.727295] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:11:12.728000] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-31T17:11:12.728069] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-31T17:11:12.728468] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-31T17:11:12.728624] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-31T17:11:13.067233] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-31T17:11:13.102633] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-31T17:11:13.152282] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:11:13.179629] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-31T17:11:13.857687] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-31T17:11:14.342089] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T17:11:14.350410] [INFO ] [REMOTE ] AMBC: Full fetch complete (51840 records). [2025-10-31T17:11:14.350542] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-31T17:11:14.658549] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-31T17:11:14.766839] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-31T17:11:14.766919] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-31T17:11:14.767426] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-31T17:11:14.767465] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-31T17:11:14.768440] [DEBUG] [LOCAL ] AMBC: Trimmed 51840 records to 35793 (keeping 200 days of data) [2025-10-31T17:11:14.956461] [DEBUG] [LOCAL ] AMBC: Primary data saved (35793 records). [2025-10-31T17:11:14.956586] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-31T17:11:14.956686] [INFO ] [MAIN ] Update Progress: 96/2365 symbols completed. AMBC took 30.2s. Estimated remaining: 4h 24m 10s. Rate: 8.6 symbols/min [2025-10-31T17:11:15.119913] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:11:15.164490] [DEBUG] [LOCAL ] AME: Loaded 48692 existing records from primary storage. [2025-10-31T17:11:15.164793] [INFO ] [MAIN ] AME: Loaded 48692 existing records. [2025-10-31T17:11:15.343862] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:11:15.344167] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-31T17:11:15.344344] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-31T17:11:15.354787] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-31T17:11:15.372286] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-31T17:11:15.464825] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-31T17:11:15.453899] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-31T17:11:15.738261] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:11:16.257731] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-31T17:11:16.715440] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-31T17:11:16.767627] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T17:11:17.057673] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-31T17:11:17.684105] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T17:11:17.857666] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-31T17:11:18.657620] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-31T17:11:19.083213] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-31T17:11:19.451858] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T17:11:19.462883] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-31T17:11:19.464821] [INFO ] [REMOTE ] AM: Full fetch complete (75637 records). [2025-10-31T17:11:19.465021] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-31T17:11:19.868201] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-31T17:11:19.868330] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-31T17:11:19.869177] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-31T17:11:19.869261] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-31T17:11:19.870800] [DEBUG] [LOCAL ] AM: Trimmed 75637 records to 52518 (keeping 200 days of data) [2025-10-31T17:11:20.120992] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T17:11:20.229469] [DEBUG] [LOCAL ] AM: Primary data saved (52518 records). [2025-10-31T17:11:20.229595] [INFO ] [MAIN ] AM: Full history saved. [2025-10-31T17:11:20.231209] [INFO ] [MAIN ] Update Progress: 97/2365 symbols completed. AM took 36.3s. Estimated remaining: 4h 23m 23s. Rate: 8.6 symbols/min [2025-10-31T17:11:20.262735] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-31T17:11:20.403174] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:11:20.424394] [DEBUG] [LOCAL ] AMG: Loaded 19719 existing records from primary storage. [2025-10-31T17:11:20.424620] [INFO ] [MAIN ] AMG: Loaded 19719 existing records. [2025-10-31T17:11:20.597424] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:11:20.597667] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-31T17:11:20.597728] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-31T17:11:20.597950] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-31T17:11:20.598010] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-31T17:11:20.963836] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:11:20.990420] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-31T17:11:21.057623] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-31T17:11:21.799626] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-31T17:11:21.857612] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-31T17:11:22.469678] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T17:11:22.657662] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-31T17:11:23.258501] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-31T17:11:23.418369] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-31T17:11:23.457612] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-31T17:11:24.230675] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-31T17:11:24.257616] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-31T17:11:25.057728] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-31T17:11:25.462198] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T17:11:25.857698] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-31T17:11:26.311804] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T17:11:26.657671] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-31T17:11:27.457632] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-31T17:11:27.541532] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T17:11:27.954110] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-31T17:11:28.257668] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-31T17:11:28.897605] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-31T17:11:29.057680] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-31T17:11:29.345625] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T17:11:29.857688] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-31T17:11:30.400064] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-31T17:11:30.657670] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-31T17:11:31.296497] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T17:11:31.457629] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-31T17:11:31.780985] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:11:32.257685] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-31T17:11:32.926638] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T17:11:33.057625] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-31T17:11:33.166769] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T17:11:33.857676] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-31T17:11:34.482884] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-31T17:11:34.657668] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-31T17:11:35.066425] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T17:11:35.457739] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-31T17:11:36.142335] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T17:11:36.257621] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-31T17:11:36.546097] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-31T17:11:37.057677] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-31T17:11:37.526084] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T17:11:37.619986] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-31T17:11:37.857681] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-31T17:11:38.657684] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-31T17:11:39.194761] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-31T17:11:39.386162] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T17:11:39.457621] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-31T17:11:40.163576] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T17:11:40.257696] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-31T17:11:41.057680] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-31T17:11:41.361513] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-31T17:11:41.366246] [INFO ] [REMOTE ] AMG: Full fetch complete (29309 records). [2025-10-31T17:11:41.366331] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-31T17:11:41.740177] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-31T17:11:41.740253] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-31T17:11:41.740598] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-31T17:11:41.740637] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-31T17:11:41.741324] [DEBUG] [LOCAL ] AMG: Trimmed 29309 records to 19885 (keeping 200 days of data) [2025-10-31T17:11:41.860427] [DEBUG] [LOCAL ] AMG: Primary data saved (19885 records). [2025-10-31T17:11:41.860715] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-31T17:11:41.860885] [INFO ] [MAIN ] Update Progress: 98/2365 symbols completed. AMG took 21.6s. Estimated remaining: 4h 28m 56s. Rate: 8.4 symbols/min [2025-10-31T17:11:41.860535] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-31T17:11:42.035619] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:11:42.085309] [DEBUG] [LOCAL ] AMH: Loaded 52180 existing records from primary storage. [2025-10-31T17:11:42.085613] [INFO ] [MAIN ] AMH: Loaded 52180 existing records. [2025-10-31T17:11:42.263731] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:11:42.263931] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-31T17:11:42.263977] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-31T17:11:42.264184] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-31T17:11:42.264224] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-31T17:11:42.620508] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:11:42.657632] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-31T17:11:43.324382] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-31T17:11:43.336756] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-31T17:11:43.336911] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-31T17:11:43.462715] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-31T17:11:43.753558] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-31T17:11:43.753687] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-31T17:11:43.754636] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-31T17:11:43.754990] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-31T17:11:43.757092] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 54548 (keeping 200 days of data) [2025-10-31T17:11:43.907107] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-31T17:11:44.041276] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-31T17:11:44.041828] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-31T17:11:44.151408] [DEBUG] [LOCAL ] AMC: Primary data saved (54548 records). [2025-10-31T17:11:44.182258] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-31T17:11:44.203909] [INFO ] [MAIN ] Update Progress: 99/2365 symbols completed. AMC took 51.8s. Estimated remaining: 4h 26m 59s. Rate: 8.5 symbols/min [2025-10-31T17:11:44.512927] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-31T17:11:44.639799] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-31T17:11:44.639180] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:11:44.664342] [DEBUG] [LOCAL ] AMN: No existing data file found in primary storage. [2025-10-31T17:11:44.669712] [WARN ] [MAIN ] AMN: No existing data found, performing full refresh instead. [2025-10-31T17:11:44.747632] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-31T17:11:44.748359] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-31T17:11:44.748697] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-31T17:11:44.754580] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-31T17:11:44.844160] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-31T17:11:44.961241] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-31T17:11:44.986679] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-31T17:11:44.986577] [INFO ] [REMOTE ] AME: Full fetch complete (70450 records). [2025-10-31T17:11:44.998551] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-31T17:11:44.997553] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-31T17:11:44.999422] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-31T17:11:45.239362] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 54450 (keeping 200 days of data) [2025-10-31T17:11:45.670603] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:11:45.682365] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-31T17:11:45.812809] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-31T17:11:45.813835] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-31T17:11:45.815043] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-31T17:11:45.816874] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-31T17:11:45.836678] [DEBUG] [LOCAL ] AME: Trimmed 70450 records to 49063 (keeping 200 days of data) [2025-10-31T17:11:46.310430] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-31T17:11:46.358309] [DEBUG] [LOCAL ] AMCR: Primary data saved (54450 records). [2025-10-31T17:11:46.360309] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-31T17:11:46.361788] [INFO ] [MAIN ] Update Progress: 100/2365 symbols completed. AMCR took 34.0s. Estimated remaining: 4h 25m 1s. Rate: 8.5 symbols/min [2025-10-31T17:11:46.397085] [DEBUG] [LOCAL ] AME: Primary data saved (49063 records). [2025-10-31T17:11:46.431090] [INFO ] [MAIN ] AME: Full history saved. [2025-10-31T17:11:46.431467] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-31T17:11:46.459228] [INFO ] [MAIN ] Update Progress: 101/2365 symbols completed. AME took 31.5s. Estimated remaining: 4h 22m 19s. Rate: 8.6 symbols/min [2025-10-31T17:11:46.677586] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:11:46.740379] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:11:46.763497] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T17:11:46.771762] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-31T17:11:46.800347] [DEBUG] [LOCAL ] AMP: Loaded 31551 existing records from primary storage. [2025-10-31T17:11:46.800613] [INFO ] [MAIN ] AMP: Loaded 31551 existing records. [2025-10-31T17:11:47.025448] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:11:47.025957] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-31T17:11:47.026148] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-31T17:11:47.026806] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-31T17:11:47.026998] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-31T17:11:47.097678] [DEBUG] [LOCAL ] AMPX: Loaded 52953 existing records from primary storage. [2025-10-31T17:11:47.115048] [INFO ] [MAIN ] AMPX: Loaded 52953 existing records. [2025-10-31T17:11:47.538419] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:11:47.544696] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-31T17:11:47.544792] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-31T17:11:47.555468] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-31T17:11:47.555598] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-31T17:11:47.713103] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:11:47.723964] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-31T17:11:48.021192] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:11:48.047491] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T17:11:48.102302] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-31T17:11:48.257754] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-31T17:11:48.863718] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T17:11:49.057884] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-31T17:11:49.781690] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T17:11:49.857747] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-31T17:11:50.003411] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T17:11:50.657682] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-31T17:11:51.323714] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T17:11:51.457694] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-31T17:11:51.809078] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T17:11:52.257686] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-31T17:11:52.634314] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T17:11:53.057681] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-31T17:11:53.560680] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:11:53.857664] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-31T17:11:54.189016] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-31T17:11:54.657682] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-31T17:11:55.148053] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T17:11:55.457679] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-31T17:11:55.858749] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T17:11:56.257699] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-31T17:11:57.067572] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-31T17:11:57.073326] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-31T17:11:57.473812] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T17:11:57.857739] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-31T17:11:58.145352] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T17:11:58.657698] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-31T17:11:59.255853] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T17:11:59.442975] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-31T17:11:59.457621] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-31T17:12:00.257695] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-31T17:12:00.568555] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T17:12:01.057723] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-31T17:12:01.672586] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T17:12:01.857689] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-31T17:12:02.082976] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T17:12:02.657708] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-31T17:12:03.007920] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-31T17:12:03.457635] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-31T17:12:03.810751] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-31T17:12:04.257693] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-31T17:12:04.729492] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T17:12:05.057676] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-31T17:12:05.674868] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T17:12:05.857694] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-31T17:12:06.248461] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T17:12:06.657666] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-31T17:12:07.092706] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T17:12:07.457683] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-31T17:12:07.852834] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T17:12:08.257669] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-31T17:12:08.641099] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-31T17:12:08.648217] [INFO ] [REMOTE ] AMP: Full fetch complete (47304 records). [2025-10-31T17:12:08.648330] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-31T17:12:08.648963] [FATAL] [VALIDATOR ] AMP: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:12:08.649054] [FATAL] [MAIN ] AMP: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:12:08.649098] [WARN ] [MAIN ] AMP: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:12:08.649140] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-31T17:12:08.649212] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-10-31T17:12:08.649287] [INFO ] [LOCAL ] AMP: Starting deletion of derivative data. [2025-10-31T17:12:08.649410] [DEBUG] [LOCAL ] AMP: Deleted derivative data file. [2025-10-31T17:12:08.649481] [INFO ] [MAIN ] Update Progress: 102/2365 symbols completed. AMP took 22.3s. Estimated remaining: 4h 27m 50s. Rate: 8.4 symbols/min [2025-10-31T17:12:08.818172] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:12:08.868688] [DEBUG] [LOCAL ] AMPY: Loaded 39678 existing records from primary storage. [2025-10-31T17:12:08.868973] [INFO ] [MAIN ] AMPY: Loaded 39678 existing records. [2025-10-31T17:12:09.062628] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:12:09.058453] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-31T17:12:09.063102] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-31T17:12:09.063179] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-31T17:12:09.064077] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-31T17:12:09.064128] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-31T17:12:09.447872] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:12:09.862705] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-31T17:12:09.881522] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-31T17:12:10.657625] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-31T17:12:10.687079] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:12:10.955894] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-31T17:12:10.968069] [INFO ] [REMOTE ] AMH: Full fetch complete (75161 records). [2025-10-31T17:12:10.968205] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-31T17:12:11.350692] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-31T17:12:11.350784] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-31T17:12:11.351486] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-31T17:12:11.351530] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-31T17:12:11.352940] [DEBUG] [LOCAL ] AMH: Trimmed 75161 records to 52570 (keeping 200 days of data) [2025-10-31T17:12:11.470682] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-31T17:12:11.669005] [DEBUG] [LOCAL ] AMH: Primary data saved (52570 records). [2025-10-31T17:12:11.669139] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-31T17:12:11.670275] [INFO ] [MAIN ] Update Progress: 103/2365 symbols completed. AMH took 29.8s. Estimated remaining: 4h 26m 13s. Rate: 8.5 symbols/min [2025-10-31T17:12:11.835973] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:12:11.867774] [DEBUG] [LOCAL ] AMR: Loaded 28476 existing records from primary storage. [2025-10-31T17:12:11.868229] [INFO ] [MAIN ] AMR: Loaded 28476 existing records. [2025-10-31T17:12:12.041970] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:12:12.042195] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-31T17:12:12.042250] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-31T17:12:12.042457] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-31T17:12:12.042514] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-31T17:12:12.260339] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-31T17:12:12.413219] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:12:12.429117] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T17:12:12.465239] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-31T17:12:13.057696] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-31T17:12:13.496817] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T17:12:13.857692] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-31T17:12:14.607433] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T17:12:14.657602] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-31T17:12:14.845602] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-31T17:12:15.457634] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-31T17:12:15.531580] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T17:12:16.257682] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-31T17:12:16.710817] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T17:12:17.057638] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-31T17:12:17.309541] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T17:12:17.857669] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-31T17:12:18.248360] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T17:12:18.657711] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-31T17:12:19.457639] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-31T17:12:19.504058] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-31T17:12:19.736891] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T17:12:20.257681] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-31T17:12:20.736252] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T17:12:20.745540] [INFO ] [REMOTE ] AMN: Full fetch complete (59902 records). [2025-10-31T17:12:20.745722] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-31T17:12:20.746420] [FATAL] [VALIDATOR ] AMN: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:12:20.746506] [FATAL] [MAIN ] AMN: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:12:20.746548] [WARN ] [MAIN ] AMN: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:12:20.746612] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-31T17:12:20.746707] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-31T17:12:20.746756] [INFO ] [LOCAL ] AMN: Starting deletion of derivative data. [2025-10-31T17:12:20.746797] [DEBUG] [LOCAL ] AMN: No derivative data file found to delete. [2025-10-31T17:12:20.746853] [INFO ] [MAIN ] Update Progress: 104/2365 symbols completed. AMN took 36.5s. Estimated remaining: 4h 26m 50s. Rate: 8.5 symbols/min [2025-10-31T17:12:20.917669] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:12:20.964527] [DEBUG] [LOCAL ] AMRC: Loaded 38408 existing records from primary storage. [2025-10-31T17:12:20.964827] [INFO ] [MAIN ] AMRC: Loaded 38408 existing records. [2025-10-31T17:12:21.063183] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-31T17:12:21.151421] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:12:21.151628] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-31T17:12:21.151706] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-31T17:12:21.151888] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-31T17:12:21.151925] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-31T17:12:21.534754] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:12:21.539004] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T17:12:21.857679] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-31T17:12:22.657687] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-31T17:12:22.880607] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T17:12:23.077674] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-31T17:12:23.457742] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-31T17:12:23.590236] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-31T17:12:24.257706] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-31T17:12:24.582122] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T17:12:25.057689] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-31T17:12:25.329360] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T17:12:25.857630] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-31T17:12:26.000368] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T17:12:26.657700] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-31T17:12:27.457716] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-31T17:12:27.777199] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-31T17:12:27.790843] [INFO ] [REMOTE ] AMPX: Full fetch complete (75336 records). [2025-10-31T17:12:27.791079] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-31T17:12:28.090073] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T17:12:28.254068] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-31T17:12:28.254233] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-31T17:12:28.255219] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-31T17:12:28.255309] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-31T17:12:28.257377] [DEBUG] [LOCAL ] AMPX: Trimmed 75336 records to 53343 (keeping 200 days of data) [2025-10-31T17:12:28.257899] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-31T17:12:28.492033] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T17:12:28.612047] [DEBUG] [LOCAL ] AMPX: Primary data saved (53343 records). [2025-10-31T17:12:28.612222] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-31T17:12:28.613791] [INFO ] [MAIN ] Update Progress: 105/2365 symbols completed. AMPX took 42.2s. Estimated remaining: 4h 26m 60s. Rate: 8.5 symbols/min [2025-10-31T17:12:28.779190] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:12:28.779432] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-31T17:12:28.779478] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-31T17:12:28.779551] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-31T17:12:28.779588] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-31T17:12:28.779628] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-31T17:12:28.779698] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-31T17:12:29.062837] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-31T17:12:29.130524] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:12:29.269537] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T17:12:29.857738] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-31T17:12:30.521215] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T17:12:30.531896] [INFO ] [REMOTE ] AMPY: Full fetch complete (53945 records). [2025-10-31T17:12:30.532042] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-31T17:12:30.662850] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-31T17:12:30.892763] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:12:30.916376] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-31T17:12:30.930517] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:12:30.930926] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-31T17:12:30.931098] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-31T17:12:30.931808] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-31T17:12:30.931917] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-31T17:12:30.931037] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-31T17:12:30.932218] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:12:30.932295] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-31T17:12:30.932363] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-31T17:12:30.932693] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-31T17:12:30.932970] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-31T17:12:30.933160] [INFO ] [MAIN ] Update Progress: 106/2365 symbols completed. AMRZ took 2.3s. Estimated remaining: 4h 25m 11s. Rate: 8.5 symbols/min [2025-10-31T17:12:30.945011] [DEBUG] [LOCAL ] AMPY: Trimmed 53945 records to 39929 (keeping 200 days of data) [2025-10-31T17:12:31.298957] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:12:31.332358] [DEBUG] [LOCAL ] AMPY: Primary data saved (39929 records). [2025-10-31T17:12:31.332667] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-31T17:12:31.333707] [INFO ] [MAIN ] Update Progress: 107/2365 symbols completed. AMPY took 22.7s. Estimated remaining: 4h 22m 44s. Rate: 8.6 symbols/min [2025-10-31T17:12:31.461092] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-31T17:12:31.459767] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-31T17:12:31.556962] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:12:31.576034] [DEBUG] [LOCAL ] AMT: Loaded 52800 existing records from primary storage. [2025-10-31T17:12:31.576479] [INFO ] [MAIN ] AMT: Loaded 52800 existing records. [2025-10-31T17:12:31.694526] [DEBUG] [LOCAL ] AMTB: Loaded 20768 existing records from primary storage. [2025-10-31T17:12:31.705580] [INFO ] [MAIN ] AMTB: Loaded 20768 existing records. [2025-10-31T17:12:31.902381] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:12:31.912816] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-31T17:12:31.918040] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-31T17:12:31.949200] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-31T17:12:31.960419] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-31T17:12:32.047493] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:12:32.074424] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-31T17:12:32.084635] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-31T17:12:32.085108] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-31T17:12:32.095633] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-31T17:12:32.271241] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-31T17:12:32.668199] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:12:32.772139] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:12:32.767852] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T17:12:33.057707] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-31T17:12:33.354994] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T17:12:33.857685] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-31T17:12:34.418820] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T17:12:34.657737] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-31T17:12:34.823363] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-31T17:12:35.457679] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-31T17:12:35.864629] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T17:12:36.257735] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-31T17:12:36.371222] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T17:12:37.057692] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-31T17:12:37.352474] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T17:12:37.857632] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-31T17:12:38.052534] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-31T17:12:38.657665] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-31T17:12:39.037492] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T17:12:39.457627] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-31T17:12:39.525024] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T17:12:40.257669] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-31T17:12:40.717031] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T17:12:40.723493] [INFO ] [REMOTE ] AMR: Full fetch complete (40405 records). [2025-10-31T17:12:40.723614] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-31T17:12:41.062715] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-31T17:12:41.105509] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-31T17:12:41.105615] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-31T17:12:41.106231] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-31T17:12:41.106295] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-31T17:12:41.108009] [DEBUG] [LOCAL ] AMR: Trimmed 40405 records to 28626 (keeping 200 days of data) [2025-10-31T17:12:41.276808] [DEBUG] [LOCAL ] AMR: Primary data saved (28626 records). [2025-10-31T17:12:41.276933] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-31T17:12:41.277017] [INFO ] [MAIN ] Update Progress: 108/2365 symbols completed. AMR took 29.6s. Estimated remaining: 4h 23m 39s. Rate: 8.6 symbols/min [2025-10-31T17:12:41.449901] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:12:41.450182] [DEBUG] [LOCAL ] AMTD: No existing data file found in primary storage. [2025-10-31T17:12:41.450284] [WARN ] [MAIN ] AMTD: No existing data found, performing full refresh instead. [2025-10-31T17:12:41.450425] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-31T17:12:41.450490] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-31T17:12:41.450542] [DEBUG] [LOCAL ] AMTD: No primary data file found to delete. [2025-10-31T17:12:41.450576] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-31T17:12:41.821700] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:12:41.851388] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-31T17:12:41.861967] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-31T17:12:42.353568] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T17:12:42.370631] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T17:12:42.657623] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-31T17:12:43.457725] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-31T17:12:44.246952] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T17:12:44.257607] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-31T17:12:44.382837] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-31T17:12:45.057690] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-31T17:12:45.137526] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T17:12:45.857686] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-31T17:12:46.657672] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-31T17:12:46.892969] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T17:12:46.983434] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-31T17:12:47.457617] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-31T17:12:47.484248] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-31T17:12:48.257664] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-31T17:12:48.915902] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-31T17:12:49.005182] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-31T17:12:49.057614] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-31T17:12:49.857630] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-31T17:12:49.943168] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-31T17:12:50.238554] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-31T17:12:50.657752] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-31T17:12:50.984896] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-31T17:12:51.457682] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-31T17:12:52.257638] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-31T17:12:52.681386] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-31T17:12:52.942912] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T17:12:53.057636] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-31T17:12:53.857714] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-31T17:12:54.178925] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-31T17:12:54.525769] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-31T17:12:54.535270] [INFO ] [REMOTE ] AMRC: Full fetch complete (54677 records). [2025-10-31T17:12:54.535378] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-31T17:12:54.662819] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-31T17:12:54.919709] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-31T17:12:54.919795] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-31T17:12:54.920358] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-31T17:12:54.920399] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-31T17:12:54.921567] [DEBUG] [LOCAL ] AMRC: Trimmed 54677 records to 38646 (keeping 200 days of data) [2025-10-31T17:12:55.181868] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T17:12:55.185577] [DEBUG] [LOCAL ] AMRC: Primary data saved (38646 records). [2025-10-31T17:12:55.187742] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-31T17:12:55.187837] [INFO ] [MAIN ] Update Progress: 109/2365 symbols completed. AMRC took 34.4s. Estimated remaining: 4h 25m 54s. Rate: 8.5 symbols/min [2025-10-31T17:12:55.358679] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:12:55.405402] [DEBUG] [LOCAL ] AMTM: Loaded 50389 existing records from primary storage. [2025-10-31T17:12:55.405747] [INFO ] [MAIN ] AMTM: Loaded 50389 existing records. [2025-10-31T17:12:55.467069] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-31T17:12:55.587355] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:12:55.587581] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-31T17:12:55.587629] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-31T17:12:55.587942] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-31T17:12:55.588002] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-31T17:12:55.947837] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:12:56.257682] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-31T17:12:56.636551] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-31T17:12:56.870009] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-31T17:12:57.057716] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-31T17:12:57.857717] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-31T17:12:57.956183] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-31T17:12:58.262279] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-31T17:12:58.657696] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-31T17:12:59.457713] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-31T17:13:00.262757] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-31T17:13:00.275931] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-31T17:13:01.057714] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-31T17:13:01.683573] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-31T17:13:01.743247] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T17:13:01.857709] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-31T17:13:02.657698] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-31T17:13:03.099031] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-31T17:13:03.111188] [INFO ] [REMOTE ] AMT: Full fetch complete (75780 records). [2025-10-31T17:13:03.111354] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-31T17:13:03.112260] [FATAL] [VALIDATOR ] AMT: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:13:03.112373] [FATAL] [MAIN ] AMT: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:13:03.112418] [WARN ] [MAIN ] AMT: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:13:03.112489] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-31T17:13:03.112555] [DEBUG] [LOCAL ] AMT: No primary data file found to delete. [2025-10-31T17:13:03.112597] [INFO ] [LOCAL ] AMT: Starting deletion of derivative data. [2025-10-31T17:13:03.112774] [DEBUG] [LOCAL ] AMT: Deleted derivative data file. [2025-10-31T17:13:03.113343] [INFO ] [MAIN ] Update Progress: 110/2365 symbols completed. AMT took 32.2s. Estimated remaining: 4h 26m 5s. Rate: 8.5 symbols/min [2025-10-31T17:13:03.267340] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-31T17:13:03.302100] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:13:03.314921] [DEBUG] [LOCAL ] AMWL: Loaded 10068 existing records from primary storage. [2025-10-31T17:13:03.315136] [INFO ] [MAIN ] AMWL: Loaded 10068 existing records. [2025-10-31T17:13:03.459676] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-31T17:13:03.499613] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:13:03.500747] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-31T17:13:03.500901] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-31T17:13:03.501191] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-31T17:13:03.501320] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-31T17:13:03.870601] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-10-31T17:13:03.942594] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:13:04.206202] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T17:13:04.257627] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-31T17:13:04.798164] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-31T17:13:05.057637] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-31T17:13:05.699683] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T17:13:05.701604] [INFO ] [REMOTE ] AMTD: Full fetch complete (5681 records). [2025-10-31T17:13:05.701714] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-31T17:13:05.860792] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-31T17:13:06.064880] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-31T17:13:06.064953] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-31T17:13:06.065106] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-31T17:13:06.065144] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-31T17:13:06.065502] [DEBUG] [LOCAL ] AMTD: Trimmed 5681 records to 4228 (keeping 200 days of data) [2025-10-31T17:13:06.088411] [DEBUG] [LOCAL ] AMTD: Primary data saved (4228 records). [2025-10-31T17:13:06.088509] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-31T17:13:06.088570] [INFO ] [MAIN ] Update Progress: 111/2365 symbols completed. AMTD took 24.8s. Estimated remaining: 4h 24m 34s. Rate: 8.5 symbols/min [2025-10-31T17:13:06.260880] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:13:06.302956] [DEBUG] [LOCAL ] AMX: Loaded 49419 existing records from primary storage. [2025-10-31T17:13:06.303233] [INFO ] [MAIN ] AMX: Loaded 49419 existing records. [2025-10-31T17:13:06.478348] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:13:06.478604] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-31T17:13:06.478688] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-31T17:13:06.479077] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-31T17:13:06.479118] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-31T17:13:06.666238] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-31T17:13:06.855713] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:13:07.002157] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:13:07.007594] [INFO ] [REMOTE ] AMTB: Full fetch complete (30041 records). [2025-10-31T17:13:07.007695] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-31T17:13:07.378799] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T17:13:07.395522] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-31T17:13:07.395587] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-31T17:13:07.395949] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-31T17:13:07.396009] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-31T17:13:07.396755] [DEBUG] [LOCAL ] AMTB: Trimmed 30041 records to 20951 (keeping 200 days of data) [2025-10-31T17:13:07.457845] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-31T17:13:07.524468] [DEBUG] [LOCAL ] AMTB: Primary data saved (20951 records). [2025-10-31T17:13:07.524581] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-31T17:13:07.524672] [INFO ] [MAIN ] Update Progress: 112/2365 symbols completed. AMTB took 36.2s. Estimated remaining: 4h 22m 35s. Rate: 8.6 symbols/min [2025-10-31T17:13:07.693152] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:13:07.726740] [DEBUG] [LOCAL ] AN: Loaded 31085 existing records from primary storage. [2025-10-31T17:13:07.726990] [INFO ] [MAIN ] AN: Loaded 31085 existing records. [2025-10-31T17:13:07.903919] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:13:07.904142] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-31T17:13:07.904188] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-31T17:13:07.904461] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-31T17:13:07.904517] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-31T17:13:08.249636] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:13:08.257608] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-31T17:13:08.641073] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T17:13:08.656358] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T17:13:09.057705] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-31T17:13:09.857627] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-31T17:13:10.305909] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T17:13:10.657685] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-31T17:13:11.196006] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T17:13:11.457742] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-31T17:13:11.636039] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T17:13:12.257687] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-31T17:13:12.567190] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:13:12.713806] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T17:13:13.057717] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-31T17:13:13.857704] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-31T17:13:14.434258] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T17:13:14.444410] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T17:13:14.657679] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-31T17:13:15.457697] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-31T17:13:15.971429] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T17:13:16.257696] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-31T17:13:16.975919] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-31T17:13:17.057667] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-31T17:13:17.463696] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T17:13:17.586356] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T17:13:17.857706] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-31T17:13:18.657674] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-31T17:13:18.997578] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T17:13:19.457686] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-31T17:13:20.035293] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T17:13:20.257722] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-31T17:13:20.661398] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T17:13:20.867427] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-31T17:13:21.057694] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-31T17:13:21.857687] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-31T17:13:22.633854] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-31T17:13:22.657681] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-31T17:13:22.994862] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T17:13:23.457695] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-31T17:13:24.204130] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T17:13:24.257689] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-31T17:13:24.626622] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T17:13:25.057709] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-31T17:13:25.857741] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-31T17:13:25.910790] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-31T17:13:26.059257] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T17:13:26.657708] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-31T17:13:27.076874] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T17:13:27.457709] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-31T17:13:27.605052] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T17:13:28.257700] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-31T17:13:28.893448] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T17:13:29.057696] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-31T17:13:29.362339] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-31T17:13:29.826145] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T17:13:29.857702] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-31T17:13:30.392038] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-31T17:13:30.657697] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-31T17:13:31.457633] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-31T17:13:31.545003] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-31T17:13:32.257751] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-31T17:13:32.923431] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T17:13:33.057607] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-31T17:13:33.681087] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T17:13:33.696582] [INFO ] [REMOTE ] AMX: Full fetch complete (71132 records). [2025-10-31T17:13:33.696794] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-31T17:13:33.857684] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-31T17:13:34.098307] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-31T17:13:34.098394] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-31T17:13:34.099116] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-31T17:13:34.099189] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-31T17:13:34.100588] [DEBUG] [LOCAL ] AMX: Trimmed 71132 records to 49781 (keeping 200 days of data) [2025-10-31T17:13:34.395562] [DEBUG] [LOCAL ] AMX: Primary data saved (49781 records). [2025-10-31T17:13:34.395748] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-31T17:13:34.395871] [INFO ] [MAIN ] Update Progress: 113/2365 symbols completed. AMX took 28.3s. Estimated remaining: 4h 29m 4s. Rate: 8.4 symbols/min [2025-10-31T17:13:34.568759] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:13:34.631746] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T17:13:34.650266] [INFO ] [REMOTE ] AMTM: Full fetch complete (73321 records). [2025-10-31T17:13:34.650612] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-31T17:13:34.668397] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-31T17:13:34.917412] [DEBUG] [LOCAL ] ANET: Loaded 54154 existing records from primary storage. [2025-10-31T17:13:34.955848] [INFO ] [MAIN ] ANET: Loaded 54154 existing records. [2025-10-31T17:13:35.307707] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T17:13:35.363188] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:13:35.372026] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-31T17:13:35.373344] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-31T17:13:35.373557] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-31T17:13:35.373747] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-31T17:13:35.374772] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-31T17:13:35.375133] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-31T17:13:35.376089] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-31T17:13:35.376223] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-31T17:13:35.463776] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-31T17:13:35.480292] [DEBUG] [LOCAL ] AMTM: Trimmed 73321 records to 50734 (keeping 200 days of data) [2025-10-31T17:13:35.970782] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T17:13:36.032883] [INFO ] [REMOTE ] AMWL: Full fetch complete (14885 records). [2025-10-31T17:13:36.057007] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:13:36.050874] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-31T17:13:36.313067] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-31T17:13:36.522952] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-31T17:13:36.523438] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-31T17:13:36.523779] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-31T17:13:36.524188] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-31T17:13:36.527489] [DEBUG] [LOCAL ] AMWL: Trimmed 14885 records to 10163 (keeping 200 days of data) [2025-10-31T17:13:36.562624] [DEBUG] [LOCAL ] AMTM: Primary data saved (50734 records). [2025-10-31T17:13:36.578099] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-31T17:13:36.581276] [INFO ] [MAIN ] Update Progress: 114/2365 symbols completed. AMTM took 41.4s. Estimated remaining: 4h 27m 18s. Rate: 8.4 symbols/min [2025-10-31T17:13:36.696846] [DEBUG] [LOCAL ] AMWL: Primary data saved (10163 records). [2025-10-31T17:13:36.700575] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-31T17:13:36.706285] [INFO ] [MAIN ] Update Progress: 115/2365 symbols completed. AMWL took 33.6s. Estimated remaining: 4h 24m 54s. Rate: 8.5 symbols/min [2025-10-31T17:13:36.874200] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:13:36.944822] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:13:36.945269] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-31T17:13:36.945376] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-31T17:13:36.945544] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-31T17:13:36.945608] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-31T17:13:36.945700] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-31T17:13:36.945765] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-31T17:13:37.135662] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-31T17:13:37.228768] [INFO ] [REMOTE ] AN: Full fetch complete (47133 records). [2025-10-31T17:13:37.273376] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-31T17:13:37.285840] [DEBUG] [LOCAL ] ANF: Loaded 52347 existing records from primary storage. [2025-10-31T17:13:37.302349] [INFO ] [MAIN ] ANF: Loaded 52347 existing records. [2025-10-31T17:13:37.601050] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:13:37.643007] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-31T17:13:37.832307] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:13:37.886117] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-31T17:13:37.893250] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-31T17:13:37.907396] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-31T17:13:37.907478] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-31T17:13:37.996126] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:13:38.031020] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-31T17:13:38.031267] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:13:38.049097] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-31T17:13:38.080843] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:13:38.091473] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-31T17:13:38.106304] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-31T17:13:38.106456] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-31T17:13:38.132690] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-31T17:13:38.132862] [INFO ] [MAIN ] Update Progress: 116/2365 symbols completed. ANGX took 1.4s. Estimated remaining: 4h 22m 58s. Rate: 8.6 symbols/min [2025-10-31T17:13:38.357072] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-31T17:13:38.419104] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-31T17:13:38.446498] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-31T17:13:38.507341] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-31T17:13:38.553152] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:13:38.558807] [DEBUG] [LOCAL ] AN: Trimmed 47133 records to 31287 (keeping 200 days of data) [2025-10-31T17:13:38.717584] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:13:38.735228] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-31T17:13:38.756045] [DEBUG] [LOCAL ] ANRO: Loaded 20216 existing records from primary storage. [2025-10-31T17:13:38.789305] [INFO ] [MAIN ] ANRO: Loaded 20216 existing records. [2025-10-31T17:13:38.897322] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-31T17:13:38.973424] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-31T17:13:38.981609] [DEBUG] [LOCAL ] AN: Primary data saved (31287 records). [2025-10-31T17:13:38.985823] [INFO ] [MAIN ] AN: Full history saved. [2025-10-31T17:13:38.987885] [INFO ] [MAIN ] Update Progress: 117/2365 symbols completed. AN took 31.5s. Estimated remaining: 4h 20m 52s. Rate: 8.6 symbols/min [2025-10-31T17:13:39.065737] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:13:39.065945] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-31T17:13:39.065993] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-31T17:13:39.066161] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-31T17:13:39.066200] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-31T17:13:39.410722] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:13:39.457677] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-31T17:13:40.110970] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-31T17:13:40.257706] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-31T17:13:40.323519] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T17:13:40.945889] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-31T17:13:41.057741] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-31T17:13:41.696609] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-31T17:13:41.857710] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-31T17:13:42.657680] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-31T17:13:42.867759] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-31T17:13:43.237542] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-31T17:13:43.286334] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T17:13:43.457686] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-31T17:13:44.257671] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-31T17:13:44.919407] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T17:13:45.057699] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-31T17:13:45.857712] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-31T17:13:45.913817] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-31T17:13:46.582076] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T17:13:46.657626] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-31T17:13:46.829102] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T17:13:47.457780] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-31T17:13:48.200770] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-31T17:13:48.257633] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-31T17:13:49.057639] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-31T17:13:49.290399] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-31T17:13:49.602106] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T17:13:49.707573] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T17:13:49.857694] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-31T17:13:50.622821] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-31T17:13:50.657693] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-31T17:13:51.457697] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-31T17:13:52.253905] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T17:13:52.259437] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-31T17:13:52.438814] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-31T17:13:53.057745] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-31T17:13:53.629576] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T17:13:53.705354] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-31T17:13:53.857686] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-31T17:13:54.515418] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T17:13:54.657710] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-31T17:13:55.457686] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-31T17:13:56.162320] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-31T17:13:56.161021] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T17:13:56.257623] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-31T17:13:57.057630] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-31T17:13:57.857737] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-31T17:13:57.985038] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-31T17:13:57.997226] [INFO ] [REMOTE ] ANF: Full fetch complete (75751 records). [2025-10-31T17:13:57.997412] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-31T17:13:58.393734] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-31T17:13:58.393817] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-31T17:13:58.394508] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-31T17:13:58.394550] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-31T17:13:58.395978] [DEBUG] [LOCAL ] ANF: Trimmed 75751 records to 52712 (keeping 200 days of data) [2025-10-31T17:13:58.699067] [DEBUG] [LOCAL ] ANF: Primary data saved (52712 records). [2025-10-31T17:13:58.699337] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-31T17:13:58.699479] [INFO ] [MAIN ] Update Progress: 118/2365 symbols completed. ANF took 22.1s. Estimated remaining: 4h 24m 48s. Rate: 8.5 symbols/min [2025-10-31T17:13:58.915357] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-31T17:13:58.927063] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-31T17:13:59.460265] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T17:13:59.468383] [INFO ] [REMOTE ] ANRO: Full fetch complete (30982 records). [2025-10-31T17:13:59.468561] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-31T17:13:59.469251] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:13:59.469344] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:13:59.469390] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:13:59.469431] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-31T17:13:59.469497] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-31T17:13:59.469538] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-10-31T17:13:59.469820] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-10-31T17:13:59.469935] [INFO ] [MAIN ] Update Progress: 119/2365 symbols completed. ANRO took 21.3s. Estimated remaining: 4h 22m 42s. Rate: 8.5 symbols/min [2025-10-31T17:14:00.997810] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-31T17:14:01.009509] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-31T17:14:02.931781] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-31T17:14:02.942982] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-31T17:14:05.326460] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-31T17:14:05.339232] [INFO ] [REMOTE ] ANET: Full fetch complete (77553 records). [2025-10-31T17:14:05.339412] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-31T17:14:05.340199] [FATAL] [VALIDATOR ] ANET: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:14:05.340289] [FATAL] [MAIN ] ANET: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:14:05.340362] [WARN ] [MAIN ] ANET: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:14:05.340458] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-31T17:14:05.340526] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-10-31T17:14:05.340562] [INFO ] [LOCAL ] ANET: Starting deletion of derivative data. [2025-10-31T17:14:05.340706] [DEBUG] [LOCAL ] ANET: Deleted derivative data file. [2025-10-31T17:14:05.340804] [INFO ] [MAIN ] Update Progress: 120/2365 symbols completed. ANET took 30.9s. Estimated remaining: 4h 22m 14s. Rate: 8.6 symbols/min [2025-10-31T17:14:05.953466] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:06.045950] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:06.048306] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-10-31T17:14:06.050472] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:06.048241] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-31T17:14:06.064506] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-31T17:14:06.050706] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-10-31T17:14:06.069575] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-31T17:14:06.070949] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-31T17:14:06.071180] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-31T17:14:06.069622] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-31T17:14:06.071280] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-31T17:14:06.070847] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:06.071383] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-31T17:14:06.083412] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-31T17:14:06.092602] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-31T17:14:06.304024] [DEBUG] [LOCAL ] AOD: Loaded 30603 existing records from primary storage. [2025-10-31T17:14:06.332757] [INFO ] [MAIN ] AOD: Loaded 30603 existing records. [2025-10-31T17:14:06.355123] [DEBUG] [LOCAL ] ANVS: Loaded 24308 existing records from primary storage. [2025-10-31T17:14:06.433545] [INFO ] [MAIN ] ANVS: Loaded 24308 existing records. [2025-10-31T17:14:07.118056] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:14:07.107852] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:14:07.161456] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-31T17:14:07.168405] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-31T17:14:07.188708] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:07.188895] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-31T17:14:07.189345] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-31T17:14:07.194963] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-31T17:14:07.188815] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-31T17:14:07.198855] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-31T17:14:07.233230] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:07.222256] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-31T17:14:07.240474] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-31T17:14:07.240595] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-31T17:14:07.369859] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:14:07.429625] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-31T17:14:07.479970] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:14:07.557867] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-31T17:14:07.582522] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:14:07.641107] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-31T17:14:07.659038] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-31T17:14:07.713242] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-31T17:14:07.768401] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-31T17:14:07.791877] [INFO ] [MAIN ] Update Progress: 121/2365 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 20m 42s. Rate: 8.6 symbols/min [2025-10-31T17:14:08.098122] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:08.128850] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:08.135600] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-31T17:14:08.138859] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-31T17:14:08.153513] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T17:14:08.186847] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-31T17:14:08.220402] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:08.258441] [DEBUG] [LOCAL ] AON: Loaded 45185 existing records from primary storage. [2025-10-31T17:14:08.258755] [INFO ] [MAIN ] AON: Loaded 45185 existing records. [2025-10-31T17:14:08.429042] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:14:08.429242] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-31T17:14:08.429289] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-31T17:14:08.429489] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-31T17:14:08.429528] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-31T17:14:08.775630] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:08.775935] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-31T17:14:08.928512] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T17:14:08.932687] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-31T17:14:09.033485] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T17:14:09.039824] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-31T17:14:09.086771] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T17:14:09.093851] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-31T17:14:09.629078] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T17:14:09.633266] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-31T17:14:09.921980] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T17:14:09.929482] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-31T17:14:10.011145] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T17:14:10.016970] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-31T17:14:10.055231] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T17:14:10.263774] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-31T17:14:10.552420] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T17:14:10.657618] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-31T17:14:10.984530] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T17:14:11.303122] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-31T17:14:11.457613] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-31T17:14:12.257690] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-31T17:14:12.429542] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T17:14:13.064318] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-31T17:14:13.066151] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T17:14:13.718173] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T17:14:13.857740] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-31T17:14:14.657695] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-31T17:14:14.718472] [DEBUG] [REMOTE ] ANVS: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-31T17:14:14.718835] [WARN ] [REMOTE ] ANVS: No data returned for month 2025-05 [2025-10-31T17:14:14.718961] [FATAL] [REMOTE ] ANVS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:14:14.719034] [FATAL] [MAIN ] ANVS: Failed to fetch primary data. [2025-10-31T17:14:14.719095] [WARN ] [MAIN ] ANVS: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:14:14.719140] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-31T17:14:14.719189] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-31T17:14:14.719223] [INFO ] [LOCAL ] ANVS: Starting deletion of derivative data. [2025-10-31T17:14:14.719338] [DEBUG] [LOCAL ] ANVS: Deleted derivative data file. [2025-10-31T17:14:14.719397] [INFO ] [MAIN ] Update Progress: 122/2365 symbols completed. ANVS took 9.4s. Estimated remaining: 4h 20m 34s. Rate: 8.6 symbols/min [2025-10-31T17:14:14.903025] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T17:14:14.905804] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:14.905979] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-31T17:14:14.912061] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-31T17:14:14.912483] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-31T17:14:14.912527] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-31T17:14:14.912569] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-31T17:14:14.912607] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-31T17:14:15.259712] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:15.457675] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-31T17:14:16.257666] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-31T17:14:16.456996] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T17:14:16.803052] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-31T17:14:17.057689] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-31T17:14:17.857624] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-31T17:14:18.017776] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T17:14:18.657711] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-31T17:14:18.798822] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T17:14:19.457671] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-31T17:14:19.595855] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-31T17:14:20.257614] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-31T17:14:20.459557] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-31T17:14:21.016958] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-31T17:14:21.057679] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-31T17:14:21.856886] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T17:14:21.860587] [INFO ] [REMOTE ] AOMR: Full fetch complete (23220 records). [2025-10-31T17:14:21.859990] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-31T17:14:21.860759] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-31T17:14:22.231516] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-31T17:14:22.231593] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-31T17:14:22.231932] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-31T17:14:22.231995] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-31T17:14:22.232617] [DEBUG] [LOCAL ] AOMR: Trimmed 23220 records to 16135 (keeping 200 days of data) [2025-10-31T17:14:22.325142] [DEBUG] [LOCAL ] AOMR: Primary data saved (16135 records). [2025-10-31T17:14:22.325272] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-31T17:14:22.325342] [INFO ] [MAIN ] Update Progress: 123/2365 symbols completed. AOMR took 17.0s. Estimated remaining: 4h 20m 39s. Rate: 8.6 symbols/min [2025-10-31T17:14:22.493919] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:22.494097] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-10-31T17:14:22.494133] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-10-31T17:14:22.494237] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-31T17:14:22.494277] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-31T17:14:22.494317] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-31T17:14:22.494348] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-31T17:14:22.667522] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-31T17:14:22.854569] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:22.990744] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T17:14:23.457731] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-31T17:14:24.172758] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-31T17:14:24.257617] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-31T17:14:24.430572] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T17:14:25.057675] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-31T17:14:25.783099] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-31T17:14:25.857694] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-31T17:14:26.125922] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T17:14:26.134004] [INFO ] [REMOTE ] AOD: Full fetch complete (44431 records). [2025-10-31T17:14:26.134121] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-31T17:14:26.555425] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-31T17:14:26.555504] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-31T17:14:26.556073] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-31T17:14:26.556137] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-31T17:14:26.557134] [DEBUG] [LOCAL ] AOD: Trimmed 44431 records to 30795 (keeping 200 days of data) [2025-10-31T17:14:26.657680] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-31T17:14:26.750313] [DEBUG] [LOCAL ] AOD: Primary data saved (30795 records). [2025-10-31T17:14:26.750446] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-31T17:14:26.750526] [INFO ] [MAIN ] Update Progress: 124/2365 symbols completed. AOD took 21.4s. Estimated remaining: 4h 19m 46s. Rate: 8.6 symbols/min [2025-10-31T17:14:26.917879] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:26.918167] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-10-31T17:14:26.918291] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-10-31T17:14:26.918407] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-31T17:14:26.918450] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-31T17:14:26.918492] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-31T17:14:26.918525] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-31T17:14:27.286396] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:27.314683] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T17:14:27.457612] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-31T17:14:27.765898] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-31T17:14:28.257695] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-31T17:14:28.669733] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T17:14:29.057686] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-31T17:14:29.180858] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T17:14:29.682559] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T17:14:29.857635] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-31T17:14:30.657637] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-31T17:14:30.778484] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-31T17:14:31.457708] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-31T17:14:32.006299] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T17:14:32.257615] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-31T17:14:32.305206] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-31T17:14:33.057629] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-31T17:14:33.417567] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T17:14:33.857684] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-31T17:14:34.174978] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T17:14:34.182488] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:14:34.657750] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-31T17:14:34.982441] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-31T17:14:35.457671] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-31T17:14:36.257691] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-31T17:14:37.057684] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-31T17:14:37.127289] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-31T17:14:37.172582] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T17:14:37.857717] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-31T17:14:38.562034] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-31T17:14:38.657733] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-31T17:14:38.976330] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T17:14:39.457778] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-31T17:14:39.824248] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T17:14:40.257688] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-31T17:14:40.662264] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T17:14:41.057729] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-31T17:14:41.586339] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:14:41.857625] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-31T17:14:41.999861] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T17:14:42.364329] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-31T17:14:42.657713] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-31T17:14:43.159410] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-31T17:14:43.457621] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-31T17:14:44.257712] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-31T17:14:44.639245] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T17:14:45.057685] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-31T17:14:45.582025] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:14:45.857687] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-31T17:14:46.150818] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T17:14:46.259850] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-31T17:14:46.657688] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-31T17:14:47.457711] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-31T17:14:48.257628] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-31T17:14:48.319341] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-31T17:14:48.329357] [INFO ] [REMOTE ] AON: Full fetch complete (65411 records). [2025-10-31T17:14:48.329490] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-31T17:14:48.760618] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-31T17:14:48.760983] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-31T17:14:48.761749] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-31T17:14:48.761836] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-31T17:14:48.800532] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T17:14:48.808602] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T17:14:48.801345] [DEBUG] [LOCAL ] AON: Trimmed 65411 records to 45556 (keeping 200 days of data) [2025-10-31T17:14:49.062946] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-31T17:14:49.098521] [DEBUG] [LOCAL ] AON: Primary data saved (45556 records). [2025-10-31T17:14:49.098698] [INFO ] [MAIN ] AON: Full history saved. [2025-10-31T17:14:49.098817] [INFO ] [MAIN ] Update Progress: 125/2365 symbols completed. AON took 41.3s. Estimated remaining: 4h 24m 15s. Rate: 8.5 symbols/min [2025-10-31T17:14:49.263469] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:49.297881] [DEBUG] [LOCAL ] APAM: Loaded 35513 existing records from primary storage. [2025-10-31T17:14:49.298167] [INFO ] [MAIN ] APAM: Loaded 35513 existing records. [2025-10-31T17:14:49.471002] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:14:49.471221] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-31T17:14:49.471289] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-31T17:14:49.471931] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-31T17:14:49.472001] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-31T17:14:49.835691] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:49.857612] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-31T17:14:50.292602] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T17:14:50.657676] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-31T17:14:50.973398] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T17:14:51.104373] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-31T17:14:51.457701] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-31T17:14:51.985210] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-31T17:14:52.257683] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-31T17:14:53.057676] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-31T17:14:53.847384] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T17:14:53.860400] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-31T17:14:53.862538] [INFO ] [REMOTE ] AOS: Full fetch complete (71097 records). [2025-10-31T17:14:53.862684] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-31T17:14:54.209558] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T17:14:54.299111] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-31T17:14:54.299203] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-31T17:14:54.299934] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-31T17:14:54.299996] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-31T17:14:54.301289] [DEBUG] [LOCAL ] AOS: Trimmed 71097 records to 49272 (keeping 200 days of data) [2025-10-31T17:14:54.577274] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T17:14:54.589745] [INFO ] [REMOTE ] AP: Full fetch complete (9279 records). [2025-10-31T17:14:54.591079] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-31T17:14:54.626528] [DEBUG] [LOCAL ] AOS: Primary data saved (49272 records). [2025-10-31T17:14:54.663946] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-31T17:14:54.663866] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-31T17:14:54.679626] [INFO ] [MAIN ] Update Progress: 126/2365 symbols completed. AOS took 32.4s. Estimated remaining: 4h 23m 41s. Rate: 8.5 symbols/min [2025-10-31T17:14:55.047787] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:55.129157] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-31T17:14:55.129233] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-31T17:14:55.129393] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-31T17:14:55.129429] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-31T17:14:55.129870] [DEBUG] [LOCAL ] AP: Trimmed 9279 records to 7602 (keeping 200 days of data) [2025-10-31T17:14:55.181916] [DEBUG] [LOCAL ] AP: Primary data saved (7602 records). [2025-10-31T17:14:55.182102] [INFO ] [MAIN ] AP: Full history saved. [2025-10-31T17:14:55.182181] [INFO ] [MAIN ] Update Progress: 127/2365 symbols completed. AP took 28.4s. Estimated remaining: 4h 21m 39s. Rate: 8.6 symbols/min [2025-10-31T17:14:55.297610] [DEBUG] [LOCAL ] APD: Loaded 45618 existing records from primary storage. [2025-10-31T17:14:55.308740] [INFO ] [MAIN ] APD: Loaded 45618 existing records. [2025-10-31T17:14:55.466271] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:55.463528] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-31T17:14:55.550152] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:14:55.550367] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-31T17:14:55.550501] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-31T17:14:55.550793] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-31T17:14:55.550848] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-31T17:14:55.840611] [DEBUG] [LOCAL ] APG: Loaded 50991 existing records from primary storage. [2025-10-31T17:14:55.846243] [INFO ] [MAIN ] APG: Loaded 50991 existing records. [2025-10-31T17:14:56.078222] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:56.152913] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:14:56.169207] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-31T17:14:56.169343] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-31T17:14:56.170700] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-31T17:14:56.170609] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-31T17:14:56.170850] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-31T17:14:56.208687] [INFO ] [REMOTE ] AORT: Full fetch complete (42514 records). [2025-10-31T17:14:56.240269] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-31T17:14:56.287105] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-31T17:14:56.966866] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:57.022030] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-31T17:14:57.022335] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-31T17:14:57.022922] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-31T17:14:57.023095] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-31T17:14:57.047002] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T17:14:57.045979] [DEBUG] [LOCAL ] AORT: Trimmed 42514 records to 28994 (keeping 200 days of data) [2025-10-31T17:14:57.057610] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-31T17:14:57.221915] [DEBUG] [LOCAL ] AORT: Primary data saved (28994 records). [2025-10-31T17:14:57.222083] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-31T17:14:57.222159] [INFO ] [MAIN ] Update Progress: 128/2365 symbols completed. AORT took 42.5s. Estimated remaining: 4h 20m 5s. Rate: 8.6 symbols/min [2025-10-31T17:14:57.385795] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:14:57.385936] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-31T17:14:57.385973] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-31T17:14:57.386080] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-31T17:14:57.386120] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-31T17:14:57.386161] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-31T17:14:57.386192] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-31T17:14:57.734353] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:14:57.814126] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-31T17:14:57.857619] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-31T17:14:58.188380] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T17:14:58.657637] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-31T17:14:59.288266] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T17:14:59.457681] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-31T17:14:59.796509] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T17:15:00.257721] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-31T17:15:00.787083] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-31T17:15:01.057662] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-31T17:15:01.788488] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-31T17:15:01.857689] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-31T17:15:02.657664] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-31T17:15:02.804266] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-31T17:15:03.222013] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T17:15:03.457711] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-31T17:15:04.035766] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T17:15:04.257686] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-31T17:15:04.888865] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T17:15:05.057724] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-31T17:15:05.857631] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-31T17:15:05.905285] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-31T17:15:06.555699] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T17:15:06.657689] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-31T17:15:07.008853] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-31T17:15:07.457704] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-31T17:15:07.992558] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:15:08.257681] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-31T17:15:08.615167] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T17:15:09.057667] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-31T17:15:09.857687] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-31T17:15:09.992278] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-31T17:15:10.423560] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T17:15:10.657674] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-31T17:15:11.140354] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T17:15:11.457671] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-31T17:15:12.123584] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T17:15:12.257639] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-31T17:15:12.505760] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T17:15:13.057640] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-31T17:15:13.589267] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T17:15:13.857669] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-31T17:15:14.069357] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T17:15:14.657739] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-31T17:15:15.117705] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T17:15:15.457679] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-31T17:15:15.678887] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T17:15:16.257683] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-31T17:15:17.051592] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T17:15:17.062755] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-31T17:15:17.065175] [INFO ] [REMOTE ] APD: Full fetch complete (67180 records). [2025-10-31T17:15:17.065379] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-31T17:15:17.482620] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-31T17:15:17.482758] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-31T17:15:17.483423] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-31T17:15:17.483504] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-31T17:15:17.484935] [DEBUG] [LOCAL ] APD: Trimmed 67180 records to 45984 (keeping 200 days of data) [2025-10-31T17:15:17.786707] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T17:15:17.823321] [DEBUG] [LOCAL ] APD: Primary data saved (45984 records). [2025-10-31T17:15:17.823909] [INFO ] [MAIN ] APD: Full history saved. [2025-10-31T17:15:17.824014] [INFO ] [MAIN ] Update Progress: 129/2365 symbols completed. APD took 23.1s. Estimated remaining: 4h 23m 54s. Rate: 8.5 symbols/min [2025-10-31T17:15:17.862808] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-31T17:15:17.997568] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:15:18.047689] [DEBUG] [LOCAL ] APLE: Loaded 52271 existing records from primary storage. [2025-10-31T17:15:18.048039] [INFO ] [MAIN ] APLE: Loaded 52271 existing records. [2025-10-31T17:15:18.224028] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:15:18.224230] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-31T17:15:18.224296] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-31T17:15:18.224733] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-31T17:15:18.224791] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-31T17:15:18.589619] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:15:18.617089] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-31T17:15:18.657635] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-31T17:15:18.901434] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T17:15:19.457675] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-31T17:15:19.985779] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T17:15:20.257727] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-31T17:15:20.495578] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T17:15:20.503561] [INFO ] [REMOTE ] APAM: Full fetch complete (51978 records). [2025-10-31T17:15:20.503750] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-31T17:15:20.921071] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-31T17:15:20.921179] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-31T17:15:20.921750] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-31T17:15:20.921812] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-31T17:15:20.923013] [DEBUG] [LOCAL ] APAM: Trimmed 51978 records to 35757 (keeping 200 days of data) [2025-10-31T17:15:21.076311] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-31T17:15:21.129919] [DEBUG] [LOCAL ] APAM: Primary data saved (35757 records). [2025-10-31T17:15:21.130046] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-31T17:15:21.130120] [INFO ] [MAIN ] Update Progress: 130/2365 symbols completed. APAM took 32.0s. Estimated remaining: 4h 22m 42s. Rate: 8.5 symbols/min [2025-10-31T17:15:21.298817] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:15:21.331389] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T17:15:21.391386] [DEBUG] [LOCAL ] APO: Loaded 53756 existing records from primary storage. [2025-10-31T17:15:21.391709] [INFO ] [MAIN ] APO: Loaded 53756 existing records. [2025-10-31T17:15:21.563221] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:15:21.563412] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-31T17:15:21.563458] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-31T17:15:21.563906] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-31T17:15:21.563961] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-31T17:15:21.862760] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-31T17:15:21.914029] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:15:22.657702] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-31T17:15:22.861576] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-31T17:15:23.199255] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T17:15:23.457674] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-31T17:15:24.005066] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T17:15:24.257684] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-31T17:15:25.009702] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T17:15:25.057745] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-31T17:15:25.738147] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T17:15:25.857751] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-31T17:15:26.342523] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T17:15:26.657722] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-31T17:15:27.199881] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T17:15:27.211922] [INFO ] [REMOTE ] APG: Full fetch complete (71973 records). [2025-10-31T17:15:27.212127] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-31T17:15:27.213968] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:15:27.214183] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:15:27.214253] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:15:27.214338] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-31T17:15:27.214425] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-31T17:15:27.214496] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-10-31T17:15:27.214703] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-10-31T17:15:27.214815] [INFO ] [MAIN ] Update Progress: 131/2365 symbols completed. APG took 32.0s. Estimated remaining: 4h 22m 18s. Rate: 8.5 symbols/min [2025-10-31T17:15:27.388745] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:15:27.398304] [DEBUG] [LOCAL ] APOS: Loaded 6849 existing records from primary storage. [2025-10-31T17:15:27.398487] [INFO ] [MAIN ] APOS: Loaded 6849 existing records. [2025-10-31T17:15:27.467751] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-31T17:15:27.590438] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:15:27.590720] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-31T17:15:27.590776] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-31T17:15:27.590991] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-31T17:15:27.591047] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-31T17:15:27.950982] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:15:28.257623] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-31T17:15:28.328371] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-31T17:15:28.735495] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-31T17:15:28.916949] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-31T17:15:29.057664] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-31T17:15:29.857714] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-31T17:15:30.539317] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-31T17:15:30.657681] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-31T17:15:31.457672] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-31T17:15:31.498141] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-31T17:15:32.081027] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T17:15:32.257675] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-31T17:15:32.743028] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-31T17:15:32.956101] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-31T17:15:33.057666] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-31T17:15:33.737067] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T17:15:33.749331] [INFO ] [REMOTE ] APH: Full fetch complete (77871 records). [2025-10-31T17:15:33.749483] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-31T17:15:33.862766] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-31T17:15:34.147386] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-31T17:15:34.147470] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-31T17:15:34.148257] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-31T17:15:34.148329] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-31T17:15:34.149816] [DEBUG] [LOCAL ] APH: Trimmed 77871 records to 54471 (keeping 200 days of data) [2025-10-31T17:15:34.478753] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-10-31T17:15:34.478879] [INFO ] [MAIN ] APH: Full history saved. [2025-10-31T17:15:34.478947] [INFO ] [MAIN ] Update Progress: 132/2365 symbols completed. APH took 37.3s. Estimated remaining: 4h 22m 15s. Rate: 8.5 symbols/min [2025-10-31T17:15:34.646781] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:15:34.657633] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-31T17:15:34.699551] [DEBUG] [LOCAL ] APTV: Loaded 52090 existing records from primary storage. [2025-10-31T17:15:34.699915] [INFO ] [MAIN ] APTV: Loaded 52090 existing records. [2025-10-31T17:15:34.877188] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:15:34.877434] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-31T17:15:34.877481] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-31T17:15:34.877855] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-31T17:15:34.877911] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-31T17:15:35.227044] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:15:35.457715] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-31T17:15:35.673212] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-31T17:15:36.054201] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-31T17:15:36.103527] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T17:15:36.257677] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-31T17:15:37.057739] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-31T17:15:37.710811] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T17:15:37.709071] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T17:15:37.857681] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-31T17:15:38.657723] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-31T17:15:39.159897] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-31T17:15:39.378302] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-31T17:15:39.457668] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-31T17:15:40.257758] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-31T17:15:40.807360] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-31T17:15:40.894273] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T17:15:41.057670] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-31T17:15:41.483263] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T17:15:41.857738] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-31T17:15:42.657675] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-31T17:15:43.171593] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T17:15:43.457679] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-31T17:15:44.058730] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T17:15:44.257682] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-31T17:15:44.789313] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T17:15:45.057663] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-31T17:15:45.369495] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:15:45.455105] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-31T17:15:45.857680] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-31T17:15:46.360294] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-31T17:15:46.657683] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-31T17:15:47.457685] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-31T17:15:47.976683] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-31T17:15:47.978411] [INFO ] [REMOTE ] APOS: Full fetch complete (10138 records). [2025-10-31T17:15:47.978478] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-31T17:15:47.978866] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:15:47.978942] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:15:47.978984] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:15:47.979048] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-31T17:15:47.979107] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-31T17:15:47.979141] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-31T17:15:47.979313] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-10-31T17:15:47.979397] [INFO ] [MAIN ] Update Progress: 133/2365 symbols completed. APOS took 20.8s. Estimated remaining: 4h 23m 56s. Rate: 8.5 symbols/min [2025-10-31T17:15:48.158388] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:15:48.190230] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-31T17:15:48.242759] [DEBUG] [LOCAL ] AQN: Loaded 51912 existing records from primary storage. [2025-10-31T17:15:48.243061] [INFO ] [MAIN ] AQN: Loaded 51912 existing records. [2025-10-31T17:15:48.262805] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-31T17:15:48.452143] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:15:48.452336] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-31T17:15:48.452381] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-31T17:15:48.452724] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-31T17:15:48.452779] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-31T17:15:48.836751] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:15:49.057678] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-31T17:15:49.857676] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-31T17:15:49.958192] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-31T17:15:50.256620] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T17:15:50.657756] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-31T17:15:51.132994] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T17:15:51.457716] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-31T17:15:52.130843] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-31T17:15:52.142600] [INFO ] [REMOTE ] APLE: Full fetch complete (74817 records). [2025-10-31T17:15:52.142757] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-31T17:15:52.262721] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-31T17:15:52.542977] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-31T17:15:52.543192] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-31T17:15:52.544143] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-31T17:15:52.544271] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-31T17:15:52.546328] [DEBUG] [LOCAL ] APLE: Trimmed 74817 records to 52657 (keeping 200 days of data) [2025-10-31T17:15:52.811545] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T17:15:52.918257] [DEBUG] [LOCAL ] APLE: Primary data saved (52657 records). [2025-10-31T17:15:52.918402] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-31T17:15:52.918480] [INFO ] [MAIN ] Update Progress: 134/2365 symbols completed. APLE took 35.1s. Estimated remaining: 4h 23m 13s. Rate: 8.5 symbols/min [2025-10-31T17:15:53.062807] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-31T17:15:53.087999] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:15:53.094289] [DEBUG] [LOCAL ] AQNB: Loaded 3688 existing records from primary storage. [2025-10-31T17:15:53.094478] [INFO ] [MAIN ] AQNB: Loaded 3688 existing records. [2025-10-31T17:15:53.273114] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:15:53.273349] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-31T17:15:53.273395] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-31T17:15:53.273529] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-31T17:15:53.273566] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-31T17:15:53.623454] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:15:53.857686] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-31T17:15:54.028744] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-31T17:15:54.043299] [INFO ] [REMOTE ] APO: Full fetch complete (77451 records). [2025-10-31T17:15:54.043525] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-31T17:15:54.485880] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-31T17:15:54.486007] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-31T17:15:54.486869] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-31T17:15:54.486965] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-31T17:15:54.488945] [DEBUG] [LOCAL ] APO: Trimmed 77451 records to 54146 (keeping 200 days of data) [2025-10-31T17:15:54.609947] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T17:15:54.706874] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-31T17:15:54.868442] [DEBUG] [LOCAL ] APO: Primary data saved (54146 records). [2025-10-31T17:15:54.868595] [INFO ] [MAIN ] APO: Full history saved. [2025-10-31T17:15:54.869858] [INFO ] [MAIN ] Update Progress: 135/2365 symbols completed. APO took 33.7s. Estimated remaining: 4h 21m 41s. Rate: 8.5 symbols/min [2025-10-31T17:15:55.041348] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:15:55.041551] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-31T17:15:55.041595] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-31T17:15:55.041728] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-31T17:15:55.041773] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-31T17:15:55.041816] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-31T17:15:55.041850] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-31T17:15:55.258840] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-31T17:15:55.419697] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:15:55.458104] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-31T17:15:55.460002] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-31T17:15:56.257666] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-31T17:15:56.555254] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-31T17:15:56.758291] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T17:15:57.057687] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-31T17:15:57.857688] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-31T17:15:58.404232] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T17:15:58.657668] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-31T17:15:59.112383] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T17:15:59.457727] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-31T17:15:59.781327] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T17:16:00.257694] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-31T17:16:00.523362] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-31T17:16:01.057674] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-31T17:16:01.615515] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T17:16:01.857688] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-31T17:16:02.472359] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T17:16:02.657762] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-31T17:16:03.245280] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T17:16:03.457682] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-31T17:16:03.939010] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T17:16:04.257678] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-31T17:16:04.907207] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T17:16:05.057604] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-31T17:16:05.628410] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T17:16:05.682870] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T17:16:05.857692] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-31T17:16:06.168118] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-31T17:16:06.657679] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-31T17:16:06.995912] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-31T17:16:07.457677] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-31T17:16:08.257718] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-31T17:16:09.045118] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-31T17:16:09.057609] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-31T17:16:09.639224] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T17:16:09.724816] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T17:16:09.736326] [INFO ] [REMOTE ] APTV: Full fetch complete (75323 records). [2025-10-31T17:16:09.736503] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-31T17:16:09.737342] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:16:09.737446] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:16:09.737489] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:16:09.737528] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-31T17:16:09.737584] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-31T17:16:09.737623] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-31T17:16:09.737829] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-10-31T17:16:09.739265] [INFO ] [MAIN ] Update Progress: 136/2365 symbols completed. APTV took 35.3s. Estimated remaining: 4h 23m 43s. Rate: 8.5 symbols/min [2025-10-31T17:16:09.862861] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-31T17:16:09.910679] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:16:09.910807] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-31T17:16:09.910845] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-31T17:16:09.910948] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-31T17:16:09.910989] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-31T17:16:09.911031] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-31T17:16:09.911063] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-31T17:16:10.269518] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:16:10.388101] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T17:16:10.657695] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-31T17:16:11.006835] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-31T17:16:11.457676] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-31T17:16:11.830389] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-31T17:16:12.257684] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-31T17:16:12.646857] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-31T17:16:13.057669] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-31T17:16:13.857668] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-31T17:16:14.329916] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T17:16:14.477264] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T17:16:14.478468] [INFO ] [REMOTE ] AQNB: Full fetch complete (5334 records). [2025-10-31T17:16:14.478533] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-31T17:16:14.662717] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-31T17:16:14.841875] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-31T17:16:14.841947] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-31T17:16:14.842105] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-31T17:16:14.842143] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-31T17:16:14.842493] [DEBUG] [LOCAL ] AQNB: Trimmed 5334 records to 3713 (keeping 200 days of data) [2025-10-31T17:16:14.864812] [DEBUG] [LOCAL ] AQNB: Primary data saved (3713 records). [2025-10-31T17:16:14.864897] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-31T17:16:14.864968] [INFO ] [MAIN ] Update Progress: 137/2365 symbols completed. AQNB took 21.9s. Estimated remaining: 4h 23m 3s. Rate: 8.5 symbols/min [2025-10-31T17:16:15.041506] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:16:15.041736] [DEBUG] [LOCAL ] ARDC: No existing data file found in primary storage. [2025-10-31T17:16:15.041796] [WARN ] [MAIN ] ARDC: No existing data found, performing full refresh instead. [2025-10-31T17:16:15.041906] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-31T17:16:15.041948] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-31T17:16:15.041994] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-31T17:16:15.042026] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-31T17:16:15.400210] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:16:15.457622] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-31T17:16:16.119071] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-31T17:16:16.257696] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-31T17:16:16.319109] [DEBUG] [REMOTE ] ARCO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-31T17:16:16.319499] [WARN ] [REMOTE ] ARCO: No data returned for month 2025-01 [2025-10-31T17:16:16.319607] [FATAL] [REMOTE ] ARCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:16:16.319704] [FATAL] [MAIN ] ARCO: Failed to fetch primary data. [2025-10-31T17:16:16.319787] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:16:16.319873] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-31T17:16:16.320103] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-31T17:16:16.320149] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-31T17:16:16.320202] [DEBUG] [LOCAL ] ARCO: No derivative data file found to delete. [2025-10-31T17:16:16.320287] [INFO ] [MAIN ] Update Progress: 138/2365 symbols completed. ARCO took 6.6s. Estimated remaining: 4h 21m 26s. Rate: 8.5 symbols/min [2025-10-31T17:16:16.512409] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:16:16.554203] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-31T17:16:16.585443] [DEBUG] [LOCAL ] ARDT: Loaded 27504 existing records from primary storage. [2025-10-31T17:16:16.585750] [INFO ] [MAIN ] ARDT: Loaded 27504 existing records. [2025-10-31T17:16:16.762148] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:16:16.762352] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-31T17:16:16.762398] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-31T17:16:16.762698] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-31T17:16:16.762753] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-31T17:16:17.062750] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-31T17:16:17.116788] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:16:17.857672] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-31T17:16:18.386678] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:16:18.558309] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-31T17:16:18.657681] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-31T17:16:19.457639] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-31T17:16:19.633099] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T17:16:20.163826] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T17:16:20.257726] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-31T17:16:21.057633] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-31T17:16:21.128088] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T17:16:21.857727] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-31T17:16:22.384462] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:16:22.639290] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-31T17:16:22.657614] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-31T17:16:23.204179] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-31T17:16:23.457634] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-31T17:16:24.257668] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-31T17:16:24.743433] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T17:16:25.057669] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-31T17:16:25.581726] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T17:16:25.594072] [INFO ] [REMOTE ] AQN: Full fetch complete (74895 records). [2025-10-31T17:16:25.594249] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-31T17:16:25.595119] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:16:25.595213] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:16:25.595287] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:16:25.595371] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-31T17:16:25.595480] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-31T17:16:25.595559] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-31T17:16:25.595795] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-31T17:16:25.596789] [INFO ] [MAIN ] Update Progress: 139/2365 symbols completed. AQN took 37.6s. Estimated remaining: 4h 21m 54s. Rate: 8.5 symbols/min [2025-10-31T17:16:25.784120] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:16:25.784266] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-10-31T17:16:25.784302] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-10-31T17:16:25.784408] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-31T17:16:25.784447] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-31T17:16:25.784505] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-31T17:16:25.784547] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-31T17:16:25.862758] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-31T17:16:26.131807] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:16:26.601484] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-31T17:16:26.657669] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-31T17:16:26.807075] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-31T17:16:27.457678] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-31T17:16:27.990840] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T17:16:28.257686] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-31T17:16:28.875898] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T17:16:29.057623] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-31T17:16:29.304720] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T17:16:29.857677] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-31T17:16:30.214530] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T17:16:30.569387] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-31T17:16:30.657672] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-31T17:16:31.457705] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-31T17:16:31.800764] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T17:16:32.257679] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-31T17:16:32.610225] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T17:16:33.057636] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-31T17:16:33.671681] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T17:16:33.857664] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-31T17:16:34.354615] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T17:16:34.657693] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-31T17:16:35.221350] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T17:16:35.457695] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-31T17:16:35.583500] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-31T17:16:36.223331] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-31T17:16:36.242091] [INFO ] [REMOTE ] AR: Full fetch complete (77736 records). [2025-10-31T17:16:36.242287] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-31T17:16:36.262898] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-31T17:16:36.724572] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-31T17:16:36.724684] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-31T17:16:36.725468] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-31T17:16:36.725512] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-31T17:16:36.727007] [DEBUG] [LOCAL ] AR: Trimmed 77736 records to 54367 (keeping 200 days of data) [2025-10-31T17:16:37.046007] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-31T17:16:37.066055] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-31T17:16:37.068715] [DEBUG] [LOCAL ] AR: Primary data saved (54367 records). [2025-10-31T17:16:37.069515] [INFO ] [MAIN ] AR: Full history saved. [2025-10-31T17:16:37.069608] [INFO ] [MAIN ] Update Progress: 140/2365 symbols completed. AR took 42.2s. Estimated remaining: 4h 22m 57s. Rate: 8.5 symbols/min [2025-10-31T17:16:37.251492] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:16:37.305160] [DEBUG] [LOCAL ] ARES: Loaded 49951 existing records from primary storage. [2025-10-31T17:16:37.305508] [INFO ] [MAIN ] ARES: Loaded 49951 existing records. [2025-10-31T17:16:37.496921] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:16:37.497178] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-31T17:16:37.497230] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-31T17:16:37.497563] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-31T17:16:37.497620] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-31T17:16:37.862812] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-31T17:16:37.925707] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:16:38.430278] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T17:16:38.584481] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-31T17:16:38.657623] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-31T17:16:39.429703] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-31T17:16:39.434349] [INFO ] [REMOTE ] ARDC: Full fetch complete (21666 records). [2025-10-31T17:16:39.434512] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-31T17:16:39.463710] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-31T17:16:39.825095] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-31T17:16:39.825174] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-31T17:16:39.825521] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-31T17:16:39.825563] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-31T17:16:39.826161] [DEBUG] [LOCAL ] ARDC: Trimmed 21666 records to 15064 (keeping 200 days of data) [2025-10-31T17:16:39.929530] [DEBUG] [LOCAL ] ARDC: Primary data saved (15064 records). [2025-10-31T17:16:39.929709] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-31T17:16:39.929797] [INFO ] [MAIN ] Update Progress: 141/2365 symbols completed. ARDC took 25.1s. Estimated remaining: 4h 21m 44s. Rate: 8.5 symbols/min [2025-10-31T17:16:40.107248] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:16:40.147276] [DEBUG] [LOCAL ] ARI: Loaded 43367 existing records from primary storage. [2025-10-31T17:16:40.147567] [INFO ] [MAIN ] ARI: Loaded 43367 existing records. [2025-10-31T17:16:40.262765] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-31T17:16:40.338216] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:16:40.338426] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-31T17:16:40.338472] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-31T17:16:40.338786] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-31T17:16:40.338842] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-31T17:16:40.643777] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T17:16:40.713222] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:16:41.057721] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-31T17:16:41.857667] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-31T17:16:42.209986] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T17:16:42.274838] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-31T17:16:42.657672] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-31T17:16:42.765313] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T17:16:43.457630] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-31T17:16:44.257825] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-31T17:16:44.285779] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-31T17:16:44.588489] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T17:16:45.057675] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-31T17:16:45.828821] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-31T17:16:45.857727] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-31T17:16:46.253215] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T17:16:46.657733] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-31T17:16:47.290225] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-31T17:16:47.457725] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-31T17:16:47.648373] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T17:16:48.257690] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-31T17:16:49.057732] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-31T17:16:49.320230] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-31T17:16:49.332570] [INFO ] [REMOTE ] ARE: Full fetch complete (73176 records). [2025-10-31T17:16:49.332755] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-31T17:16:49.472946] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:16:49.761464] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-31T17:16:49.761554] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-31T17:16:49.762299] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-31T17:16:49.762363] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-31T17:16:49.763783] [DEBUG] [LOCAL ] ARE: Trimmed 73176 records to 51640 (keeping 200 days of data) [2025-10-31T17:16:49.857842] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-31T17:16:50.083946] [DEBUG] [LOCAL ] ARE: Primary data saved (51640 records). [2025-10-31T17:16:50.084097] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-31T17:16:50.084171] [INFO ] [MAIN ] Update Progress: 142/2365 symbols completed. ARE took 24.5s. Estimated remaining: 4h 22m 25s. Rate: 8.5 symbols/min [2025-10-31T17:16:50.262096] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:16:50.303067] [DEBUG] [LOCAL ] ARLO: Loaded 43883 existing records from primary storage. [2025-10-31T17:16:50.303347] [INFO ] [MAIN ] ARLO: Loaded 43883 existing records. [2025-10-31T17:16:50.487284] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:16:50.487596] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-31T17:16:50.487767] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-31T17:16:50.488234] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-31T17:16:50.488337] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-31T17:16:50.664788] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-31T17:16:50.810404] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-31T17:16:50.904228] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:16:50.933144] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-31T17:16:51.457700] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-31T17:16:52.199346] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T17:16:52.257675] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-31T17:16:52.770068] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T17:16:53.057674] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-31T17:16:53.605797] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T17:16:53.857755] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-31T17:16:54.452200] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-31T17:16:54.657671] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-31T17:16:55.312256] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T17:16:55.457686] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-31T17:16:56.126764] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-31T17:16:56.257637] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-31T17:16:56.471423] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:16:57.057691] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-31T17:16:57.555564] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T17:16:57.857687] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-31T17:16:58.660169] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-31T17:16:58.663375] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-31T17:16:58.843949] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T17:16:58.850984] [INFO ] [REMOTE ] ARDT: Full fetch complete (41712 records). [2025-10-31T17:16:58.851091] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-31T17:16:59.216129] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-31T17:16:59.216208] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-31T17:16:59.216763] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-31T17:16:59.216825] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-31T17:16:59.217710] [DEBUG] [LOCAL ] ARDT: Trimmed 41712 records to 27660 (keeping 200 days of data) [2025-10-31T17:16:59.374082] [DEBUG] [LOCAL ] ARDT: Primary data saved (27660 records). [2025-10-31T17:16:59.374213] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-31T17:16:59.374289] [INFO ] [MAIN ] Update Progress: 143/2365 symbols completed. ARDT took 43.1s. Estimated remaining: 4h 22m 52s. Rate: 8.5 symbols/min [2025-10-31T17:16:59.462846] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-31T17:16:59.548717] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:16:59.597766] [DEBUG] [LOCAL ] ARMK: Loaded 50603 existing records from primary storage. [2025-10-31T17:16:59.598095] [INFO ] [MAIN ] ARMK: Loaded 50603 existing records. [2025-10-31T17:16:59.775415] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:16:59.775639] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-31T17:16:59.775723] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-31T17:16:59.775991] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-31T17:16:59.776032] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-31T17:17:00.135515] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:00.204112] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-31T17:17:00.257710] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-31T17:17:00.859169] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-31T17:17:01.057667] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-31T17:17:01.580177] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T17:17:01.857708] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-31T17:17:02.322366] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T17:17:02.657625] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-31T17:17:03.242915] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T17:17:03.457695] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-31T17:17:04.061963] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T17:17:04.257687] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-31T17:17:04.954164] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T17:17:04.964349] [INFO ] [REMOTE ] ARI: Full fetch complete (62147 records). [2025-10-31T17:17:04.964519] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-31T17:17:05.066232] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-31T17:17:05.376045] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-31T17:17:05.376241] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-31T17:17:05.376933] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-31T17:17:05.377017] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-31T17:17:05.378393] [DEBUG] [LOCAL ] ARI: Trimmed 62147 records to 43685 (keeping 200 days of data) [2025-10-31T17:17:05.669686] [DEBUG] [LOCAL ] ARI: Primary data saved (43685 records). [2025-10-31T17:17:05.669826] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-31T17:17:05.669982] [INFO ] [MAIN ] Update Progress: 144/2365 symbols completed. ARI took 25.7s. Estimated remaining: 4h 22m 33s. Rate: 8.5 symbols/min [2025-10-31T17:17:05.709382] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T17:17:05.857838] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-31T17:17:05.857770] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:17:05.902509] [DEBUG] [LOCAL ] AROC: Loaded 49373 existing records from primary storage. [2025-10-31T17:17:05.902828] [INFO ] [MAIN ] AROC: Loaded 49373 existing records. [2025-10-31T17:17:06.078181] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:17:06.078408] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-31T17:17:06.078456] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-31T17:17:06.078967] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-31T17:17:06.079023] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-31T17:17:06.441888] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:06.471800] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T17:17:06.657716] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-31T17:17:07.349034] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-31T17:17:07.457726] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-31T17:17:08.064549] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T17:17:08.257710] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-31T17:17:08.913703] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T17:17:09.057712] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-31T17:17:09.450614] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T17:17:09.857739] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-31T17:17:10.280449] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T17:17:10.657666] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-31T17:17:11.075844] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T17:17:11.457674] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-31T17:17:11.803008] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T17:17:12.257688] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-31T17:17:12.742587] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T17:17:13.057679] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-31T17:17:13.798318] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T17:17:13.857678] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-31T17:17:14.485749] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T17:17:14.657673] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-31T17:17:15.386585] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-31T17:17:15.398663] [INFO ] [REMOTE ] ARES: Full fetch complete (72021 records). [2025-10-31T17:17:15.398826] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-31T17:17:15.464546] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-31T17:17:15.799939] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-31T17:17:15.800034] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-31T17:17:15.800848] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-31T17:17:15.800911] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-31T17:17:15.802194] [DEBUG] [LOCAL ] ARES: Trimmed 72021 records to 50339 (keeping 200 days of data) [2025-10-31T17:17:16.144318] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T17:17:16.193371] [DEBUG] [LOCAL ] ARES: Primary data saved (50339 records). [2025-10-31T17:17:16.193516] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-31T17:17:16.194350] [INFO ] [MAIN ] Update Progress: 145/2365 symbols completed. ARES took 39.1s. Estimated remaining: 4h 23m 18s. Rate: 8.4 symbols/min [2025-10-31T17:17:16.263173] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-31T17:17:16.369684] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:17:16.369854] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-31T17:17:16.369892] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-31T17:17:16.369998] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-31T17:17:16.370039] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-31T17:17:16.370133] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-31T17:17:16.370192] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-31T17:17:16.736453] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:17.057693] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-31T17:17:17.339624] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-31T17:17:17.857636] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-31T17:17:18.180738] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-31T17:17:18.429522] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T17:17:18.657690] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-31T17:17:19.109786] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T17:17:19.457709] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-31T17:17:19.946637] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T17:17:20.257708] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-31T17:17:20.678497] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T17:17:21.057692] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-31T17:17:21.603001] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-31T17:17:21.857707] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-31T17:17:22.524151] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T17:17:22.657669] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-31T17:17:22.938748] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T17:17:23.457687] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-31T17:17:24.061096] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T17:17:24.072802] [INFO ] [REMOTE ] ARLO: Full fetch complete (63425 records). [2025-10-31T17:17:24.072976] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-31T17:17:24.262758] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-31T17:17:24.523234] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-31T17:17:24.523325] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-31T17:17:24.523980] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-31T17:17:24.524044] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-31T17:17:24.525273] [DEBUG] [LOCAL ] ARLO: Trimmed 63425 records to 44201 (keeping 200 days of data) [2025-10-31T17:17:24.778957] [DEBUG] [LOCAL ] ARLO: Primary data saved (44201 records). [2025-10-31T17:17:24.779079] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-31T17:17:24.780199] [INFO ] [MAIN ] Update Progress: 146/2365 symbols completed. ARLO took 34.7s. Estimated remaining: 4h 23m 33s. Rate: 8.4 symbols/min [2025-10-31T17:17:24.958686] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:17:24.958910] [DEBUG] [LOCAL ] ARW: No existing data file found in primary storage. [2025-10-31T17:17:24.958955] [WARN ] [MAIN ] ARW: No existing data found, performing full refresh instead. [2025-10-31T17:17:24.959063] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-31T17:17:24.959144] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-31T17:17:24.959195] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-31T17:17:24.959228] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-31T17:17:25.058255] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-31T17:17:25.338896] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:25.370850] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-31T17:17:25.691572] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T17:17:25.857683] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-31T17:17:26.445466] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-31T17:17:26.657682] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-31T17:17:27.387420] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T17:17:27.457639] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-31T17:17:27.788332] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-31T17:17:28.257684] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-31T17:17:28.718141] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T17:17:29.057624] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-31T17:17:29.098338] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-31T17:17:29.857693] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-31T17:17:30.453129] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-31T17:17:30.657729] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-31T17:17:31.262394] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T17:17:31.274271] [INFO ] [REMOTE ] ARMK: Full fetch complete (72925 records). [2025-10-31T17:17:31.274412] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-31T17:17:31.464980] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-31T17:17:31.688728] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-31T17:17:31.688806] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-31T17:17:31.689570] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-31T17:17:31.689639] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-31T17:17:31.691623] [DEBUG] [LOCAL ] ARMK: Trimmed 72925 records to 50977 (keeping 200 days of data) [2025-10-31T17:17:31.842631] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T17:17:32.027275] [DEBUG] [LOCAL ] ARMK: Primary data saved (50977 records). [2025-10-31T17:17:32.027397] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-31T17:17:32.028552] [INFO ] [MAIN ] Update Progress: 147/2365 symbols completed. ARMK took 32.7s. Estimated remaining: 4h 23m 28s. Rate: 8.4 symbols/min [2025-10-31T17:17:32.195162] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:17:32.195294] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-31T17:17:32.195333] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-31T17:17:32.195440] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-31T17:17:32.195481] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-31T17:17:32.195524] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-31T17:17:32.195559] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-31T17:17:32.262753] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-31T17:17:32.548753] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:32.683212] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:17:33.057704] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-31T17:17:33.605284] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T17:17:33.618271] [INFO ] [REMOTE ] AROC: Full fetch complete (71478 records). [2025-10-31T17:17:33.618531] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-31T17:17:33.862863] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-31T17:17:34.074093] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-31T17:17:34.074322] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-31T17:17:34.075295] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-31T17:17:34.075398] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-31T17:17:34.077801] [DEBUG] [LOCAL ] AROC: Trimmed 71478 records to 49760 (keeping 200 days of data) [2025-10-31T17:17:34.217491] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T17:17:34.403751] [DEBUG] [LOCAL ] AROC: Primary data saved (49760 records). [2025-10-31T17:17:34.403911] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-31T17:17:34.404000] [INFO ] [MAIN ] Update Progress: 148/2365 symbols completed. AROC took 28.7s. Estimated remaining: 4h 22m 10s. Rate: 8.5 symbols/min [2025-10-31T17:17:34.570944] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:17:34.619018] [DEBUG] [LOCAL ] AS: Loaded 53585 existing records from primary storage. [2025-10-31T17:17:34.619305] [INFO ] [MAIN ] AS: Loaded 53585 existing records. [2025-10-31T17:17:34.662821] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-31T17:17:34.796765] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:17:34.796977] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-31T17:17:34.797023] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-31T17:17:34.797414] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-31T17:17:34.797450] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-31T17:17:35.150863] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:35.457628] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-31T17:17:35.629764] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:17:35.640896] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-31T17:17:35.643138] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-31T17:17:35.641598] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:17:35.643360] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-31T17:17:35.653463] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:17:35.654165] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-31T17:17:35.654565] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-31T17:17:35.654623] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-31T17:17:35.654718] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-31T17:17:35.654779] [INFO ] [MAIN ] Update Progress: 149/2365 symbols completed. ARX took 3.6s. Estimated remaining: 4h 20m 36s. Rate: 8.5 symbols/min [2025-10-31T17:17:35.835604] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:17:35.857677] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T17:17:35.876795] [DEBUG] [LOCAL ] ASA: Loaded 16045 existing records from primary storage. [2025-10-31T17:17:35.877026] [INFO ] [MAIN ] ASA: Loaded 16045 existing records. [2025-10-31T17:17:36.055834] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:17:36.056038] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-31T17:17:36.056084] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-31T17:17:36.056302] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-31T17:17:36.056358] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-31T17:17:36.262869] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-31T17:17:36.420625] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:37.057662] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-31T17:17:37.712597] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T17:17:37.857683] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-31T17:17:38.387047] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-31T17:17:38.657628] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-31T17:17:38.794788] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-31T17:17:39.457708] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-31T17:17:39.784979] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T17:17:39.977881] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T17:17:40.257699] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-31T17:17:41.057639] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-31T17:17:41.554959] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-31T17:17:41.641420] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-31T17:17:41.857693] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-31T17:17:42.657637] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-31T17:17:42.733135] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:17:43.457732] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-31T17:17:44.207627] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-31T17:17:44.257689] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-31T17:17:44.734418] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T17:17:44.822967] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T17:17:45.057689] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-31T17:17:45.857708] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-31T17:17:46.246682] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T17:17:46.377931] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T17:17:46.657667] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-31T17:17:47.457672] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-31T17:17:47.713271] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T17:17:47.998944] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T17:17:48.257727] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-31T17:17:49.057667] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-31T17:17:49.857618] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-31T17:17:50.070847] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-31T17:17:50.082846] [INFO ] [REMOTE ] ARR: Full fetch complete (75505 records). [2025-10-31T17:17:50.082972] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-31T17:17:50.229461] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T17:17:50.493182] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-31T17:17:50.493256] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-31T17:17:50.494000] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-31T17:17:50.494061] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-31T17:17:50.495392] [DEBUG] [LOCAL ] ARR: Trimmed 75505 records to 52795 (keeping 200 days of data) [2025-10-31T17:17:50.669688] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-31T17:17:50.816110] [DEBUG] [LOCAL ] ARR: Primary data saved (52795 records). [2025-10-31T17:17:50.816255] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-31T17:17:50.816332] [INFO ] [MAIN ] Update Progress: 150/2365 symbols completed. ARR took 34.6s. Estimated remaining: 4h 22m 28s. Rate: 8.4 symbols/min [2025-10-31T17:17:50.986812] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:17:50.986954] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-10-31T17:17:50.986990] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-10-31T17:17:50.987099] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-31T17:17:50.987139] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-31T17:17:50.987182] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-31T17:17:50.987214] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-31T17:17:51.344768] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:51.355123] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-31T17:17:51.386922] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T17:17:51.457618] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-31T17:17:52.257620] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-31T17:17:52.741093] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T17:17:53.057664] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-31T17:17:53.827855] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-31T17:17:53.852271] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T17:17:53.857597] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-31T17:17:54.657685] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-31T17:17:54.876618] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-31T17:17:54.882370] [INFO ] [REMOTE ] ASA: Full fetch complete (21190 records). [2025-10-31T17:17:54.882477] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-31T17:17:55.248816] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-31T17:17:55.248917] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-31T17:17:55.249247] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-31T17:17:55.249289] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-31T17:17:55.249931] [DEBUG] [LOCAL ] ASA: Trimmed 21190 records to 16149 (keeping 200 days of data) [2025-10-31T17:17:55.344857] [DEBUG] [LOCAL ] ASA: Primary data saved (16149 records). [2025-10-31T17:17:55.344991] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-31T17:17:55.345067] [INFO ] [MAIN ] Update Progress: 151/2365 symbols completed. ASA took 19.7s. Estimated remaining: 4h 21m 43s. Rate: 8.5 symbols/min [2025-10-31T17:17:55.462831] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-31T17:17:55.519270] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:17:55.561847] [DEBUG] [LOCAL ] ASB: Loaded 50031 existing records from primary storage. [2025-10-31T17:17:55.562131] [INFO ] [MAIN ] ASB: Loaded 50031 existing records. [2025-10-31T17:17:55.737929] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:17:55.738204] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-31T17:17:55.738252] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-31T17:17:55.738709] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-31T17:17:55.738766] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-31T17:17:56.110121] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:17:56.189373] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-31T17:17:56.257701] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-31T17:17:56.418167] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-31T17:17:57.057698] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-31T17:17:57.598146] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T17:17:57.857684] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-31T17:17:58.298522] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T17:17:58.657723] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-31T17:17:59.142352] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T17:17:59.457694] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-31T17:18:00.197436] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T17:18:00.257606] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-31T17:18:01.057714] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-31T17:18:01.345988] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-31T17:18:01.354161] [INFO ] [REMOTE ] ARW: Full fetch complete (48879 records). [2025-10-31T17:18:01.354253] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-31T17:18:01.726864] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-31T17:18:01.726937] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-31T17:18:01.727452] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-31T17:18:01.727491] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-31T17:18:01.728464] [DEBUG] [LOCAL ] ARW: Trimmed 48879 records to 33516 (keeping 200 days of data) [2025-10-31T17:18:01.884888] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-31T17:18:01.933910] [DEBUG] [LOCAL ] ARW: Primary data saved (33516 records). [2025-10-31T17:18:01.934024] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-31T17:18:01.934091] [INFO ] [MAIN ] Update Progress: 152/2365 symbols completed. ARW took 37.2s. Estimated remaining: 4h 21m 29s. Rate: 8.5 symbols/min [2025-10-31T17:18:02.126305] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:18:02.152698] [DEBUG] [LOCAL ] ASBA: Loaded 3492 existing records from primary storage. [2025-10-31T17:18:02.161189] [INFO ] [MAIN ] ASBA: Loaded 3492 existing records. [2025-10-31T17:18:02.240419] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T17:18:02.291166] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-31T17:18:02.339530] [INFO ] [REMOTE ] AS: Full fetch complete (76962 records). [2025-10-31T17:18:02.349971] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-31T17:18:02.521976] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:18:02.547930] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-31T17:18:02.548024] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-31T17:18:02.575847] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-31T17:18:02.578550] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-31T17:18:02.667811] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-31T17:18:03.053289] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-31T17:18:03.064712] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-31T17:18:03.076092] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-31T17:18:03.089324] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-31T17:18:03.171967] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:18:03.169004] [DEBUG] [LOCAL ] AS: Trimmed 76962 records to 53973 (keeping 200 days of data) [2025-10-31T17:18:03.297276] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T17:18:03.463212] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-31T17:18:03.510153] [DEBUG] [LOCAL ] AS: Primary data saved (53973 records). [2025-10-31T17:18:03.510269] [INFO ] [MAIN ] AS: Full history saved. [2025-10-31T17:18:03.510363] [INFO ] [MAIN ] Update Progress: 153/2365 symbols completed. AS took 29.1s. Estimated remaining: 4h 20m 2s. Rate: 8.5 symbols/min [2025-10-31T17:18:03.676112] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:18:03.709891] [DEBUG] [LOCAL ] ASC: Loaded 37172 existing records from primary storage. [2025-10-31T17:18:03.710188] [INFO ] [MAIN ] ASC: Loaded 37172 existing records. [2025-10-31T17:18:03.882736] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:18:03.882898] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-31T17:18:03.882942] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-31T17:18:03.883129] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-31T17:18:03.883166] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-31T17:18:04.235674] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:18:04.266516] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-31T17:18:04.271555] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-31T17:18:05.057622] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-31T17:18:05.127588] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-31T17:18:05.449703] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-31T17:18:05.529734] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T17:18:05.857740] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-31T17:18:06.657688] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-31T17:18:07.457730] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-31T17:18:07.577313] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-31T17:18:07.918620] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T17:18:08.257676] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-31T17:18:08.985392] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T17:18:09.057680] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-31T17:18:09.572633] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T17:18:09.857675] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-31T17:18:10.507737] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T17:18:10.657680] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-31T17:18:11.049890] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T17:18:11.457699] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-31T17:18:12.257639] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-31T17:18:12.369726] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-31T17:18:12.583528] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T17:18:12.636545] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-31T17:18:13.057623] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-31T17:18:13.346879] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-31T17:18:13.857676] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-31T17:18:14.657675] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-31T17:18:15.457712] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-31T17:18:15.651049] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-31T17:18:15.892674] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T17:18:15.966488] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-31T17:18:16.257700] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-31T17:18:17.057719] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-31T17:18:17.747014] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-31T17:18:17.857671] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-31T17:18:18.288058] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T17:18:18.657670] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-31T17:18:19.417419] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-31T17:18:19.457664] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-31T17:18:19.795223] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-31T17:18:19.989287] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T17:18:20.257672] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-31T17:18:21.057697] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-31T17:18:21.857680] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-31T17:18:21.994604] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-31T17:18:22.007351] [INFO ] [REMOTE ] ASAN: Full fetch complete (76616 records). [2025-10-31T17:18:22.007520] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-31T17:18:22.440137] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-31T17:18:22.450104] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-31T17:18:22.456927] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-31T17:18:22.465745] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-31T17:18:22.471914] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T17:18:22.483824] [DEBUG] [LOCAL ] ASAN: Trimmed 76616 records to 53470 (keeping 200 days of data) [2025-10-31T17:18:22.662033] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-31T17:18:22.803587] [DEBUG] [LOCAL ] ASAN: Primary data saved (53470 records). [2025-10-31T17:18:22.803749] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-31T17:18:22.803825] [INFO ] [MAIN ] Update Progress: 154/2365 symbols completed. ASAN took 32.0s. Estimated remaining: 4h 22m 51s. Rate: 8.4 symbols/min [2025-10-31T17:18:22.973966] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:18:22.978088] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-31T17:18:22.997212] [DEBUG] [LOCAL ] ASG: Loaded 19163 existing records from primary storage. [2025-10-31T17:18:22.997435] [INFO ] [MAIN ] ASG: Loaded 19163 existing records. [2025-10-31T17:18:23.181038] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:18:23.181356] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-31T17:18:23.181419] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-31T17:18:23.181774] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-31T17:18:23.181849] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-31T17:18:23.310987] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T17:18:23.462837] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-31T17:18:23.621084] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:18:24.257673] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-31T17:18:24.623636] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T17:18:25.057625] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-31T17:18:25.238897] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-31T17:18:25.250778] [INFO ] [REMOTE ] ASB: Full fetch complete (72397 records). [2025-10-31T17:18:25.250920] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-31T17:18:25.651774] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-31T17:18:25.651863] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-31T17:18:25.652615] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-31T17:18:25.652733] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-31T17:18:25.654145] [DEBUG] [LOCAL ] ASB: Trimmed 72397 records to 50417 (keeping 200 days of data) [2025-10-31T17:18:25.869342] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-31T17:18:25.974835] [DEBUG] [LOCAL ] ASB: Primary data saved (50417 records). [2025-10-31T17:18:25.975114] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-31T17:18:25.975774] [INFO ] [MAIN ] Update Progress: 155/2365 symbols completed. ASB took 30.6s. Estimated remaining: 4h 21m 47s. Rate: 8.4 symbols/min [2025-10-31T17:18:26.171821] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:18:26.173954] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:18:26.202945] [DEBUG] [LOCAL ] ASGI: Loaded 22821 existing records from primary storage. [2025-10-31T17:18:26.203189] [INFO ] [MAIN ] ASGI: Loaded 22821 existing records. [2025-10-31T17:18:26.376277] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:18:26.376486] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-31T17:18:26.376532] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-31T17:18:26.376803] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-31T17:18:26.376858] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-31T17:18:26.673065] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-31T17:18:26.727422] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:18:26.832128] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-31T17:18:27.213105] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-31T17:18:27.457691] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-31T17:18:28.257693] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-31T17:18:28.518328] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T17:18:29.053719] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T17:18:29.058086] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-31T17:18:29.664402] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-31T17:18:29.857688] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-31T17:18:30.245597] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-31T17:18:30.657682] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-31T17:18:31.327528] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-31T17:18:31.457631] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-31T17:18:32.257683] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-31T17:18:32.502408] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T17:18:33.005174] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T17:18:33.057611] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-31T17:18:33.857626] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-31T17:18:33.902059] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T17:18:34.657638] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-31T17:18:35.092932] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T17:18:35.200887] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-31T17:18:35.202345] [INFO ] [REMOTE ] ASBA: Full fetch complete (5178 records). [2025-10-31T17:18:35.202412] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-31T17:18:35.462761] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-31T17:18:35.565802] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-31T17:18:35.565875] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-31T17:18:35.566020] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-31T17:18:35.566060] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-31T17:18:35.566405] [DEBUG] [LOCAL ] ASBA: Trimmed 5178 records to 3535 (keeping 200 days of data) [2025-10-31T17:18:35.587131] [DEBUG] [LOCAL ] ASBA: Primary data saved (3535 records). [2025-10-31T17:18:35.587221] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-31T17:18:35.587290] [INFO ] [MAIN ] Update Progress: 156/2365 symbols completed. ASBA took 33.7s. Estimated remaining: 4h 22m 16s. Rate: 8.4 symbols/min [2025-10-31T17:18:35.754183] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:18:35.754354] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-10-31T17:18:35.754392] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-10-31T17:18:35.754526] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-31T17:18:35.754594] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-31T17:18:35.754703] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-31T17:18:35.754769] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-31T17:18:36.110700] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:18:36.257615] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-31T17:18:36.320892] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-31T17:18:37.057611] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-31T17:18:37.194803] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-31T17:18:37.857620] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-31T17:18:38.018983] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T17:18:38.543145] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-31T17:18:38.657670] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-31T17:18:39.457668] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-31T17:18:39.712311] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T17:18:40.257614] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-31T17:18:40.324562] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-31T17:18:41.057723] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-31T17:18:41.320126] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T17:18:41.857626] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-31T17:18:41.911748] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-31T17:18:42.657681] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-31T17:18:43.129008] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T17:18:43.457677] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-31T17:18:43.652250] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-31T17:18:44.165076] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-31T17:18:44.257696] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-31T17:18:45.057670] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-31T17:18:45.648228] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T17:18:45.656689] [INFO ] [REMOTE ] ASC: Full fetch complete (55669 records). [2025-10-31T17:18:45.656796] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-31T17:18:45.845171] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-31T17:18:45.861720] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-31T17:18:46.058269] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-31T17:18:46.058350] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-31T17:18:46.058958] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-31T17:18:46.059020] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-31T17:18:46.060057] [DEBUG] [LOCAL ] ASC: Trimmed 55669 records to 37397 (keeping 200 days of data) [2025-10-31T17:18:46.275795] [DEBUG] [LOCAL ] ASC: Primary data saved (37397 records). [2025-10-31T17:18:46.275951] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-31T17:18:46.276047] [INFO ] [MAIN ] Update Progress: 157/2365 symbols completed. ASC took 42.8s. Estimated remaining: 4h 22m 59s. Rate: 8.4 symbols/min [2025-10-31T17:18:46.657714] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-31T17:18:46.778760] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T17:18:46.784847] [INFO ] [REMOTE ] ASGI: Full fetch complete (32448 records). [2025-10-31T17:18:46.785024] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-31T17:18:47.147447] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-31T17:18:47.147521] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-31T17:18:47.147932] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-31T17:18:47.148009] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-31T17:18:47.148751] [DEBUG] [LOCAL ] ASGI: Trimmed 32448 records to 22971 (keeping 200 days of data) [2025-10-31T17:18:47.288274] [DEBUG] [LOCAL ] ASGI: Primary data saved (22971 records). [2025-10-31T17:18:47.288406] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-31T17:18:47.288485] [INFO ] [MAIN ] Update Progress: 158/2365 symbols completed. ASGI took 21.3s. Estimated remaining: 4h 21m 26s. Rate: 8.4 symbols/min [2025-10-31T17:18:47.457747] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-31T17:18:47.484018] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T17:18:48.257731] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-31T17:18:48.692930] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T17:18:49.057735] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-31T17:18:50.055742] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-31T17:18:50.060137] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-31T17:18:50.931605] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T17:18:50.936250] [INFO ] [REMOTE ] ASG: Full fetch complete (30292 records). [2025-10-31T17:18:50.936327] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-31T17:18:51.212995] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-31T17:18:51.259585] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-31T17:18:51.345065] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-31T17:18:51.345153] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-31T17:18:51.345597] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-31T17:18:51.345639] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-31T17:18:51.346557] [DEBUG] [LOCAL ] ASG: Trimmed 30292 records to 19290 (keeping 200 days of data) [2025-10-31T17:18:51.453027] [DEBUG] [LOCAL ] ASG: Primary data saved (19290 records). [2025-10-31T17:18:51.453178] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-31T17:18:51.453260] [INFO ] [MAIN ] Update Progress: 159/2365 symbols completed. ASG took 28.6s. Estimated remaining: 4h 20m 38s. Rate: 8.5 symbols/min [2025-10-31T17:18:52.319692] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T17:18:52.326695] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-31T17:18:56.975518] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (4.65 seconds). [2025-10-31T17:18:56.982614] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-31T17:18:58.138077] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T17:18:58.146390] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-31T17:18:59.148183] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T17:18:59.156375] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-31T17:19:00.212071] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T17:19:00.220457] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-31T17:19:01.775113] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T17:19:01.784361] [INFO ] [REMOTE ] ASGN: Full fetch complete (53893 records). [2025-10-31T17:19:01.784502] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-31T17:19:01.785206] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:19:01.785296] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:19:01.785339] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:19:01.785377] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-31T17:19:01.785446] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-31T17:19:01.785510] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-10-31T17:19:01.785598] [DEBUG] [LOCAL ] ASGN: No derivative data file found to delete. [2025-10-31T17:19:01.785735] [INFO ] [MAIN ] Update Progress: 160/2365 symbols completed. ASGN took 26.2s. Estimated remaining: 4h 21m 15s. Rate: 8.4 symbols/min [2025-10-31T17:19:02.431829] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:02.438883] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:02.479958] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:02.497004] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:02.497426] [DEBUG] [LOCAL ] ASPN: No existing data file found in primary storage. [2025-10-31T17:19:02.497489] [WARN ] [MAIN ] ASPN: No existing data found, performing full refresh instead. [2025-10-31T17:19:02.497985] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-31T17:19:02.498043] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-31T17:19:02.498771] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-10-31T17:19:02.498861] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-31T17:19:02.629472] [DEBUG] [LOCAL ] ASIX: Loaded 22882 existing records from primary storage. [2025-10-31T17:19:02.644930] [DEBUG] [LOCAL ] ASR: Loaded 9477 existing records from primary storage. [2025-10-31T17:19:02.661098] [INFO ] [MAIN ] ASR: Loaded 9477 existing records. [2025-10-31T17:19:02.655768] [INFO ] [MAIN ] ASIX: Loaded 22882 existing records. [2025-10-31T17:19:02.898175] [DEBUG] [LOCAL ] ASH: Loaded 37277 existing records from primary storage. [2025-10-31T17:19:02.933957] [INFO ] [MAIN ] ASH: Loaded 37277 existing records. [2025-10-31T17:19:03.251178] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:19:03.336157] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:19:03.376969] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-31T17:19:03.362295] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-31T17:19:03.387192] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-31T17:19:03.411040] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-31T17:19:03.416420] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:19:03.410964] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-31T17:19:03.427497] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-31T17:19:03.427350] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-31T17:19:03.486055] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-31T17:19:03.519213] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-31T17:19:03.536917] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-31T17:19:03.549608] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:03.598923] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-31T17:19:03.610375] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-31T17:19:03.610219] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-31T17:19:04.763490] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:04.822625] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-31T17:19:04.890662] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:04.901719] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-31T17:19:04.973128] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:04.973528] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-31T17:19:05.297296] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-31T17:19:05.307035] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-31T17:19:05.439976] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T17:19:05.442148] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-31T17:19:05.650800] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T17:19:05.654762] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-31T17:19:05.966161] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T17:19:05.968334] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-31T17:19:06.041148] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T17:19:06.048935] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-31T17:19:06.143403] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-31T17:19:06.147156] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-31T17:19:06.422873] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-31T17:19:06.424930] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-31T17:19:06.732921] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-31T17:19:06.743557] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-31T17:19:06.749174] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-31T17:19:06.748913] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-31T17:19:06.971136] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-31T17:19:06.974315] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-31T17:19:07.074086] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T17:19:07.081974] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-31T17:19:07.441157] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-31T17:19:07.457620] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-31T17:19:07.669369] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T17:19:08.026699] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-31T17:19:08.201595] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T17:19:08.245222] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:19:08.257617] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-31T17:19:09.057688] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-31T17:19:09.468698] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T17:19:09.687350] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T17:19:09.857702] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-31T17:19:10.657694] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-31T17:19:11.177189] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-31T17:19:11.272373] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T17:19:11.457709] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-31T17:19:12.257682] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-31T17:19:12.521403] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T17:19:12.969904] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-31T17:19:13.057681] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-31T17:19:13.857720] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-31T17:19:14.462887] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-31T17:19:14.628923] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-31T17:19:14.657614] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-31T17:19:15.457690] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-31T17:19:16.202352] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-31T17:19:16.204986] [INFO ] [REMOTE ] ASR: Full fetch complete (12622 records). [2025-10-31T17:19:16.205062] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-31T17:19:16.205490] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:19:16.205578] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:19:16.205620] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:19:16.205725] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-31T17:19:16.205797] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-31T17:19:16.205833] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-10-31T17:19:16.206010] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-10-31T17:19:16.206105] [INFO ] [MAIN ] Update Progress: 161/2365 symbols completed. ASR took 14.4s. Estimated remaining: 4h 22m 48s. Rate: 8.4 symbols/min [2025-10-31T17:19:16.266035] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-31T17:19:16.410488] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-31T17:19:16.430533] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:16.498361] [DEBUG] [LOCAL ] ASX: Loaded 53241 existing records from primary storage. [2025-10-31T17:19:16.498939] [INFO ] [MAIN ] ASX: Loaded 53241 existing records. [2025-10-31T17:19:16.686579] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:19:16.686871] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-31T17:19:16.686922] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-31T17:19:16.687377] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-31T17:19:16.687418] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-31T17:19:17.056053] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:17.057630] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-31T17:19:17.080937] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-31T17:19:17.857689] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-31T17:19:18.483529] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T17:19:18.657689] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-31T17:19:18.716221] [DEBUG] [REMOTE ] ASH: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-31T17:19:18.716697] [WARN ] [REMOTE ] ASH: No data returned for month 2025-06 [2025-10-31T17:19:18.716793] [FATAL] [REMOTE ] ASH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:19:18.716896] [FATAL] [MAIN ] ASH: Failed to fetch primary data. [2025-10-31T17:19:18.716967] [WARN ] [MAIN ] ASH: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:19:18.717043] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-31T17:19:18.717117] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-10-31T17:19:18.717157] [INFO ] [LOCAL ] ASH: Starting deletion of derivative data. [2025-10-31T17:19:18.717410] [DEBUG] [LOCAL ] ASH: Deleted derivative data file. [2025-10-31T17:19:18.717520] [INFO ] [MAIN ] Update Progress: 162/2365 symbols completed. ASH took 16.9s. Estimated remaining: 4h 21m 38s. Rate: 8.4 symbols/min [2025-10-31T17:19:18.892085] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:18.892335] [DEBUG] [LOCAL ] ATEN: No existing data file found in primary storage. [2025-10-31T17:19:18.892374] [WARN ] [MAIN ] ATEN: No existing data found, performing full refresh instead. [2025-10-31T17:19:18.892491] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-31T17:19:18.892533] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-31T17:19:18.892575] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-10-31T17:19:18.892607] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-31T17:19:19.252449] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:19.457681] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-31T17:19:19.493817] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-31T17:19:20.257694] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-31T17:19:20.732343] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T17:19:21.057683] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-31T17:19:21.518503] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T17:19:21.857618] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-31T17:19:22.136241] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T17:19:22.657669] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-31T17:19:23.166709] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T17:19:23.457671] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-31T17:19:23.806369] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T17:19:24.243765] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-31T17:19:24.257605] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-31T17:19:25.057622] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-31T17:19:25.135704] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-31T17:19:25.857667] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-31T17:19:26.347096] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T17:19:26.657664] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-31T17:19:27.210133] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T17:19:27.436184] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T17:19:27.457609] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-31T17:19:28.257620] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-31T17:19:28.455327] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-31T17:19:28.461089] [INFO ] [REMOTE ] ASIX: Full fetch complete (31310 records). [2025-10-31T17:19:28.461175] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-31T17:19:28.822136] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-31T17:19:28.822214] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-31T17:19:28.822597] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-31T17:19:28.822637] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-31T17:19:28.823448] [DEBUG] [LOCAL ] ASIX: Trimmed 31310 records to 23138 (keeping 200 days of data) [2025-10-31T17:19:28.955459] [DEBUG] [LOCAL ] ASIX: Primary data saved (23138 records). [2025-10-31T17:19:28.955551] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-31T17:19:28.955626] [INFO ] [MAIN ] Update Progress: 163/2365 symbols completed. ASIX took 27.2s. Estimated remaining: 4h 22m 13s. Rate: 8.4 symbols/min [2025-10-31T17:19:29.058959] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-31T17:19:29.140552] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:29.140742] [DEBUG] [LOCAL ] ATGE: No existing data file found in primary storage. [2025-10-31T17:19:29.140789] [WARN ] [MAIN ] ATGE: No existing data found, performing full refresh instead. [2025-10-31T17:19:29.140902] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-31T17:19:29.140961] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-31T17:19:29.141004] [DEBUG] [LOCAL ] ATGE: No primary data file found to delete. [2025-10-31T17:19:29.141038] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-31T17:19:29.501326] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:29.838971] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T17:19:29.850368] [INFO ] [REMOTE ] ASPN: Full fetch complete (72570 records). [2025-10-31T17:19:29.850495] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-31T17:19:29.863799] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-31T17:19:30.236544] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-31T17:19:30.236619] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-31T17:19:30.237434] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-31T17:19:30.237492] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-31T17:19:30.238980] [DEBUG] [LOCAL ] ASPN: Trimmed 72570 records to 50465 (keeping 200 days of data) [2025-10-31T17:19:30.512304] [DEBUG] [LOCAL ] ASPN: Primary data saved (50465 records). [2025-10-31T17:19:30.512416] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-31T17:19:30.512483] [INFO ] [MAIN ] Update Progress: 164/2365 symbols completed. ASPN took 28.7s. Estimated remaining: 4h 20m 51s. Rate: 8.4 symbols/min [2025-10-31T17:19:30.691971] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:30.667699] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-31T17:19:30.693490] [DEBUG] [LOCAL ] ATHM: No existing data file found in primary storage. [2025-10-31T17:19:30.693557] [WARN ] [MAIN ] ATHM: No existing data found, performing full refresh instead. [2025-10-31T17:19:30.693811] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-31T17:19:30.693900] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-31T17:19:30.694018] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-31T17:19:30.694170] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-31T17:19:31.026075] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-31T17:19:31.116473] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:31.245853] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T17:19:31.457668] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-31T17:19:31.914509] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T17:19:32.257715] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-31T17:19:32.463479] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T17:19:33.051609] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T17:19:33.058122] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-31T17:19:33.857737] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-31T17:19:34.579700] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-31T17:19:34.657716] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-31T17:19:35.457619] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-31T17:19:35.741051] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-31T17:19:36.047980] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T17:19:36.257637] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-31T17:19:36.468142] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T17:19:37.057701] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-31T17:19:37.790712] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T17:19:37.857709] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-31T17:19:38.126326] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T17:19:38.657635] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-31T17:19:38.884953] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T17:19:39.457687] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-31T17:19:39.673946] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T17:19:40.257720] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-31T17:19:40.541246] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T17:19:41.057627] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-31T17:19:41.372555] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T17:19:41.379968] [INFO ] [REMOTE ] ATEN: Full fetch complete (56333 records). [2025-10-31T17:19:41.380067] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-31T17:19:41.759591] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-31T17:19:41.759686] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-31T17:19:41.760272] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-31T17:19:41.760311] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-31T17:19:41.761342] [DEBUG] [LOCAL ] ATEN: Trimmed 56333 records to 37628 (keeping 200 days of data) [2025-10-31T17:19:41.861858] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-31T17:19:41.987824] [DEBUG] [LOCAL ] ATEN: Primary data saved (37628 records). [2025-10-31T17:19:41.987990] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-31T17:19:41.988078] [INFO ] [MAIN ] Update Progress: 165/2365 symbols completed. ATEN took 23.3s. Estimated remaining: 4h 21m 42s. Rate: 8.4 symbols/min [2025-10-31T17:19:42.165978] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:42.190862] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T17:19:42.201923] [DEBUG] [LOCAL ] ATHS: Loaded 6294 existing records from primary storage. [2025-10-31T17:19:42.202331] [INFO ] [MAIN ] ATHS: Loaded 6294 existing records. [2025-10-31T17:19:42.386131] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:19:42.386340] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-31T17:19:42.386386] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-31T17:19:42.386551] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-31T17:19:42.386589] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-31T17:19:42.666679] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-31T17:19:42.749255] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:19:42.990780] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T17:19:43.457671] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-31T17:19:43.825674] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:19:44.257631] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-31T17:19:44.381324] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-31T17:19:44.774866] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-31T17:19:45.057684] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-31T17:19:45.857700] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-31T17:19:46.104569] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-31T17:19:46.657728] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-31T17:19:47.266967] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T17:19:47.457740] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-31T17:19:47.816137] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T17:19:48.036127] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T17:19:48.257682] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-31T17:19:49.057675] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-31T17:19:49.591775] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T17:19:49.624483] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T17:19:49.857710] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-31T17:19:50.657615] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-31T17:19:50.943477] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T17:19:51.457704] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-31T17:19:51.826508] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T17:19:52.257681] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-31T17:19:52.633075] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T17:19:52.695569] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-31T17:19:53.057639] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-31T17:19:53.857681] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-31T17:19:53.996519] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T17:19:54.285523] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T17:19:54.657632] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-31T17:19:55.197547] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-31T17:19:55.457690] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-31T17:19:56.257619] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-31T17:19:56.276774] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-31T17:19:57.057668] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-31T17:19:57.536886] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-31T17:19:57.857695] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-31T17:19:58.012088] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-31T17:19:58.024087] [INFO ] [REMOTE ] ASX: Full fetch complete (76799 records). [2025-10-31T17:19:58.024213] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-31T17:19:58.407593] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-31T17:19:58.407709] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-31T17:19:58.408483] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-31T17:19:58.408547] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-31T17:19:58.410022] [DEBUG] [LOCAL ] ASX: Trimmed 76799 records to 53631 (keeping 200 days of data) [2025-10-31T17:19:58.677254] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-31T17:19:58.745414] [DEBUG] [LOCAL ] ASX: Primary data saved (53631 records). [2025-10-31T17:19:58.748620] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-31T17:19:58.749927] [INFO ] [MAIN ] Update Progress: 166/2365 symbols completed. ASX took 42.5s. Estimated remaining: 4h 23m 42s. Rate: 8.3 symbols/min [2025-10-31T17:19:58.796106] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-31T17:19:58.928498] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:19:58.981024] [DEBUG] [LOCAL ] ATI: Loaded 51636 existing records from primary storage. [2025-10-31T17:19:58.981336] [INFO ] [MAIN ] ATI: Loaded 51636 existing records. [2025-10-31T17:19:59.157850] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:19:59.158223] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-31T17:19:59.158299] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-31T17:19:59.163669] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-31T17:19:59.163861] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-31T17:19:59.164080] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-31T17:19:59.462940] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-31T17:19:59.519622] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:00.257635] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-31T17:20:00.365638] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-31T17:20:01.057677] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-31T17:20:01.213896] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-31T17:20:01.221193] [INFO ] [REMOTE ] ATGE: Full fetch complete (45496 records). [2025-10-31T17:20:01.221349] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-31T17:20:01.695709] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-31T17:20:01.695818] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-31T17:20:01.696455] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-31T17:20:01.696522] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-31T17:20:01.697856] [DEBUG] [LOCAL ] ATGE: Trimmed 45496 records to 30394 (keeping 200 days of data) [2025-10-31T17:20:01.869188] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-31T17:20:01.889967] [DEBUG] [LOCAL ] ATGE: Primary data saved (30394 records). [2025-10-31T17:20:01.890494] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-31T17:20:01.890580] [INFO ] [MAIN ] Update Progress: 167/2365 symbols completed. ATGE took 32.9s. Estimated remaining: 4h 22m 42s. Rate: 8.4 symbols/min [2025-10-31T17:20:02.082307] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:20:02.118817] [DEBUG] [LOCAL ] ATKR: Loaded 34484 existing records from primary storage. [2025-10-31T17:20:02.119152] [INFO ] [MAIN ] ATKR: Loaded 34484 existing records. [2025-10-31T17:20:02.270813] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T17:20:02.354629] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:20:02.354930] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-31T17:20:02.354999] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-31T17:20:02.355304] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-31T17:20:02.355361] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-31T17:20:02.671012] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-31T17:20:02.712612] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:03.160419] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-31T17:20:03.457618] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-31T17:20:04.018517] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-31T17:20:04.257740] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-31T17:20:04.938888] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-31T17:20:05.057635] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-31T17:20:05.393350] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:20:05.400405] [INFO ] [REMOTE ] ATHM: Full fetch complete (48840 records). [2025-10-31T17:20:05.400538] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-31T17:20:05.769331] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-31T17:20:05.769407] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-31T17:20:05.769945] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-31T17:20:05.770005] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-31T17:20:05.771024] [DEBUG] [LOCAL ] ATHM: Trimmed 48840 records to 30988 (keeping 200 days of data) [2025-10-31T17:20:05.860918] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-31T17:20:05.966846] [DEBUG] [LOCAL ] ATHM: Primary data saved (30988 records). [2025-10-31T17:20:05.966977] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-31T17:20:05.967047] [INFO ] [MAIN ] Update Progress: 168/2365 symbols completed. ATHM took 35.5s. Estimated remaining: 4h 21m 54s. Rate: 8.4 symbols/min [2025-10-31T17:20:06.159752] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:20:06.191107] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T17:20:06.223261] [DEBUG] [LOCAL ] ATMU: Loaded 38328 existing records from primary storage. [2025-10-31T17:20:06.223526] [INFO ] [MAIN ] ATMU: Loaded 38328 existing records. [2025-10-31T17:20:06.400088] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:20:06.400299] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-31T17:20:06.400345] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-31T17:20:06.400695] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-31T17:20:06.400797] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-31T17:20:06.522314] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-31T17:20:06.546746] [INFO ] [REMOTE ] ATHS: Full fetch complete (9490 records). [2025-10-31T17:20:06.564724] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-31T17:20:06.665417] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-31T17:20:07.031660] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:07.136549] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-31T17:20:07.136626] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-31T17:20:07.136836] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-31T17:20:07.136885] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-31T17:20:07.137277] [DEBUG] [LOCAL ] ATHS: Trimmed 9490 records to 6366 (keeping 200 days of data) [2025-10-31T17:20:07.173864] [DEBUG] [LOCAL ] ATHS: Primary data saved (6366 records). [2025-10-31T17:20:07.173943] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-31T17:20:07.174011] [INFO ] [MAIN ] Update Progress: 169/2365 symbols completed. ATHS took 25.2s. Estimated remaining: 4h 20m 30s. Rate: 8.4 symbols/min [2025-10-31T17:20:07.341365] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:20:07.379510] [DEBUG] [LOCAL ] ATO: Loaded 41461 existing records from primary storage. [2025-10-31T17:20:07.379797] [INFO ] [MAIN ] ATO: Loaded 41461 existing records. [2025-10-31T17:20:07.462931] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-31T17:20:07.559914] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:20:07.560113] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-31T17:20:07.560166] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-31T17:20:07.560520] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-31T17:20:07.560576] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-31T17:20:07.919832] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:08.071240] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T17:20:08.257623] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-31T17:20:08.523427] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T17:20:09.057672] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-31T17:20:09.509940] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T17:20:09.857719] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-31T17:20:10.399782] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T17:20:10.657684] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-31T17:20:11.216614] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T17:20:11.457670] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-31T17:20:11.730137] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-31T17:20:12.257721] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-31T17:20:12.730932] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T17:20:13.057684] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-31T17:20:13.789847] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T17:20:13.857723] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-31T17:20:14.281808] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:20:14.657638] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-31T17:20:15.308298] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T17:20:15.457631] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-31T17:20:16.123771] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T17:20:16.257720] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-31T17:20:17.057635] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-31T17:20:17.566777] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T17:20:17.857696] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-31T17:20:18.260848] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T17:20:18.291253] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-31T17:20:18.657632] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-31T17:20:19.262792] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T17:20:19.457625] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-31T17:20:19.651269] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-31T17:20:20.257727] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-31T17:20:20.841476] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T17:20:21.057621] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-31T17:20:21.172674] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T17:20:21.857710] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-31T17:20:22.317981] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T17:20:22.657692] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-31T17:20:23.134842] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T17:20:23.457686] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-31T17:20:23.775877] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T17:20:24.257670] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-31T17:20:24.522021] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T17:20:25.057668] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-31T17:20:25.242982] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T17:20:25.857681] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-31T17:20:26.330794] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T17:20:26.657720] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-31T17:20:27.348696] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-31T17:20:27.457671] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-31T17:20:28.257698] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-31T17:20:28.449151] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-31T17:20:28.462058] [INFO ] [REMOTE ] ATI: Full fetch complete (74278 records). [2025-10-31T17:20:28.462210] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-31T17:20:28.847259] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T17:20:28.953208] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-31T17:20:28.953287] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-31T17:20:28.954030] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-31T17:20:28.954094] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-31T17:20:28.955424] [DEBUG] [LOCAL ] ATI: Trimmed 74278 records to 52009 (keeping 200 days of data) [2025-10-31T17:20:29.057778] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-31T17:20:29.258964] [DEBUG] [LOCAL ] ATI: Primary data saved (52009 records). [2025-10-31T17:20:29.259097] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-31T17:20:29.259991] [INFO ] [MAIN ] Update Progress: 170/2365 symbols completed. ATI took 30.5s. Estimated remaining: 4h 23m 36s. Rate: 8.3 symbols/min [2025-10-31T17:20:29.431762] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:20:29.461233] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T17:20:29.500991] [DEBUG] [LOCAL ] ATR: Loaded 30764 existing records from primary storage. [2025-10-31T17:20:29.501310] [INFO ] [MAIN ] ATR: Loaded 30764 existing records. [2025-10-31T17:20:29.719185] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:20:29.719417] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-31T17:20:29.719467] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-31T17:20:29.719896] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-31T17:20:29.719956] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-31T17:20:29.862860] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-31T17:20:30.154744] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:30.175932] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T17:20:30.657626] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-31T17:20:31.180089] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T17:20:31.457724] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-31T17:20:31.861581] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T17:20:32.257679] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-31T17:20:32.416773] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-31T17:20:33.057701] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-31T17:20:33.406600] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T17:20:33.857625] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-31T17:20:34.178863] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-31T17:20:34.657727] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-31T17:20:34.881730] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T17:20:35.457674] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-31T17:20:35.909342] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T17:20:35.917033] [INFO ] [REMOTE ] ATKR: Full fetch complete (52784 records). [2025-10-31T17:20:35.917166] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-31T17:20:36.266203] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-31T17:20:36.310279] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-31T17:20:36.310442] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-31T17:20:36.311099] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-31T17:20:36.311162] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-31T17:20:36.312288] [DEBUG] [LOCAL ] ATKR: Trimmed 52784 records to 34723 (keeping 200 days of data) [2025-10-31T17:20:36.538585] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-31T17:20:36.553574] [DEBUG] [LOCAL ] ATKR: Primary data saved (34723 records). [2025-10-31T17:20:36.553722] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-31T17:20:36.554333] [INFO ] [MAIN ] Update Progress: 171/2365 symbols completed. ATKR took 34.7s. Estimated remaining: 4h 23m 30s. Rate: 8.3 symbols/min [2025-10-31T17:20:36.732769] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:20:36.751454] [DEBUG] [LOCAL ] ATS: Loaded 16622 existing records from primary storage. [2025-10-31T17:20:36.751723] [INFO ] [MAIN ] ATS: Loaded 16622 existing records. [2025-10-31T17:20:36.936432] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:20:36.936685] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-31T17:20:36.936753] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-31T17:20:36.937023] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-31T17:20:36.937082] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-31T17:20:37.062763] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-31T17:20:37.309483] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:37.753919] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T17:20:37.762938] [INFO ] [REMOTE ] ATO: Full fetch complete (60517 records). [2025-10-31T17:20:37.763079] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-31T17:20:37.862853] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-31T17:20:38.155785] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-31T17:20:38.155955] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-31T17:20:38.156617] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-31T17:20:38.156837] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-31T17:20:38.158345] [DEBUG] [LOCAL ] ATO: Trimmed 60517 records to 41804 (keeping 200 days of data) [2025-10-31T17:20:38.274240] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T17:20:38.444141] [DEBUG] [LOCAL ] ATO: Primary data saved (41804 records). [2025-10-31T17:20:38.444263] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-31T17:20:38.444339] [INFO ] [MAIN ] Update Progress: 172/2365 symbols completed. ATO took 31.3s. Estimated remaining: 4h 22m 15s. Rate: 8.4 symbols/min [2025-10-31T17:20:38.612908] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:20:38.631013] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-31T17:20:38.657622] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-31T17:20:38.677208] [DEBUG] [LOCAL ] ATUS: Loaded 50351 existing records from primary storage. [2025-10-31T17:20:38.677495] [INFO ] [MAIN ] ATUS: Loaded 50351 existing records. [2025-10-31T17:20:38.858038] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:20:38.858349] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-31T17:20:38.858407] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-31T17:20:38.858768] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-31T17:20:38.858846] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-31T17:20:39.209435] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:39.333270] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-31T17:20:39.457691] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-31T17:20:40.257671] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-31T17:20:40.334529] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:20:41.057714] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-31T17:20:41.451292] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T17:20:41.459531] [INFO ] [REMOTE ] ATMU: Full fetch complete (56513 records). [2025-10-31T17:20:41.459638] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-31T17:20:41.859394] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-31T17:20:41.859327] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-31T17:20:41.859880] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-31T17:20:41.864901] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-31T17:20:41.865909] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-31T17:20:41.865980] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-31T17:20:41.867225] [DEBUG] [LOCAL ] ATMU: Trimmed 56513 records to 38639 (keeping 200 days of data) [2025-10-31T17:20:42.090807] [DEBUG] [LOCAL ] ATMU: Primary data saved (38639 records). [2025-10-31T17:20:42.090939] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-31T17:20:42.091016] [INFO ] [MAIN ] Update Progress: 173/2365 symbols completed. ATMU took 36.1s. Estimated remaining: 4h 21m 23s. Rate: 8.4 symbols/min [2025-10-31T17:20:42.261387] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:20:42.261554] [DEBUG] [LOCAL ] AU: No existing data file found in primary storage. [2025-10-31T17:20:42.261592] [WARN ] [MAIN ] AU: No existing data found, performing full refresh instead. [2025-10-31T17:20:42.261748] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-31T17:20:42.261819] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-31T17:20:42.261875] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-31T17:20:42.261914] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-31T17:20:42.614586] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:42.657699] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-31T17:20:43.301199] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T17:20:43.457684] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-31T17:20:44.047211] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T17:20:44.071302] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-31T17:20:44.257689] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-31T17:20:44.931452] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T17:20:45.057639] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-31T17:20:45.857686] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-31T17:20:46.319350] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T17:20:46.544475] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T17:20:46.657677] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-31T17:20:47.457667] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-31T17:20:47.651898] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T17:20:48.257728] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-31T17:20:48.578966] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-31T17:20:49.057713] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-31T17:20:49.140915] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T17:20:49.857624] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-31T17:20:50.028535] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T17:20:50.574706] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T17:20:50.657688] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-31T17:20:51.457738] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-31T17:20:51.776030] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T17:20:52.257677] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-31T17:20:53.064589] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-31T17:20:53.069897] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-31T17:20:53.864692] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-31T17:20:53.871605] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-31T17:20:53.960962] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-31T17:20:54.657667] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-31T17:20:55.282631] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-31T17:20:55.457711] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-31T17:20:55.716853] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T17:20:55.985740] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-31T17:20:56.257681] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-31T17:20:57.057635] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-31T17:20:57.082889] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-31T17:20:57.086373] [INFO ] [REMOTE ] ATS: Full fetch complete (25092 records). [2025-10-31T17:20:57.086451] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-31T17:20:57.458019] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-31T17:20:57.458117] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-31T17:20:57.458519] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-31T17:20:57.458561] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-31T17:20:57.459381] [DEBUG] [LOCAL ] ATS: Trimmed 25092 records to 16764 (keeping 200 days of data) [2025-10-31T17:20:57.561605] [DEBUG] [LOCAL ] ATS: Primary data saved (16764 records). [2025-10-31T17:20:57.561778] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-31T17:20:57.561873] [INFO ] [MAIN ] Update Progress: 174/2365 symbols completed. ATS took 21.0s. Estimated remaining: 4h 23m 1s. Rate: 8.3 symbols/min [2025-10-31T17:20:57.744200] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:20:57.790855] [DEBUG] [LOCAL ] AUB: Loaded 45919 existing records from primary storage. [2025-10-31T17:20:57.791162] [INFO ] [MAIN ] AUB: Loaded 45919 existing records. [2025-10-31T17:20:57.863192] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-31T17:20:57.968114] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:20:57.968330] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-31T17:20:57.968400] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-31T17:20:57.968863] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-31T17:20:57.968920] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-31T17:20:58.345839] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:20:58.662115] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-31T17:20:58.667387] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-31T17:20:58.909348] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-31T17:20:59.457669] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-31T17:20:59.914589] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T17:21:00.257637] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-31T17:21:01.057719] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-31T17:21:01.147057] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-31T17:21:01.382473] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T17:21:01.391543] [INFO ] [REMOTE ] ATR: Full fetch complete (44398 records). [2025-10-31T17:21:01.391759] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-31T17:21:01.862871] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-31T17:21:01.953474] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-31T17:21:01.953565] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-31T17:21:01.954159] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-31T17:21:01.954224] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-31T17:21:01.955398] [DEBUG] [LOCAL ] ATR: Trimmed 44398 records to 31136 (keeping 200 days of data) [2025-10-31T17:21:02.182800] [DEBUG] [LOCAL ] ATR: Primary data saved (31136 records). [2025-10-31T17:21:02.182935] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-31T17:21:02.183052] [INFO ] [MAIN ] Update Progress: 175/2365 symbols completed. ATR took 32.9s. Estimated remaining: 4h 22m 21s. Rate: 8.3 symbols/min [2025-10-31T17:21:02.411923] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:02.443365] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T17:21:02.456019] [DEBUG] [LOCAL ] AUNA: Loaded 5493 existing records from primary storage. [2025-10-31T17:21:02.457212] [INFO ] [MAIN ] AUNA: Loaded 5493 existing records. [2025-10-31T17:21:02.658728] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-31T17:21:02.658585] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:21:02.659917] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-31T17:21:02.659991] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-31T17:21:02.660144] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-31T17:21:02.660201] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-31T17:21:03.015483] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:03.457625] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-31T17:21:03.879063] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-31T17:21:03.923266] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T17:21:04.257695] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-31T17:21:04.616910] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T17:21:05.057675] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-31T17:21:05.554546] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:21:05.857683] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-31T17:21:06.436739] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-31T17:21:06.657673] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-31T17:21:07.227189] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-31T17:21:07.457783] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-31T17:21:07.589149] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-31T17:21:08.257678] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-31T17:21:08.615352] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T17:21:08.786423] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T17:21:09.057722] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-31T17:21:09.857622] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-31T17:21:10.189984] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-31T17:21:10.653297] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-31T17:21:10.664666] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-31T17:21:11.457670] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-31T17:21:12.264064] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-31T17:21:12.269400] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T17:21:12.280761] [INFO ] [REMOTE ] ATUS: Full fetch complete (71427 records). [2025-10-31T17:21:12.280887] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-31T17:21:12.675431] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-31T17:21:12.675509] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-31T17:21:12.676264] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-31T17:21:12.676329] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-31T17:21:12.677723] [DEBUG] [LOCAL ] ATUS: Trimmed 71427 records to 50702 (keeping 200 days of data) [2025-10-31T17:21:12.959435] [DEBUG] [LOCAL ] ATUS: Primary data saved (50702 records). [2025-10-31T17:21:12.959809] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-31T17:21:12.970893] [INFO ] [MAIN ] Update Progress: 176/2365 symbols completed. ATUS took 34.5s. Estimated remaining: 4h 22m 59s. Rate: 8.3 symbols/min [2025-10-31T17:21:13.068607] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-31T17:21:13.070455] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-31T17:21:13.178847] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:13.211785] [DEBUG] [LOCAL ] AVA: Loaded 38192 existing records from primary storage. [2025-10-31T17:21:13.212048] [INFO ] [MAIN ] AVA: Loaded 38192 existing records. [2025-10-31T17:21:13.382849] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:21:13.383032] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-31T17:21:13.383077] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-31T17:21:13.383337] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-31T17:21:13.383392] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-31T17:21:13.593499] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-31T17:21:13.739934] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:13.822392] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-31T17:21:13.857613] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-31T17:21:14.657625] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-31T17:21:14.890148] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T17:21:15.057139] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-31T17:21:15.457660] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-31T17:21:16.257679] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-31T17:21:16.550024] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T17:21:17.057678] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-31T17:21:17.624639] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-31T17:21:17.857703] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-31T17:21:18.283460] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-31T17:21:18.295872] [INFO ] [REMOTE ] AU: Full fetch complete (76669 records). [2025-10-31T17:21:18.296037] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-31T17:21:18.661950] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-31T17:21:18.686340] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-31T17:21:18.686397] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-31T17:21:18.687407] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-31T17:21:18.687472] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-31T17:21:18.689089] [DEBUG] [LOCAL ] AU: Trimmed 76669 records to 53848 (keeping 200 days of data) [2025-10-31T17:21:19.015630] [DEBUG] [LOCAL ] AU: Primary data saved (53848 records). [2025-10-31T17:21:19.015768] [INFO ] [MAIN ] AU: Full history saved. [2025-10-31T17:21:19.015834] [INFO ] [MAIN ] Update Progress: 177/2365 symbols completed. AU took 36.9s. Estimated remaining: 4h 22m 37s. Rate: 8.3 symbols/min [2025-10-31T17:21:19.125778] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-31T17:21:19.204502] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:19.236097] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T17:21:19.249167] [DEBUG] [LOCAL ] AVAL: Loaded 8361 existing records from primary storage. [2025-10-31T17:21:19.249363] [INFO ] [MAIN ] AVAL: Loaded 8361 existing records. [2025-10-31T17:21:19.421248] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:21:19.421499] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-31T17:21:19.421554] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-31T17:21:19.421802] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-31T17:21:19.421898] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-31T17:21:19.462781] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-31T17:21:19.770791] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:20.257724] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-31T17:21:20.540682] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T17:21:21.057620] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-31T17:21:21.103430] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T17:21:21.857675] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-31T17:21:22.226315] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T17:21:22.657670] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-31T17:21:23.059604] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-31T17:21:23.090583] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T17:21:23.457715] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-31T17:21:23.801487] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-31T17:21:24.257668] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-31T17:21:24.844839] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T17:21:24.846863] [INFO ] [REMOTE ] AUNA: Full fetch complete (7912 records). [2025-10-31T17:21:24.846931] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-31T17:21:25.062873] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-31T17:21:25.198481] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-31T17:21:25.198548] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-31T17:21:25.198758] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-31T17:21:25.198818] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-31T17:21:25.199187] [DEBUG] [LOCAL ] AUNA: Trimmed 7912 records to 5526 (keeping 200 days of data) [2025-10-31T17:21:25.228274] [DEBUG] [LOCAL ] AUNA: Primary data saved (5526 records). [2025-10-31T17:21:25.228356] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-31T17:21:25.228433] [INFO ] [MAIN ] Update Progress: 178/2365 symbols completed. AUNA took 23.0s. Estimated remaining: 4h 22m 18s. Rate: 8.3 symbols/min [2025-10-31T17:21:25.395270] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:25.436970] [DEBUG] [LOCAL ] AVB: Loaded 42232 existing records from primary storage. [2025-10-31T17:21:25.437238] [INFO ] [MAIN ] AVB: Loaded 42232 existing records. [2025-10-31T17:21:25.611227] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:21:25.611415] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-31T17:21:25.611460] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-31T17:21:25.611628] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-31T17:21:25.611715] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-31T17:21:25.862884] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-31T17:21:25.957878] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:26.546164] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-31T17:21:26.562957] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-31T17:21:26.657679] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-31T17:21:27.457688] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-31T17:21:27.843224] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T17:21:28.257676] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-31T17:21:28.433746] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T17:21:29.057683] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-31T17:21:29.429148] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T17:21:29.857709] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-31T17:21:30.129792] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-31T17:21:30.657702] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-31T17:21:31.374884] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T17:21:31.457674] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-31T17:21:31.873882] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:21:32.257678] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-31T17:21:32.551801] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-31T17:21:33.057666] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-31T17:21:33.388818] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-31T17:21:33.857765] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-31T17:21:34.386095] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-31T17:21:34.397035] [INFO ] [REMOTE ] AUB: Full fetch complete (66539 records). [2025-10-31T17:21:34.397199] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-31T17:21:34.664515] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-31T17:21:34.784182] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-31T17:21:34.784266] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-31T17:21:34.785325] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-31T17:21:34.785396] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-31T17:21:34.786779] [DEBUG] [LOCAL ] AUB: Trimmed 66539 records to 46264 (keeping 200 days of data) [2025-10-31T17:21:35.034568] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-31T17:21:35.101568] [DEBUG] [LOCAL ] AUB: Primary data saved (46264 records). [2025-10-31T17:21:35.101714] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-31T17:21:35.102371] [INFO ] [MAIN ] Update Progress: 179/2365 symbols completed. AUB took 37.5s. Estimated remaining: 4h 22m 43s. Rate: 8.3 symbols/min [2025-10-31T17:21:35.273389] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:35.273529] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-31T17:21:35.273566] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-31T17:21:35.273719] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-31T17:21:35.273780] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-31T17:21:35.273826] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-31T17:21:35.273862] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-31T17:21:35.461806] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-31T17:21:35.488742] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T17:21:35.653234] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:36.257672] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-31T17:21:36.700281] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T17:21:36.783623] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T17:21:37.057700] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-31T17:21:37.698516] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T17:21:37.857700] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-31T17:21:38.657674] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-31T17:21:38.985214] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T17:21:39.137445] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-31T17:21:39.457693] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-31T17:21:40.258040] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-31T17:21:40.427109] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:21:40.427416] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-31T17:21:40.427504] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:21:40.427553] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-31T17:21:40.427609] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:21:40.427718] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-31T17:21:40.427786] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-31T17:21:40.427860] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-31T17:21:40.427927] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-31T17:21:40.428028] [INFO ] [MAIN ] Update Progress: 180/2365 symbols completed. AVBC took 5.3s. Estimated remaining: 4h 22m 13s. Rate: 8.3 symbols/min [2025-10-31T17:21:40.625071] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:40.625322] [DEBUG] [LOCAL ] AVD: No existing data file found in primary storage. [2025-10-31T17:21:40.625421] [WARN ] [MAIN ] AVD: No existing data found, performing full refresh instead. [2025-10-31T17:21:40.625737] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-31T17:21:40.625850] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-31T17:21:40.625915] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-31T17:21:40.625950] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-31T17:21:40.831084] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T17:21:41.021779] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:41.057607] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-31T17:21:41.857669] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-31T17:21:42.008055] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T17:21:42.657668] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-31T17:21:43.009870] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-31T17:21:43.044092] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-31T17:21:43.457674] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-31T17:21:44.098488] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-31T17:21:44.257639] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-31T17:21:45.057686] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-31T17:21:45.158596] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T17:21:45.546481] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-31T17:21:45.857690] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-31T17:21:46.657682] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-31T17:21:46.963095] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T17:21:47.131339] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T17:21:47.457710] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-31T17:21:48.257678] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-31T17:21:48.713727] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T17:21:48.722518] [INFO ] [REMOTE ] AVA: Full fetch complete (55559 records). [2025-10-31T17:21:48.722686] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-31T17:21:49.051359] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T17:21:49.080909] [INFO ] [REMOTE ] AVAL: Full fetch complete (15250 records). [2025-10-31T17:21:49.069951] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-31T17:21:49.135416] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-31T17:21:49.218761] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-31T17:21:49.255019] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-31T17:21:49.258479] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-31T17:21:49.258684] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-31T17:21:49.337095] [DEBUG] [LOCAL ] AVA: Trimmed 55559 records to 38493 (keeping 200 days of data) [2025-10-31T17:21:49.625265] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-31T17:21:49.632337] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-31T17:21:49.636161] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-31T17:21:49.637998] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-31T17:21:49.647706] [DEBUG] [LOCAL ] AVAL: Trimmed 15250 records to 8519 (keeping 200 days of data) [2025-10-31T17:21:49.711236] [DEBUG] [LOCAL ] AVAL: Primary data saved (8519 records). [2025-10-31T17:21:49.711389] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-31T17:21:49.711486] [INFO ] [MAIN ] Update Progress: 181/2365 symbols completed. AVAL took 30.7s. Estimated remaining: 4h 22m 31s. Rate: 8.3 symbols/min [2025-10-31T17:21:49.862850] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-31T17:21:49.992571] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:49.998795] [DEBUG] [LOCAL ] AVA: Primary data saved (38493 records). [2025-10-31T17:21:49.998950] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-31T17:21:49.999035] [INFO ] [MAIN ] Update Progress: 182/2365 symbols completed. AVA took 37.0s. Estimated remaining: 4h 21m 1s. Rate: 8.4 symbols/min [2025-10-31T17:21:50.187580] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:50.188183] [DEBUG] [LOCAL ] AVK: Loaded 18543 existing records from primary storage. [2025-10-31T17:21:50.188743] [INFO ] [MAIN ] AVK: Loaded 18543 existing records. [2025-10-31T17:21:50.383604] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:21:50.384260] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-31T17:21:50.384394] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-31T17:21:50.384724] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-31T17:21:50.384797] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-31T17:21:50.502050] [DEBUG] [LOCAL ] AVNS: Loaded 33418 existing records from primary storage. [2025-10-31T17:21:50.503619] [INFO ] [MAIN ] AVNS: Loaded 33418 existing records. [2025-10-31T17:21:50.771459] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-31T17:21:50.885218] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-31T17:21:50.956957] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T17:21:50.992561] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:21:51.008734] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-31T17:21:51.038477] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-31T17:21:51.057473] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-31T17:21:51.059943] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-31T17:21:51.095392] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:51.422436] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:51.457720] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-31T17:21:52.199344] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T17:21:52.257637] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-31T17:21:52.500681] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T17:21:53.057728] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-31T17:21:53.598193] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T17:21:53.615270] [INFO ] [REMOTE ] AVB: Full fetch complete (59806 records). [2025-10-31T17:21:53.615694] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-31T17:21:53.862921] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-31T17:21:53.964520] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T17:21:54.291666] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-31T17:21:54.291782] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-31T17:21:54.292516] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-31T17:21:54.292579] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-31T17:21:54.294156] [DEBUG] [LOCAL ] AVB: Trimmed 59806 records to 42559 (keeping 200 days of data) [2025-10-31T17:21:54.603593] [DEBUG] [LOCAL ] AVB: Primary data saved (42559 records). [2025-10-31T17:21:54.603755] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-31T17:21:54.605401] [INFO ] [MAIN ] Update Progress: 183/2365 symbols completed. AVB took 29.4s. Estimated remaining: 4h 20m 23s. Rate: 8.4 symbols/min [2025-10-31T17:21:54.667174] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-31T17:21:54.780226] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:21:54.826603] [DEBUG] [LOCAL ] AVNT: Loaded 38263 existing records from primary storage. [2025-10-31T17:21:54.832430] [INFO ] [MAIN ] AVNT: Loaded 38263 existing records. [2025-10-31T17:21:54.870724] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:21:55.021742] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:21:55.021948] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-31T17:21:55.021994] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-31T17:21:55.022433] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-31T17:21:55.022488] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-31T17:21:55.372841] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:21:55.457633] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-31T17:21:55.561932] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T17:21:56.257671] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-31T17:21:56.479574] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T17:21:56.988918] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T17:21:57.057664] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-31T17:21:57.857619] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-31T17:21:58.256675] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T17:21:58.642233] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-31T17:21:58.657610] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-31T17:21:59.457633] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-31T17:21:59.529148] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-31T17:22:00.257678] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-31T17:22:00.621902] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T17:22:01.057683] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-31T17:22:01.154818] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-31T17:22:01.857689] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-31T17:22:01.878005] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-31T17:22:02.657715] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-31T17:22:03.074997] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T17:22:03.457690] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-31T17:22:04.127931] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-31T17:22:04.257627] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-31T17:22:04.332987] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-31T17:22:04.337295] [INFO ] [REMOTE ] AVD: Full fetch complete (32036 records). [2025-10-31T17:22:04.337412] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-31T17:22:04.338112] [FATAL] [VALIDATOR ] AVD: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:22:04.338194] [FATAL] [MAIN ] AVD: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:22:04.338258] [WARN ] [MAIN ] AVD: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:22:04.338327] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-31T17:22:04.338389] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-31T17:22:04.338426] [INFO ] [LOCAL ] AVD: Starting deletion of derivative data. [2025-10-31T17:22:04.338466] [DEBUG] [LOCAL ] AVD: No derivative data file found to delete. [2025-10-31T17:22:04.338524] [INFO ] [MAIN ] Update Progress: 184/2365 symbols completed. AVD took 23.9s. Estimated remaining: 4h 20m 46s. Rate: 8.4 symbols/min [2025-10-31T17:22:04.516437] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:22:04.516599] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-10-31T17:22:04.516636] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-10-31T17:22:04.516795] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-31T17:22:04.516876] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-31T17:22:04.516947] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-31T17:22:04.516987] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-31T17:22:04.885976] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:22:05.057674] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-31T17:22:05.398382] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T17:22:05.714970] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T17:22:05.857674] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-31T17:22:06.596121] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T17:22:06.657690] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-31T17:22:07.457688] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-31T17:22:08.240907] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-31T17:22:08.263122] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-31T17:22:08.265050] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T17:22:09.057626] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-31T17:22:09.501007] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T17:22:09.857666] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-31T17:22:10.056139] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-31T17:22:10.545483] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-31T17:22:10.657635] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-31T17:22:11.457704] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-31T17:22:11.868051] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T17:22:12.214591] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-31T17:22:12.257614] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-31T17:22:12.969356] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-31T17:22:13.057671] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-31T17:22:13.857684] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-31T17:22:14.539585] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T17:22:14.657624] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-31T17:22:15.049801] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T17:22:15.457695] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-31T17:22:16.185612] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T17:22:16.257632] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-31T17:22:16.368320] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T17:22:17.049905] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-31T17:22:17.057595] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-31T17:22:17.747543] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-31T17:22:17.857672] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-31T17:22:18.657686] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-31T17:22:18.897244] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T17:22:19.457634] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-31T17:22:19.929457] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T17:22:20.257696] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-31T17:22:20.657491] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T17:22:21.057616] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-31T17:22:21.101534] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-31T17:22:21.857670] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-31T17:22:22.543016] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-31T17:22:22.657635] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-31T17:22:22.920895] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-31T17:22:22.928261] [INFO ] [REMOTE ] AVNS: Full fetch complete (48049 records). [2025-10-31T17:22:22.928380] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-31T17:22:23.309258] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-31T17:22:23.309335] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-31T17:22:23.309916] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-31T17:22:23.309978] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-31T17:22:23.310965] [DEBUG] [LOCAL ] AVNS: Trimmed 48049 records to 33649 (keeping 200 days of data) [2025-10-31T17:22:23.468010] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-31T17:22:23.541730] [DEBUG] [LOCAL ] AVNS: Primary data saved (33649 records). [2025-10-31T17:22:23.541927] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-31T17:22:23.542038] [INFO ] [MAIN ] Update Progress: 185/2365 symbols completed. AVNS took 33.5s. Estimated remaining: 4h 23m 1s. Rate: 8.3 symbols/min [2025-10-31T17:22:23.627280] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-31T17:22:23.669480] [INFO ] [REMOTE ] AVK: Full fetch complete (26646 records). [2025-10-31T17:22:23.675220] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-31T17:22:23.696470] [FATAL] [VALIDATOR ] AVK: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:22:23.721236] [FATAL] [MAIN ] AVK: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:22:23.722249] [WARN ] [MAIN ] AVK: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:22:23.737190] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-31T17:22:23.739827] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:22:23.740240] [DEBUG] [LOCAL ] AVK: No primary data file found to delete. [2025-10-31T17:22:23.740293] [INFO ] [LOCAL ] AVK: Starting deletion of derivative data. [2025-10-31T17:22:23.740423] [DEBUG] [LOCAL ] AVK: Deleted derivative data file. [2025-10-31T17:22:23.740497] [INFO ] [MAIN ] Update Progress: 186/2365 symbols completed. AVK took 34.0s. Estimated remaining: 4h 21m 31s. Rate: 8.3 symbols/min [2025-10-31T17:22:23.921640] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:22:23.921917] [DEBUG] [LOCAL ] AWF: No existing data file found in primary storage. [2025-10-31T17:22:23.922004] [WARN ] [MAIN ] AWF: No existing data found, performing full refresh instead. [2025-10-31T17:22:23.922093] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-31T17:22:23.922134] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-31T17:22:23.922174] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-10-31T17:22:23.922205] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-31T17:22:24.044096] [DEBUG] [LOCAL ] AVY: Loaded 38046 existing records from primary storage. [2025-10-31T17:22:24.055371] [INFO ] [MAIN ] AVY: Loaded 38046 existing records. [2025-10-31T17:22:24.265126] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-31T17:22:24.514258] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:22:24.534451] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-31T17:22:24.534376] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:22:24.534612] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-31T17:22:24.535240] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-31T17:22:24.535296] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-31T17:22:24.889049] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:22:24.920858] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-31T17:22:25.057626] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-31T17:22:25.539038] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T17:22:25.857905] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-31T17:22:26.006193] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T17:22:26.657692] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-31T17:22:27.031087] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-31T17:22:27.457705] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-31T17:22:28.075401] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T17:22:28.257674] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-31T17:22:28.693028] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T17:22:29.057675] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-31T17:22:29.717006] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T17:22:29.857745] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-31T17:22:30.163862] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:22:30.657675] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-31T17:22:31.457708] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-31T17:22:31.933162] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T17:22:31.941444] [INFO ] [REMOTE ] AVNT: Full fetch complete (55891 records). [2025-10-31T17:22:31.941569] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-31T17:22:32.266702] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-31T17:22:32.378936] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-31T17:22:32.379016] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-31T17:22:32.379630] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-31T17:22:32.379714] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-31T17:22:32.380969] [DEBUG] [LOCAL ] AVNT: Trimmed 55891 records to 38514 (keeping 200 days of data) [2025-10-31T17:22:32.642072] [DEBUG] [LOCAL ] AVNT: Primary data saved (38514 records). [2025-10-31T17:22:32.642208] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-31T17:22:32.642981] [INFO ] [MAIN ] Update Progress: 187/2365 symbols completed. AVNT took 38.0s. Estimated remaining: 4h 21m 44s. Rate: 8.3 symbols/min [2025-10-31T17:22:32.853424] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:22:32.881956] [DEBUG] [LOCAL ] AWI: Loaded 25172 existing records from primary storage. [2025-10-31T17:22:32.882226] [INFO ] [MAIN ] AWI: Loaded 25172 existing records. [2025-10-31T17:22:33.105775] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:22:33.106189] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-31T17:22:33.106328] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-31T17:22:33.106560] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-31T17:22:33.106621] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-31T17:22:33.580112] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:22:33.588368] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-31T17:22:33.588983] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-31T17:22:33.605934] [INFO ] [REMOTE ] AVTR: Full fetch complete (77677 records). [2025-10-31T17:22:33.606232] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-31T17:22:33.713726] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T17:22:33.884024] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-31T17:22:34.049042] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-31T17:22:34.049279] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-31T17:22:34.050176] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-31T17:22:34.050242] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-31T17:22:34.051899] [DEBUG] [LOCAL ] AVTR: Trimmed 77677 records to 54350 (keeping 200 days of data) [2025-10-31T17:22:34.167187] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (4.31 seconds). [2025-10-31T17:22:34.394313] [DEBUG] [LOCAL ] AVTR: Primary data saved (54350 records). [2025-10-31T17:22:34.394439] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-31T17:22:34.394516] [INFO ] [MAIN ] Update Progress: 188/2365 symbols completed. AVTR took 30.1s. Estimated remaining: 4h 20m 33s. Rate: 8.4 symbols/min [2025-10-31T17:22:34.575918] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:22:34.588396] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T17:22:34.636290] [DEBUG] [LOCAL ] AWK: Loaded 48611 existing records from primary storage. [2025-10-31T17:22:34.636571] [INFO ] [MAIN ] AWK: Loaded 48611 existing records. [2025-10-31T17:22:34.667030] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-31T17:22:34.815261] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:22:34.815483] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-31T17:22:34.815567] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-31T17:22:34.816039] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-31T17:22:34.816104] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-31T17:22:35.172745] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:22:35.200759] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T17:22:35.352089] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-31T17:22:35.457612] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-31T17:22:36.257631] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-31T17:22:36.352557] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T17:22:37.057669] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-31T17:22:37.498072] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T17:22:37.857718] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-31T17:22:38.302429] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-31T17:22:38.657625] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-31T17:22:38.741452] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:22:39.457675] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-31T17:22:39.583506] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T17:22:40.257691] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-31T17:22:40.351835] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T17:22:41.057724] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-31T17:22:41.495578] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T17:22:41.863384] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-31T17:22:41.888733] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-31T17:22:42.657771] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-31T17:22:42.781075] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-31T17:22:43.422448] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-31T17:22:43.457682] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-31T17:22:44.177902] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T17:22:44.257635] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-31T17:22:44.992732] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T17:22:45.057687] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-31T17:22:45.857677] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-31T17:22:46.253448] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T17:22:46.657666] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-31T17:22:46.963007] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T17:22:47.457671] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-31T17:22:47.532106] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T17:22:48.257688] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-31T17:22:48.606075] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T17:22:49.057678] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-31T17:22:49.468399] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T17:22:49.857661] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-31T17:22:49.891866] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T17:22:50.657672] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-31T17:22:50.900158] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T17:22:51.457693] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-31T17:22:51.988440] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:22:52.257689] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-31T17:22:52.277427] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-31T17:22:53.057615] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-31T17:22:53.098249] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-31T17:22:53.857676] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-31T17:22:54.318663] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T17:22:54.657624] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-31T17:22:54.790180] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T17:22:54.796085] [INFO ] [REMOTE ] AWF: Full fetch complete (35806 records). [2025-10-31T17:22:54.796187] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-31T17:22:55.171801] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-31T17:22:55.171905] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-31T17:22:55.172353] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-31T17:22:55.172393] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-31T17:22:55.173156] [DEBUG] [LOCAL ] AWF: Trimmed 35806 records to 24099 (keeping 200 days of data) [2025-10-31T17:22:55.311413] [DEBUG] [LOCAL ] AWF: Primary data saved (24099 records). [2025-10-31T17:22:55.311533] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-31T17:22:55.311599] [INFO ] [MAIN ] Update Progress: 189/2365 symbols completed. AWF took 31.6s. Estimated remaining: 4h 23m 4s. Rate: 8.3 symbols/min [2025-10-31T17:22:55.465861] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-31T17:22:55.487340] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:22:55.508942] [DEBUG] [LOCAL ] AWP: Loaded 21479 existing records from primary storage. [2025-10-31T17:22:55.509200] [INFO ] [MAIN ] AWP: Loaded 21479 existing records. [2025-10-31T17:22:55.702676] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:22:55.702911] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-31T17:22:55.702968] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-31T17:22:55.703603] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-31T17:22:55.703715] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-31T17:22:56.073402] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:22:56.101174] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-31T17:22:56.110890] [INFO ] [REMOTE ] AVY: Full fetch complete (56589 records). [2025-10-31T17:22:56.111068] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-31T17:22:56.276589] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-31T17:22:56.491578] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-31T17:22:56.491687] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-31T17:22:56.492345] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-31T17:22:56.492393] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-31T17:22:56.493569] [DEBUG] [LOCAL ] AVY: Trimmed 56589 records to 38317 (keeping 200 days of data) [2025-10-31T17:22:56.726931] [DEBUG] [LOCAL ] AVY: Primary data saved (38317 records). [2025-10-31T17:22:56.727080] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-31T17:22:56.727156] [INFO ] [MAIN ] Update Progress: 190/2365 symbols completed. AVY took 33.2s. Estimated remaining: 4h 21m 50s. Rate: 8.3 symbols/min [2025-10-31T17:22:56.899995] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:22:56.921543] [DEBUG] [LOCAL ] AWR: Loaded 22593 existing records from primary storage. [2025-10-31T17:22:56.921839] [INFO ] [MAIN ] AWR: Loaded 22593 existing records. [2025-10-31T17:22:57.058149] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-31T17:22:57.114355] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:22:57.115825] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-31T17:22:57.115990] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-31T17:22:57.116227] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-31T17:22:57.116345] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-31T17:22:57.463121] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-31T17:22:57.544585] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:22:57.563352] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T17:22:57.857685] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-31T17:22:58.063394] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T17:22:58.635359] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T17:22:58.657616] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-31T17:22:59.457694] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-31T17:23:00.257707] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-31T17:23:01.057709] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-31T17:23:04.668762] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (6.01 seconds). [2025-10-31T17:23:04.674705] [INFO ] [REMOTE ] AWI: Full fetch complete (36542 records). [2025-10-31T17:23:04.674800] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-31T17:23:05.070443] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-31T17:23:05.081979] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (4.82 seconds). [2025-10-31T17:23:05.078987] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-31T17:23:05.086620] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-31T17:23:05.087191] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-31T17:23:05.088171] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-31T17:23:05.089766] [DEBUG] [LOCAL ] AWI: Trimmed 36542 records to 25363 (keeping 200 days of data) [2025-10-31T17:23:05.192153] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (5.73 seconds). [2025-10-31T17:23:05.199854] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-31T17:23:05.265034] [DEBUG] [LOCAL ] AWI: Primary data saved (25363 records). [2025-10-31T17:23:05.265155] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-31T17:23:05.265232] [INFO ] [MAIN ] Update Progress: 191/2365 symbols completed. AWI took 32.6s. Estimated remaining: 4h 21m 58s. Rate: 8.3 symbols/min [2025-10-31T17:23:05.431440] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:23:05.457429] [DEBUG] [LOCAL ] AX: Loaded 27338 existing records from primary storage. [2025-10-31T17:23:05.457703] [INFO ] [MAIN ] AX: Loaded 27338 existing records. [2025-10-31T17:23:05.632250] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:23:05.632497] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-31T17:23:05.632558] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-31T17:23:05.632828] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-31T17:23:05.632899] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-31T17:23:05.993453] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:23:05.993841] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-31T17:23:06.201723] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T17:23:06.206361] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-31T17:23:06.236891] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T17:23:06.242041] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-31T17:23:06.683373] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (5.63 seconds). [2025-10-31T17:23:06.694508] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-31T17:23:06.959766] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-31T17:23:06.965072] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-31T17:23:07.126697] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:23:07.225949] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-31T17:23:07.457622] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-31T17:23:07.779222] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T17:23:08.225102] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-31T17:23:08.257689] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-31T17:23:08.421124] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-31T17:23:09.057637] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-31T17:23:09.133529] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T17:23:09.857690] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-31T17:23:10.016095] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T17:23:10.657677] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-31T17:23:11.309987] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T17:23:11.457622] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-31T17:23:11.569725] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-31T17:23:11.580699] [INFO ] [REMOTE ] AWK: Full fetch complete (70943 records). [2025-10-31T17:23:11.580831] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-31T17:23:11.985812] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-31T17:23:11.985893] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-31T17:23:11.986686] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-31T17:23:11.986802] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-31T17:23:11.988261] [DEBUG] [LOCAL ] AWK: Trimmed 70943 records to 48987 (keeping 200 days of data) [2025-10-31T17:23:12.273563] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-31T17:23:12.293744] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T17:23:12.313758] [DEBUG] [LOCAL ] AWK: Primary data saved (48987 records). [2025-10-31T17:23:12.313859] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-31T17:23:12.314472] [INFO ] [MAIN ] Update Progress: 192/2365 symbols completed. AWK took 37.9s. Estimated remaining: 4h 21m 49s. Rate: 8.3 symbols/min [2025-10-31T17:23:12.477274] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:23:12.525248] [DEBUG] [LOCAL ] AXL: Loaded 50854 existing records from primary storage. [2025-10-31T17:23:12.525539] [INFO ] [MAIN ] AXL: Loaded 50854 existing records. [2025-10-31T17:23:12.697422] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:23:12.697638] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-31T17:23:12.697729] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-31T17:23:12.698001] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-31T17:23:12.698056] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-31T17:23:13.041794] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:23:13.057605] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-31T17:23:13.397001] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T17:23:13.857696] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-31T17:23:14.309170] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T17:23:14.645488] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-31T17:23:14.657596] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-31T17:23:15.395359] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-31T17:23:15.457614] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-31T17:23:16.239969] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T17:23:16.257609] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-31T17:23:17.063125] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-31T17:23:17.065205] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-31T17:23:17.857687] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-31T17:23:18.328350] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T17:23:18.499810] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T17:23:18.657626] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-31T17:23:19.457676] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-31T17:23:19.683422] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-31T17:23:19.688076] [INFO ] [REMOTE ] AWP: Full fetch complete (31267 records). [2025-10-31T17:23:19.688163] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-31T17:23:20.074475] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-31T17:23:20.074559] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-31T17:23:20.075022] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-31T17:23:20.075090] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-31T17:23:20.075889] [DEBUG] [LOCAL ] AWP: Trimmed 31267 records to 21663 (keeping 200 days of data) [2025-10-31T17:23:20.209402] [DEBUG] [LOCAL ] AWP: Primary data saved (21663 records). [2025-10-31T17:23:20.209536] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-31T17:23:20.209616] [INFO ] [MAIN ] Update Progress: 193/2365 symbols completed. AWP took 24.9s. Estimated remaining: 4h 21m 49s. Rate: 8.3 symbols/min [2025-10-31T17:23:20.260976] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-31T17:23:20.409483] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:23:20.455385] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T17:23:20.479446] [DEBUG] [LOCAL ] AXP: Loaded 53476 existing records from primary storage. [2025-10-31T17:23:20.479859] [INFO ] [MAIN ] AXP: Loaded 53476 existing records. [2025-10-31T17:23:20.659002] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:23:20.659211] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-31T17:23:20.659258] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-31T17:23:20.659554] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-31T17:23:20.659591] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-31T17:23:21.001538] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:23:21.057672] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-31T17:23:21.126925] [DEBUG] [REMOTE ] AWR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-31T17:23:21.127179] [WARN ] [REMOTE ] AWR: No data returned for month 2025-07 [2025-10-31T17:23:21.127263] [FATAL] [REMOTE ] AWR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:23:21.127339] [FATAL] [MAIN ] AWR: Failed to fetch primary data. [2025-10-31T17:23:21.127400] [WARN ] [MAIN ] AWR: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:23:21.127470] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-31T17:23:21.127531] [DEBUG] [LOCAL ] AWR: No primary data file found to delete. [2025-10-31T17:23:21.127565] [INFO ] [LOCAL ] AWR: Starting deletion of derivative data. [2025-10-31T17:23:21.127735] [DEBUG] [LOCAL ] AWR: Deleted derivative data file. [2025-10-31T17:23:21.127814] [INFO ] [MAIN ] Update Progress: 194/2365 symbols completed. AWR took 24.4s. Estimated remaining: 4h 20m 31s. Rate: 8.3 symbols/min [2025-10-31T17:23:21.301327] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:23:21.320496] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T17:23:21.328493] [DEBUG] [LOCAL ] AXR: Loaded 2759 existing records from primary storage. [2025-10-31T17:23:21.329085] [INFO ] [MAIN ] AXR: Loaded 2759 existing records. [2025-10-31T17:23:21.503251] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:23:21.503500] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-31T17:23:21.503552] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-31T17:23:21.503726] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-31T17:23:21.503784] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-31T17:23:21.865627] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-31T17:23:21.865553] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:23:22.657667] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-31T17:23:23.242424] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T17:23:23.327704] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-31T17:23:23.457638] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-31T17:23:24.257719] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-31T17:23:25.057611] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-31T17:23:25.518412] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T17:23:25.566560] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-31T17:23:25.857614] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-31T17:23:25.887842] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T17:23:26.657684] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-31T17:23:27.147763] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-31T17:23:27.457688] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-31T17:23:27.645193] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-31T17:23:28.257734] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-31T17:23:28.618172] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T17:23:29.057690] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-31T17:23:29.857630] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-31T17:23:30.045627] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-31T17:23:30.193632] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-31T17:23:30.437825] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T17:23:30.657661] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-31T17:23:31.457674] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-31T17:23:31.992261] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T17:23:32.257672] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-31T17:23:32.550839] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-31T17:23:32.556877] [INFO ] [REMOTE ] AX: Full fetch complete (41682 records). [2025-10-31T17:23:32.556967] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-31T17:23:32.668391] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-31T17:23:32.931466] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-31T17:23:32.931542] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-31T17:23:32.932082] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-31T17:23:32.932148] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-31T17:23:32.933021] [DEBUG] [LOCAL ] AX: Trimmed 41682 records to 27618 (keeping 200 days of data) [2025-10-31T17:23:33.061410] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-31T17:23:33.089215] [DEBUG] [LOCAL ] AX: Primary data saved (27618 records). [2025-10-31T17:23:33.089309] [INFO ] [MAIN ] AX: Full history saved. [2025-10-31T17:23:33.089379] [INFO ] [MAIN ] Update Progress: 195/2365 symbols completed. AX took 27.8s. Estimated remaining: 4h 21m 17s. Rate: 8.3 symbols/min [2025-10-31T17:23:33.263897] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:23:33.301604] [DEBUG] [LOCAL ] AXS: Loaded 39085 existing records from primary storage. [2025-10-31T17:23:33.301894] [INFO ] [MAIN ] AXS: Loaded 39085 existing records. [2025-10-31T17:23:33.477747] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:23:33.477993] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-31T17:23:33.478051] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-31T17:23:33.478237] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-31T17:23:33.478274] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-31T17:23:33.829532] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:23:33.857616] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-31T17:23:34.657676] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-31T17:23:34.842839] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-31T17:23:34.938631] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T17:23:35.074500] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-31T17:23:35.457719] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-31T17:23:36.257719] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-31T17:23:36.598833] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-31T17:23:36.950776] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T17:23:37.057674] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-31T17:23:37.857692] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-31T17:23:38.042886] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T17:23:38.657696] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-31T17:23:39.325710] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T17:23:39.457671] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-31T17:23:39.717204] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T17:23:40.257683] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-31T17:23:40.863678] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T17:23:41.057628] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-31T17:23:41.857629] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-31T17:23:41.947180] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-31T17:23:42.376784] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T17:23:42.388811] [INFO ] [REMOTE ] AXL: Full fetch complete (73261 records). [2025-10-31T17:23:42.388969] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-31T17:23:42.667352] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-31T17:23:42.777437] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-31T17:23:42.777531] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-31T17:23:42.778342] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-31T17:23:42.778406] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-31T17:23:42.779839] [DEBUG] [LOCAL ] AXL: Trimmed 73261 records to 51226 (keeping 200 days of data) [2025-10-31T17:23:43.024156] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T17:23:43.122083] [DEBUG] [LOCAL ] AXL: Primary data saved (51226 records). [2025-10-31T17:23:43.122221] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-31T17:23:43.123082] [INFO ] [MAIN ] Update Progress: 196/2365 symbols completed. AXL took 30.8s. Estimated remaining: 4h 21m 41s. Rate: 8.3 symbols/min [2025-10-31T17:23:43.321215] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:23:43.317196] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T17:23:43.375039] [DEBUG] [LOCAL ] AXTA: Loaded 52690 existing records from primary storage. [2025-10-31T17:23:43.375351] [INFO ] [MAIN ] AXTA: Loaded 52690 existing records. [2025-10-31T17:23:43.462765] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-31T17:23:43.574629] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:23:43.574876] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-31T17:23:43.574923] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-31T17:23:43.575197] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-31T17:23:43.575235] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-31T17:23:43.929559] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:23:44.257733] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-31T17:23:44.491009] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T17:23:44.589358] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-31T17:23:45.057625] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-31T17:23:45.367753] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-31T17:23:45.857616] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-31T17:23:46.283690] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-31T17:23:46.657683] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-31T17:23:47.457694] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-31T17:23:47.854517] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-31T17:23:47.863245] [INFO ] [REMOTE ] AXR: Full fetch complete (4190 records). [2025-10-31T17:23:47.876605] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-31T17:23:47.946971] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T17:23:48.261161] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-31T17:23:48.267452] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-31T17:23:48.267546] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-31T17:23:48.267741] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-31T17:23:48.267803] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-31T17:23:48.268188] [DEBUG] [LOCAL ] AXR: Trimmed 4190 records to 2769 (keeping 200 days of data) [2025-10-31T17:23:48.284210] [DEBUG] [LOCAL ] AXR: Primary data saved (2769 records). [2025-10-31T17:23:48.284269] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-31T17:23:48.284341] [INFO ] [MAIN ] Update Progress: 197/2365 symbols completed. AXR took 27.2s. Estimated remaining: 4h 21m 11s. Rate: 8.3 symbols/min [2025-10-31T17:23:49.057672] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-31T17:23:49.665029] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T17:23:49.857830] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-31T17:23:50.093309] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T17:23:50.657739] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-31T17:23:51.008294] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T17:23:51.457702] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-31T17:23:52.257713] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-31T17:23:52.419486] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-31T17:23:52.467956] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-31T17:23:53.057692] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-31T17:23:53.465183] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T17:23:53.857683] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-31T17:23:54.486210] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:23:54.657730] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-31T17:23:55.110730] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T17:23:55.457707] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-31T17:23:56.257635] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-31T17:23:56.391812] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-31T17:23:56.658776] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T17:23:57.057680] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-31T17:23:57.424269] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T17:23:57.659079] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T17:23:57.670941] [INFO ] [REMOTE ] AXP: Full fetch complete (77058 records). [2025-10-31T17:23:57.671081] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-31T17:23:57.865387] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-31T17:23:58.066039] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-31T17:23:58.066119] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-31T17:23:58.066949] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-31T17:23:58.067013] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-31T17:23:58.068412] [DEBUG] [LOCAL ] AXP: Trimmed 77058 records to 53860 (keeping 200 days of data) [2025-10-31T17:23:58.412972] [DEBUG] [LOCAL ] AXP: Primary data saved (53860 records). [2025-10-31T17:23:58.413119] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-31T17:23:58.414083] [INFO ] [MAIN ] Update Progress: 198/2365 symbols completed. AXP took 38.2s. Estimated remaining: 4h 21m 35s. Rate: 8.3 symbols/min [2025-10-31T17:23:58.657699] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-31T17:23:59.087222] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T17:23:59.457721] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-31T17:24:00.082610] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T17:24:00.092404] [INFO ] [REMOTE ] AXS: Full fetch complete (56495 records). [2025-10-31T17:24:00.092538] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-31T17:24:00.477998] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-31T17:24:00.478098] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-31T17:24:00.478752] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-31T17:24:00.478834] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-31T17:24:00.479926] [DEBUG] [LOCAL ] AXS: Trimmed 56495 records to 39401 (keeping 200 days of data) [2025-10-31T17:24:00.729254] [DEBUG] [LOCAL ] AXS: Primary data saved (39401 records). [2025-10-31T17:24:00.729424] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-31T17:24:00.730681] [INFO ] [MAIN ] Update Progress: 199/2365 symbols completed. AXS took 27.6s. Estimated remaining: 4h 20m 34s. Rate: 8.3 symbols/min [2025-10-31T17:24:01.355767] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-31T17:24:01.370303] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-31T17:24:02.713408] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T17:24:02.724197] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-31T17:24:03.991733] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T17:24:04.002994] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-31T17:24:05.602142] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T17:24:05.614014] [INFO ] [REMOTE ] AXTA: Full fetch complete (75232 records). [2025-10-31T17:24:05.614173] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-31T17:24:05.614971] [FATAL] [VALIDATOR ] AXTA: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:24:05.615060] [FATAL] [MAIN ] AXTA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:24:05.615101] [WARN ] [MAIN ] AXTA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:24:05.615138] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-31T17:24:05.615193] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-31T17:24:05.615227] [INFO ] [LOCAL ] AXTA: Starting deletion of derivative data. [2025-10-31T17:24:05.615399] [DEBUG] [LOCAL ] AXTA: Deleted derivative data file. [2025-10-31T17:24:05.615485] [INFO ] [MAIN ] Update Progress: 200/2365 symbols completed. AXTA took 22.5s. Estimated remaining: 4h 20m 2s. Rate: 8.3 symbols/min [2025-10-31T17:24:06.345338] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:06.365384] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:06.352618] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:06.366387] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-31T17:24:06.366909] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-31T17:24:06.387247] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-31T17:24:06.387141] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:06.387706] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-31T17:24:06.388508] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-31T17:24:06.388572] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-31T17:24:06.540177] [DEBUG] [LOCAL ] AZO: Loaded 10681 existing records from primary storage. [2025-10-31T17:24:06.540573] [DEBUG] [LOCAL ] AZZ: Loaded 23132 existing records from primary storage. [2025-10-31T17:24:06.547530] [INFO ] [MAIN ] AZO: Loaded 10681 existing records. [2025-10-31T17:24:06.549182] [DEBUG] [LOCAL ] AYI: Loaded 23482 existing records from primary storage. [2025-10-31T17:24:06.554705] [INFO ] [MAIN ] AZZ: Loaded 23132 existing records. [2025-10-31T17:24:06.555034] [INFO ] [MAIN ] AYI: Loaded 23482 existing records. [2025-10-31T17:24:07.317208] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:07.370330] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:07.374627] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:07.385323] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-31T17:24:07.395825] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-31T17:24:07.401137] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-31T17:24:07.401273] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-31T17:24:07.401424] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-31T17:24:07.414233] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-31T17:24:07.441722] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-31T17:24:07.449707] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-31T17:24:07.455078] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-31T17:24:07.449803] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-31T17:24:07.456751] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-31T17:24:07.476027] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:07.527286] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-31T17:24:07.537726] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-31T17:24:08.414563] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:08.436325] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-31T17:24:08.543881] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:08.569561] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-31T17:24:08.653006] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:08.654062] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-31T17:24:08.676146] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T17:24:08.683514] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-31T17:24:08.825668] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:24:08.826225] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-31T17:24:08.826352] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:24:08.826466] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-31T17:24:08.826556] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:24:08.826683] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-31T17:24:08.826797] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-31T17:24:08.826861] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-31T17:24:08.826950] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-31T17:24:08.827046] [INFO ] [MAIN ] Update Progress: 201/2365 symbols completed. B took 3.2s. Estimated remaining: 4h 19m 12s. Rate: 8.3 symbols/min [2025-10-31T17:24:09.054929] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:09.118732] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-31T17:24:09.119275] [INFO ] [MAIN ] BA: Loaded 54180 existing records. [2025-10-31T17:24:09.324688] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:09.325034] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-31T17:24:09.325095] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-31T17:24:09.325351] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-31T17:24:09.325407] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-31T17:24:09.517533] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T17:24:09.531838] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-31T17:24:09.768886] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T17:24:09.778911] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-31T17:24:09.772915] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:09.789128] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-31T17:24:09.802302] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T17:24:09.811420] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-31T17:24:10.117539] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T17:24:10.121322] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-31T17:24:10.541094] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-31T17:24:10.607894] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T17:24:10.657734] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-31T17:24:10.906278] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-31T17:24:11.457715] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-31T17:24:11.543622] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-31T17:24:11.675794] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T17:24:12.095854] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T17:24:12.257705] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-31T17:24:12.858742] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-31T17:24:13.057667] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-31T17:24:13.702248] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-31T17:24:13.857725] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-31T17:24:14.517983] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T17:24:14.657748] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-31T17:24:15.457705] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-31T17:24:15.660212] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-31T17:24:16.048265] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T17:24:16.257692] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-31T17:24:17.057698] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-31T17:24:17.753388] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T17:24:17.857625] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-31T17:24:17.994554] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-31T17:24:18.657666] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-31T17:24:18.709223] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T17:24:18.713630] [INFO ] [REMOTE ] AZO: Full fetch complete (16099 records). [2025-10-31T17:24:18.713801] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-31T17:24:19.079861] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-31T17:24:19.079956] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-31T17:24:19.080248] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-31T17:24:19.080287] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-31T17:24:19.080782] [DEBUG] [LOCAL ] AZO: Trimmed 16099 records to 10763 (keeping 200 days of data) [2025-10-31T17:24:19.144823] [DEBUG] [LOCAL ] AZO: Primary data saved (10763 records). [2025-10-31T17:24:19.144942] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-31T17:24:19.145017] [INFO ] [MAIN ] Update Progress: 202/2365 symbols completed. AZO took 13.5s. Estimated remaining: 4h 19m 38s. Rate: 8.3 symbols/min [2025-10-31T17:24:19.313499] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:19.357211] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T17:24:19.384264] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-31T17:24:19.384578] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-10-31T17:24:19.462714] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-31T17:24:19.568576] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:19.568862] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-31T17:24:19.568917] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-31T17:24:19.569268] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-31T17:24:19.569308] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-31T17:24:19.930469] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:20.257669] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-31T17:24:20.491106] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T17:24:21.057675] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-31T17:24:21.857619] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-31T17:24:21.929407] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-31T17:24:22.188567] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-31T17:24:22.657683] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-31T17:24:23.457728] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-31T17:24:23.645831] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-31T17:24:23.859817] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-31T17:24:24.257698] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-31T17:24:24.977345] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T17:24:25.057713] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-31T17:24:25.348507] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-31T17:24:25.792783] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T17:24:25.857669] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-31T17:24:26.657709] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-31T17:24:26.845345] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T17:24:26.850854] [INFO ] [REMOTE ] AYI: Full fetch complete (35798 records). [2025-10-31T17:24:26.850979] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-31T17:24:27.237248] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-31T17:24:27.237351] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-31T17:24:27.237853] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-31T17:24:27.237916] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-31T17:24:27.238766] [DEBUG] [LOCAL ] AYI: Trimmed 35798 records to 23591 (keeping 200 days of data) [2025-10-31T17:24:27.389432] [DEBUG] [LOCAL ] AYI: Primary data saved (23591 records). [2025-10-31T17:24:27.389692] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-31T17:24:27.394998] [INFO ] [MAIN ] Update Progress: 203/2365 symbols completed. AYI took 21.8s. Estimated remaining: 4h 19m 42s. Rate: 8.3 symbols/min [2025-10-31T17:24:27.437138] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-31T17:24:27.462839] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-31T17:24:27.588691] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:27.638682] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-31T17:24:27.638992] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-10-31T17:24:27.825605] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:27.825832] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-31T17:24:27.825878] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-31T17:24:27.826087] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-31T17:24:27.826141] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-31T17:24:28.188502] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:28.257615] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-31T17:24:29.057685] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-31T17:24:29.600015] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-31T17:24:29.857711] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-31T17:24:29.988213] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-31T17:24:30.627443] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-31T17:24:30.657629] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-31T17:24:31.010430] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-31T17:24:31.327926] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T17:24:31.457712] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-31T17:24:32.257724] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-31T17:24:32.459915] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-31T17:24:33.057689] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-31T17:24:33.834934] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-31T17:24:33.857604] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-31T17:24:34.110632] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-31T17:24:34.601804] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T17:24:34.657682] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-31T17:24:35.457629] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-31T17:24:35.671373] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T17:24:35.678085] [INFO ] [REMOTE ] AZZ: Full fetch complete (32154 records). [2025-10-31T17:24:35.678203] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-31T17:24:36.043097] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-31T17:24:36.043173] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-31T17:24:36.043595] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-31T17:24:36.043635] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-31T17:24:36.044443] [DEBUG] [LOCAL ] AZZ: Trimmed 32154 records to 23251 (keeping 200 days of data) [2025-10-31T17:24:36.192085] [DEBUG] [LOCAL ] AZZ: Primary data saved (23251 records). [2025-10-31T17:24:36.192213] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-31T17:24:36.192320] [INFO ] [MAIN ] Update Progress: 204/2365 symbols completed. AZZ took 30.6s. Estimated remaining: 4h 19m 52s. Rate: 8.3 symbols/min [2025-10-31T17:24:36.262913] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-31T17:24:36.370613] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:36.425837] [DEBUG] [LOCAL ] BAH: Loaded 52030 existing records from primary storage. [2025-10-31T17:24:36.426167] [INFO ] [MAIN ] BAH: Loaded 52030 existing records. [2025-10-31T17:24:36.606520] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:36.606771] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-31T17:24:36.606821] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-31T17:24:36.607016] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-31T17:24:36.607056] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-31T17:24:36.960439] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:37.057630] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-31T17:24:37.874402] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-31T17:24:37.903761] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-31T17:24:38.474992] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-31T17:24:38.657625] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-31T17:24:38.718241] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-31T17:24:39.457726] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-31T17:24:40.078252] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-31T17:24:40.257629] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-31T17:24:40.513851] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-31T17:24:40.724632] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T17:24:41.057707] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-31T17:24:41.857700] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-31T17:24:42.171388] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-31T17:24:42.657710] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-31T17:24:43.236706] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T17:24:43.457718] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-31T17:24:43.651712] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-31T17:24:44.257720] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-31T17:24:44.716537] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-31T17:24:44.774569] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T17:24:45.057666] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-31T17:24:45.857716] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-31T17:24:46.179936] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-31T17:24:46.657681] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-31T17:24:46.839153] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-31T17:24:47.457633] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-31T17:24:47.577314] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-31T17:24:48.257681] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-31T17:24:48.657274] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-31T17:24:49.057666] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-31T17:24:49.090296] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-31T17:24:49.857687] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-31T17:24:50.435841] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-31T17:24:50.657702] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-31T17:24:51.240298] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-31T17:24:51.457686] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-31T17:24:51.631188] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-31T17:24:51.840352] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T17:24:52.257703] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-31T17:24:52.295558] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-31T17:24:52.314113] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-31T17:24:52.314359] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-31T17:24:52.723684] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-31T17:24:52.723783] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-31T17:24:52.724625] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-31T17:24:52.724716] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-31T17:24:52.726164] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 54570 (keeping 200 days of data) [2025-10-31T17:24:53.058142] [DEBUG] [LOCAL ] BA: Primary data saved (54570 records). [2025-10-31T17:24:53.058334] [INFO ] [MAIN ] BA: Full history saved. [2025-10-31T17:24:53.058507] [INFO ] [MAIN ] Update Progress: 205/2365 symbols completed. BA took 44.2s. Estimated remaining: 4h 21m 26s. Rate: 8.3 symbols/min [2025-10-31T17:24:53.057991] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-31T17:24:53.238861] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:53.275258] [DEBUG] [LOCAL ] BAK: Loaded 39381 existing records from primary storage. [2025-10-31T17:24:53.275546] [INFO ] [MAIN ] BAK: Loaded 39381 existing records. [2025-10-31T17:24:53.456113] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:53.456322] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-31T17:24:53.456368] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-31T17:24:53.456574] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-31T17:24:53.456673] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-31T17:24:53.806217] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:24:53.857672] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-31T17:24:54.301169] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-31T17:24:54.437179] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T17:24:54.657638] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-31T17:24:55.457718] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-31T17:24:55.861598] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-31T17:24:55.912313] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T17:24:56.257674] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-31T17:24:57.062884] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-31T17:24:57.080942] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-31T17:24:57.475346] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T17:24:57.857702] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-31T17:24:58.399636] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-31T17:24:58.421975] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-31T17:24:58.422162] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-31T17:24:58.668233] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-31T17:24:58.835992] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-31T17:24:58.836078] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-31T17:24:58.836870] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-31T17:24:58.836939] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-31T17:24:58.838426] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 54588 (keeping 200 days of data) [2025-10-31T17:24:59.165953] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-10-31T17:24:59.166089] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-31T17:24:59.166164] [INFO ] [MAIN ] Update Progress: 206/2365 symbols completed. BAC took 31.8s. Estimated remaining: 4h 21m 7s. Rate: 8.3 symbols/min [2025-10-31T17:24:59.340959] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:24:59.390240] [DEBUG] [LOCAL ] BALL: Loaded 52278 existing records from primary storage. [2025-10-31T17:24:59.403249] [INFO ] [MAIN ] BALL: Loaded 52278 existing records. [2025-10-31T17:24:59.462856] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-31T17:24:59.512822] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-31T17:24:59.629347] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:24:59.629592] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-31T17:24:59.629674] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-31T17:24:59.630055] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-31T17:24:59.630112] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-31T17:24:59.976840] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:25:00.257685] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-31T17:25:00.570577] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-31T17:25:00.582508] [INFO ] [REMOTE ] BAH: Full fetch complete (75347 records). [2025-10-31T17:25:00.582678] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-31T17:25:00.987333] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-31T17:25:00.987474] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-31T17:25:00.988476] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-31T17:25:00.988541] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-31T17:25:00.989941] [DEBUG] [LOCAL ] BAH: Trimmed 75347 records to 52419 (keeping 200 days of data) [2025-10-31T17:25:01.081677] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-31T17:25:01.130297] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-31T17:25:01.373781] [DEBUG] [LOCAL ] BAH: Primary data saved (52419 records). [2025-10-31T17:25:01.373962] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-31T17:25:01.375413] [INFO ] [MAIN ] Update Progress: 207/2365 symbols completed. BAH took 25.2s. Estimated remaining: 4h 20m 7s. Rate: 8.3 symbols/min [2025-10-31T17:25:01.567257] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:25:01.567435] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-31T17:25:01.567475] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-31T17:25:01.567594] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-31T17:25:01.567637] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-31T17:25:01.567729] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-31T17:25:01.567767] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-31T17:25:01.861042] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-31T17:25:02.044812] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:25:02.091435] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-31T17:25:02.657677] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-31T17:25:02.964043] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T17:25:03.457710] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-31T17:25:03.649624] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-31T17:25:03.662298] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-31T17:25:03.662715] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-31T17:25:04.096406] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-31T17:25:04.096742] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-31T17:25:04.098063] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-31T17:25:04.098413] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-31T17:25:04.132880] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T17:25:04.142986] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-31T17:25:04.268884] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-31T17:25:04.552125] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-10-31T17:25:04.552388] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-31T17:25:04.553549] [INFO ] [MAIN ] Update Progress: 208/2365 symbols completed. BABA took 45.4s. Estimated remaining: 4h 19m 18s. Rate: 8.3 symbols/min [2025-10-31T17:25:04.692036] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T17:25:04.804369] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:25:04.876878] [DEBUG] [LOCAL ] BAM: Loaded 52453 existing records from primary storage. [2025-10-31T17:25:04.877426] [INFO ] [MAIN ] BAM: Loaded 52453 existing records. [2025-10-31T17:25:05.064547] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-31T17:25:05.094624] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:25:05.095169] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-31T17:25:05.095230] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-31T17:25:05.095600] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-31T17:25:05.095687] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-31T17:25:05.513715] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:25:05.706734] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-31T17:25:05.857636] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-31T17:25:06.255962] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T17:25:06.657689] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-31T17:25:07.127693] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T17:25:07.457636] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-31T17:25:08.257723] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-31T17:25:08.443716] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T17:25:08.496975] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-31T17:25:09.057680] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-31T17:25:09.411875] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-31T17:25:09.463172] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-31T17:25:09.857678] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-31T17:25:10.657760] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-31T17:25:11.151391] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T17:25:11.213052] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T17:25:11.457667] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-31T17:25:12.257684] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-31T17:25:12.922092] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-31T17:25:13.057675] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-31T17:25:13.772600] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T17:25:13.857669] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-31T17:25:14.369789] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T17:25:14.657634] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-31T17:25:14.942774] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T17:25:15.457684] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-31T17:25:15.923564] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-31T17:25:16.020538] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T17:25:16.257682] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-31T17:25:17.057668] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-31T17:25:17.425466] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T17:25:17.857636] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-31T17:25:18.305976] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T17:25:18.657671] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-31T17:25:18.798085] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-31T17:25:19.364928] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-31T17:25:19.457684] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-31T17:25:20.257675] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-31T17:25:20.928951] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T17:25:21.057621] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-31T17:25:21.441736] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T17:25:21.857689] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-31T17:25:22.353557] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T17:25:22.379147] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T17:25:22.657638] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-31T17:25:22.718246] [DEBUG] [REMOTE ] BALY: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-31T17:25:22.718563] [WARN ] [REMOTE ] BALY: No data returned for month 2025-07 [2025-10-31T17:25:22.718678] [FATAL] [REMOTE ] BALY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:25:22.718769] [FATAL] [MAIN ] BALY: Failed to fetch primary data. [2025-10-31T17:25:22.718831] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:25:22.718901] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-31T17:25:22.718964] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-31T17:25:22.718999] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-31T17:25:22.719037] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-31T17:25:22.719084] [INFO ] [MAIN ] Update Progress: 209/2365 symbols completed. BALY took 21.3s. Estimated remaining: 4h 21m 3s. Rate: 8.3 symbols/min [2025-10-31T17:25:22.896052] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:25:22.949554] [DEBUG] [LOCAL ] BANC: Loaded 51761 existing records from primary storage. [2025-10-31T17:25:22.949925] [INFO ] [MAIN ] BANC: Loaded 51761 existing records. [2025-10-31T17:25:23.132085] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:25:23.132312] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-31T17:25:23.132358] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-31T17:25:23.132909] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-31T17:25:23.132965] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-31T17:25:23.462772] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-31T17:25:23.542920] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:25:24.257753] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-31T17:25:24.798722] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T17:25:24.807337] [INFO ] [REMOTE ] BAK: Full fetch complete (56475 records). [2025-10-31T17:25:24.807445] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-31T17:25:24.808228] [FATAL] [VALIDATOR ] BAK: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:25:24.808338] [FATAL] [MAIN ] BAK: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:25:24.808406] [WARN ] [MAIN ] BAK: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:25:24.808480] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-31T17:25:24.808542] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-10-31T17:25:24.808578] [INFO ] [LOCAL ] BAK: Starting deletion of derivative data. [2025-10-31T17:25:24.808740] [DEBUG] [LOCAL ] BAK: Deleted derivative data file. [2025-10-31T17:25:24.808829] [INFO ] [MAIN ] Update Progress: 210/2365 symbols completed. BAK took 31.8s. Estimated remaining: 4h 20m 3s. Rate: 8.3 symbols/min [2025-10-31T17:25:24.982670] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:25:25.006321] [DEBUG] [LOCAL ] BAP: Loaded 25204 existing records from primary storage. [2025-10-31T17:25:25.006563] [INFO ] [MAIN ] BAP: Loaded 25204 existing records. [2025-10-31T17:25:25.066108] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-31T17:25:25.197500] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:25:25.197737] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-31T17:25:25.197788] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-31T17:25:25.198025] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-31T17:25:25.198080] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-31T17:25:25.556234] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:25:25.587581] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:25:25.857726] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-31T17:25:26.431276] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T17:25:26.657728] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-31T17:25:26.870711] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T17:25:27.457628] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-31T17:25:27.601115] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-31T17:25:28.257699] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-31T17:25:28.703023] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-31T17:25:29.054011] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T17:25:29.058728] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-31T17:25:29.857710] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-31T17:25:30.281595] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T17:25:30.615026] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-31T17:25:30.630090] [INFO ] [REMOTE ] BALL: Full fetch complete (75623 records). [2025-10-31T17:25:30.630274] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-31T17:25:30.662855] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-31T17:25:31.020719] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-31T17:25:31.021013] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-31T17:25:31.021890] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-31T17:25:31.021962] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-31T17:25:31.023464] [DEBUG] [LOCAL ] BALL: Trimmed 75623 records to 52668 (keeping 200 days of data) [2025-10-31T17:25:31.394221] [DEBUG] [LOCAL ] BALL: Primary data saved (52668 records). [2025-10-31T17:25:31.394403] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-31T17:25:31.394524] [INFO ] [MAIN ] Update Progress: 211/2365 symbols completed. BALL took 32.2s. Estimated remaining: 4h 19m 49s. Rate: 8.3 symbols/min [2025-10-31T17:25:31.463866] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-31T17:25:31.671312] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:25:31.728241] [DEBUG] [LOCAL ] BARK: Loaded 38484 existing records from primary storage. [2025-10-31T17:25:31.728686] [INFO ] [MAIN ] BARK: Loaded 38484 existing records. [2025-10-31T17:25:31.976923] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:25:31.977173] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-31T17:25:31.977241] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-31T17:25:31.977573] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-31T17:25:31.977633] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-31T17:25:32.266860] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-31T17:25:32.442397] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:25:32.474665] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-31T17:25:32.943567] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T17:25:33.057678] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-31T17:25:33.294238] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T17:25:33.857728] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-31T17:25:34.200556] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T17:25:34.657623] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-31T17:25:35.411700] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T17:25:35.424451] [INFO ] [REMOTE ] BAM: Full fetch complete (75398 records). [2025-10-31T17:25:35.424626] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-31T17:25:35.459712] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-31T17:25:35.862539] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T17:25:35.861928] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-31T17:25:35.867954] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-31T17:25:35.869425] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-31T17:25:35.870257] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-31T17:25:35.872090] [DEBUG] [LOCAL ] BAM: Trimmed 75398 records to 52839 (keeping 200 days of data) [2025-10-31T17:25:36.199170] [DEBUG] [LOCAL ] BAM: Primary data saved (52839 records). [2025-10-31T17:25:36.199330] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-31T17:25:36.200067] [INFO ] [MAIN ] Update Progress: 212/2365 symbols completed. BAM took 31.6s. Estimated remaining: 4h 19m 17s. Rate: 8.3 symbols/min [2025-10-31T17:25:36.264168] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-31T17:25:36.376468] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:25:36.429762] [DEBUG] [LOCAL ] BAX: Loaded 53926 existing records from primary storage. [2025-10-31T17:25:36.430083] [INFO ] [MAIN ] BAX: Loaded 53926 existing records. [2025-10-31T17:25:36.614271] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:25:36.614590] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-31T17:25:36.614707] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-31T17:25:36.615121] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-31T17:25:36.633927] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-31T17:25:36.691663] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T17:25:37.003297] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:25:37.057708] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-31T17:25:37.426634] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T17:25:37.857721] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-31T17:25:38.657629] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-31T17:25:38.773566] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-31T17:25:38.844076] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T17:25:39.457726] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-31T17:25:39.983232] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T17:25:40.257732] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-31T17:25:40.661492] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T17:25:41.057695] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-31T17:25:41.528456] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T17:25:41.857705] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-31T17:25:42.325638] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T17:25:42.657712] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-31T17:25:43.049828] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T17:25:43.457696] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-31T17:25:43.898857] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T17:25:44.257707] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-31T17:25:44.684807] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T17:25:45.057681] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-31T17:25:45.189175] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-31T17:25:45.857681] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-31T17:25:46.016206] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T17:25:46.657730] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-31T17:25:47.189177] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:25:47.457693] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-31T17:25:47.625016] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T17:25:48.257729] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-31T17:25:48.296971] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T17:25:49.057686] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-31T17:25:49.453597] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T17:25:49.857628] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-31T17:25:49.991887] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-31T17:25:50.657673] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-31T17:25:51.378330] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T17:25:51.457687] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-31T17:25:51.848903] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T17:25:52.257720] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-31T17:25:52.520965] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T17:25:53.057754] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-31T17:25:53.645941] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T17:25:53.857615] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-31T17:25:53.999883] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T17:25:54.657692] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-31T17:25:55.160323] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T17:25:55.457685] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-31T17:25:55.589143] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-31T17:25:56.257773] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-31T17:25:56.379903] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T17:25:56.385610] [INFO ] [REMOTE ] BAP: Full fetch complete (37008 records). [2025-10-31T17:25:56.385767] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-31T17:25:56.760829] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-31T17:25:56.760914] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-31T17:25:56.761376] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-31T17:25:56.761416] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-31T17:25:56.762320] [DEBUG] [LOCAL ] BAP: Trimmed 37008 records to 25327 (keeping 200 days of data) [2025-10-31T17:25:56.912002] [DEBUG] [LOCAL ] BAP: Primary data saved (25327 records). [2025-10-31T17:25:56.912117] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-31T17:25:56.912193] [INFO ] [MAIN ] Update Progress: 213/2365 symbols completed. BAP took 32.1s. Estimated remaining: 4h 21m 26s. Rate: 8.2 symbols/min [2025-10-31T17:25:57.058199] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-31T17:25:57.085626] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:25:57.133973] [DEBUG] [LOCAL ] BB: Loaded 53238 existing records from primary storage. [2025-10-31T17:25:57.134296] [INFO ] [MAIN ] BB: Loaded 53238 existing records. [2025-10-31T17:25:57.320846] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:25:57.333580] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-31T17:25:57.333855] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-31T17:25:57.335149] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-31T17:25:57.335192] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-31T17:25:57.335327] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-31T17:25:57.696321] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:25:57.857716] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-31T17:25:58.488898] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-31T17:25:58.501684] [INFO ] [REMOTE ] BANC: Full fetch complete (74681 records). [2025-10-31T17:25:58.502216] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-31T17:25:58.663496] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-31T17:25:58.953004] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-31T17:25:58.953153] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-31T17:25:58.954325] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-31T17:25:58.954425] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-31T17:25:58.956894] [DEBUG] [LOCAL ] BANC: Trimmed 74681 records to 52147 (keeping 200 days of data) [2025-10-31T17:25:59.337688] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T17:25:59.363055] [INFO ] [REMOTE ] BARK: Full fetch complete (55750 records). [2025-10-31T17:25:59.366911] [DEBUG] [LOCAL ] BANC: Primary data saved (52147 records). [2025-10-31T17:25:59.367401] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-31T17:25:59.367557] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-31T17:25:59.368960] [INFO ] [MAIN ] Update Progress: 214/2365 symbols completed. BANC took 36.6s. Estimated remaining: 4h 20m 30s. Rate: 8.3 symbols/min [2025-10-31T17:25:59.478249] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-31T17:25:59.878072] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:00.018410] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-31T17:26:00.018498] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-31T17:26:00.019124] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-31T17:26:00.019262] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-31T17:26:00.021710] [DEBUG] [LOCAL ] BARK: Trimmed 55750 records to 38709 (keeping 200 days of data) [2025-10-31T17:26:00.221430] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-31T17:26:00.260724] [INFO ] [MAIN ] BBAI: Loaded 54210 existing records. [2025-10-31T17:26:00.279138] [DEBUG] [LOCAL ] BARK: Primary data saved (38709 records). [2025-10-31T17:26:00.284496] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-31T17:26:00.312992] [INFO ] [MAIN ] Update Progress: 215/2365 symbols completed. BARK took 28.9s. Estimated remaining: 4h 19m 20s. Rate: 8.3 symbols/min [2025-10-31T17:26:00.644803] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:00.669283] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:00.669512] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-31T17:26:00.669558] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-31T17:26:00.670073] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-31T17:26:00.670120] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-31T17:26:00.979468] [DEBUG] [LOCAL ] BBAR: Loaded 43087 existing records from primary storage. [2025-10-31T17:26:01.006429] [INFO ] [MAIN ] BBAR: Loaded 43087 existing records. [2025-10-31T17:26:01.111157] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:01.123583] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-31T17:26:01.253454] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:01.253968] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-31T17:26:01.254043] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-31T17:26:01.264300] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-31T17:26:01.269504] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-31T17:26:01.315823] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-31T17:26:01.395353] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-31T17:26:01.661142] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:01.697357] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-31T17:26:01.857660] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-31T17:26:02.657715] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-31T17:26:03.059905] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-31T17:26:03.291522] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:26:03.490111] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-31T17:26:03.512181] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-31T17:26:03.800972] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T17:26:04.257705] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-31T17:26:04.877975] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-31T17:26:05.057696] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-31T17:26:05.682950] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T17:26:05.857677] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-31T17:26:06.252242] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T17:26:06.634969] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T17:26:06.647109] [INFO ] [REMOTE ] BAX: Full fetch complete (77622 records). [2025-10-31T17:26:06.647232] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-31T17:26:06.667882] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-31T17:26:07.041588] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-31T17:26:07.041705] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-31T17:26:07.042481] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-31T17:26:07.042524] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-31T17:26:07.043977] [DEBUG] [LOCAL ] BAX: Trimmed 77622 records to 54316 (keeping 200 days of data) [2025-10-31T17:26:07.360592] [DEBUG] [LOCAL ] BAX: Primary data saved (54316 records). [2025-10-31T17:26:07.360764] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-31T17:26:07.361375] [INFO ] [MAIN ] Update Progress: 216/2365 symbols completed. BAX took 31.2s. Estimated remaining: 4h 19m 11s. Rate: 8.3 symbols/min [2025-10-31T17:26:07.462779] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-31T17:26:07.537151] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:07.588016] [DEBUG] [LOCAL ] BBD: Loaded 53672 existing records from primary storage. [2025-10-31T17:26:07.588322] [INFO ] [MAIN ] BBD: Loaded 53672 existing records. [2025-10-31T17:26:07.763462] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:07.763740] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-31T17:26:07.763791] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-31T17:26:07.764074] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-31T17:26:07.764112] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-31T17:26:08.122772] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:08.257621] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-31T17:26:08.397921] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-31T17:26:09.057675] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-31T17:26:09.393533] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T17:26:09.453551] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-31T17:26:09.857671] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-31T17:26:10.445459] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T17:26:10.657717] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-31T17:26:11.353846] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-31T17:26:11.457674] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-31T17:26:11.828916] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T17:26:12.257695] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-31T17:26:13.057719] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-31T17:26:13.504879] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-31T17:26:13.622882] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T17:26:13.857638] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-31T17:26:14.471227] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-31T17:26:14.657667] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-31T17:26:15.457680] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-31T17:26:15.821891] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T17:26:15.906476] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-31T17:26:16.257678] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-31T17:26:16.922745] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T17:26:17.057638] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-31T17:26:17.857695] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-31T17:26:18.048732] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T17:26:18.348813] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-31T17:26:18.657691] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-31T17:26:19.374752] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T17:26:19.457707] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-31T17:26:19.895158] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T17:26:20.257682] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-31T17:26:20.937698] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-31T17:26:21.057625] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-31T17:26:21.318400] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T17:26:21.857691] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-31T17:26:22.551580] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T17:26:22.657678] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-31T17:26:23.156848] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T17:26:23.457706] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-31T17:26:24.257679] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-31T17:26:24.775105] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-31T17:26:24.980727] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-31T17:26:25.057627] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-31T17:26:25.862804] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-31T17:26:25.881072] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-31T17:26:26.657734] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-31T17:26:27.455520] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T17:26:27.485355] [INFO ] [REMOTE ] BBAR: Full fetch complete (61417 records). [2025-10-31T17:26:27.470911] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-31T17:26:27.486450] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-31T17:26:27.498629] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-31T17:26:27.880354] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-31T17:26:27.880470] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-31T17:26:27.881149] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-31T17:26:27.881214] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-31T17:26:27.882514] [DEBUG] [LOCAL ] BBAR: Trimmed 61417 records to 43472 (keeping 200 days of data) [2025-10-31T17:26:28.155340] [DEBUG] [LOCAL ] BBAR: Primary data saved (43472 records). [2025-10-31T17:26:28.175574] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-31T17:26:28.175802] [INFO ] [MAIN ] Update Progress: 217/2365 symbols completed. BBAR took 27.8s. Estimated remaining: 4h 21m 18s. Rate: 8.2 symbols/min [2025-10-31T17:26:28.221508] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-31T17:26:28.269259] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-31T17:26:28.361896] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:28.390901] [DEBUG] [LOCAL ] BBDC: Loaded 32495 existing records from primary storage. [2025-10-31T17:26:28.391145] [INFO ] [MAIN ] BBDC: Loaded 32495 existing records. [2025-10-31T17:26:28.566234] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:28.566524] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-31T17:26:28.566579] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-31T17:26:28.566875] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-31T17:26:28.566930] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-31T17:26:28.914789] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:29.057607] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-31T17:26:29.137992] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-31T17:26:29.857705] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-31T17:26:30.355615] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-31T17:26:30.487371] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:26:30.657623] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-31T17:26:31.457709] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-31T17:26:31.771719] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-31T17:26:31.783797] [INFO ] [REMOTE ] BB: Full fetch complete (76950 records). [2025-10-31T17:26:31.783948] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-31T17:26:32.185473] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-31T17:26:32.185741] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-31T17:26:32.186629] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-31T17:26:32.186735] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-31T17:26:32.216920] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-31T17:26:32.215416] [DEBUG] [LOCAL ] BB: Trimmed 76950 records to 53623 (keeping 200 days of data) [2025-10-31T17:26:32.272523] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-31T17:26:32.527978] [DEBUG] [LOCAL ] BB: Primary data saved (53623 records). [2025-10-31T17:26:32.528184] [INFO ] [MAIN ] BB: Full history saved. [2025-10-31T17:26:32.528274] [INFO ] [MAIN ] Update Progress: 218/2365 symbols completed. BB took 35.6s. Estimated remaining: 4h 20m 41s. Rate: 8.2 symbols/min [2025-10-31T17:26:32.675810] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T17:26:32.728910] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:32.735366] [DEBUG] [LOCAL ] BBDO: Loaded 4925 existing records from primary storage. [2025-10-31T17:26:32.735518] [INFO ] [MAIN ] BBDO: Loaded 4925 existing records. [2025-10-31T17:26:32.917844] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:32.918103] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-31T17:26:32.918155] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-31T17:26:32.918307] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-31T17:26:32.918361] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-31T17:26:33.062831] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-31T17:26:33.282528] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:33.823874] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T17:26:33.836104] [INFO ] [REMOTE ] BBD: Full fetch complete (77272 records). [2025-10-31T17:26:33.836236] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-31T17:26:33.867340] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-31T17:26:34.234075] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-31T17:26:34.234158] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-31T17:26:34.235005] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-31T17:26:34.235070] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-31T17:26:34.236533] [DEBUG] [LOCAL ] BBD: Trimmed 77272 records to 54062 (keeping 200 days of data) [2025-10-31T17:26:34.541116] [DEBUG] [LOCAL ] BBD: Primary data saved (54062 records). [2025-10-31T17:26:34.541238] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-31T17:26:34.541311] [INFO ] [MAIN ] Update Progress: 219/2365 symbols completed. BBD took 27.2s. Estimated remaining: 4h 19m 43s. Rate: 8.3 symbols/min [2025-10-31T17:26:34.662860] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-31T17:26:34.710492] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:34.729013] [DEBUG] [LOCAL ] BBN: Loaded 17450 existing records from primary storage. [2025-10-31T17:26:34.729268] [INFO ] [MAIN ] BBN: Loaded 17450 existing records. [2025-10-31T17:26:34.909495] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:34.909827] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-31T17:26:34.909906] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-31T17:26:34.910250] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-31T17:26:34.910392] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-31T17:26:35.005532] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T17:26:35.310251] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:35.342611] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-31T17:26:35.372103] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-31T17:26:35.457625] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-31T17:26:36.174238] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T17:26:36.257678] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-31T17:26:36.624567] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T17:26:37.057678] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-31T17:26:37.857692] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-31T17:26:38.494441] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-31T17:26:38.618244] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-31T17:26:38.657608] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-31T17:26:39.457693] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-31T17:26:39.626750] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T17:26:39.862464] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T17:26:40.257670] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-31T17:26:40.846473] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T17:26:41.057633] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-31T17:26:41.552192] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-31T17:26:41.857714] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-31T17:26:42.604390] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T17:26:42.657617] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-31T17:26:43.304861] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-31T17:26:43.457683] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-31T17:26:44.257728] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-31T17:26:44.586697] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T17:26:44.660240] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-31T17:26:45.057706] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-31T17:26:45.547500] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T17:26:45.857710] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-31T17:26:46.657690] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-31T17:26:47.388310] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T17:26:47.457661] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-31T17:26:48.257626] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-31T17:26:48.441696] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T17:26:48.670367] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T17:26:48.704923] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.85 seconds). [2025-10-31T17:26:48.717259] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-31T17:26:48.717391] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-31T17:26:49.062818] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-31T17:26:49.120881] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-31T17:26:49.121033] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-31T17:26:49.121934] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-31T17:26:49.121999] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-31T17:26:49.123468] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-31T17:26:49.437924] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-10-31T17:26:49.438096] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-31T17:26:49.438176] [INFO ] [MAIN ] Update Progress: 220/2365 symbols completed. BBAI took 50.1s. Estimated remaining: 4h 20m 50s. Rate: 8.2 symbols/min [2025-10-31T17:26:49.543972] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T17:26:49.611184] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:49.611337] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-31T17:26:49.611373] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-31T17:26:49.611495] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-31T17:26:49.611557] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-31T17:26:49.611635] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-31T17:26:49.611725] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-31T17:26:49.862781] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-31T17:26:49.964892] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:50.382785] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-31T17:26:50.657669] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-31T17:26:51.352704] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T17:26:51.457636] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-31T17:26:51.607472] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:26:51.607965] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-31T17:26:51.608065] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:26:51.608120] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-31T17:26:51.608181] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:26:51.608261] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-31T17:26:51.608434] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-31T17:26:51.608493] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-31T17:26:51.608541] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-31T17:26:51.608594] [INFO ] [MAIN ] Update Progress: 221/2365 symbols completed. BBT took 2.2s. Estimated remaining: 4h 19m 53s. Rate: 8.3 symbols/min [2025-10-31T17:26:51.799660] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:51.807308] [DEBUG] [LOCAL ] BBU: Loaded 5965 existing records from primary storage. [2025-10-31T17:26:51.807531] [INFO ] [MAIN ] BBU: Loaded 5965 existing records. [2025-10-31T17:26:51.993607] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:51.993894] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-31T17:26:51.993953] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-31T17:26:51.994475] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-31T17:26:51.994545] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-31T17:26:52.262880] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-31T17:26:52.356247] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:53.006238] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T17:26:53.057613] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-31T17:26:53.857714] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-31T17:26:53.887766] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-31T17:26:53.892306] [INFO ] [REMOTE ] BBN: Full fetch complete (25132 records). [2025-10-31T17:26:53.892467] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-31T17:26:54.270596] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-31T17:26:54.270706] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-31T17:26:54.271105] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-31T17:26:54.271146] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-31T17:26:54.272194] [DEBUG] [LOCAL ] BBN: Trimmed 25132 records to 17702 (keeping 200 days of data) [2025-10-31T17:26:54.385689] [DEBUG] [LOCAL ] BBN: Primary data saved (17702 records). [2025-10-31T17:26:54.385832] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-31T17:26:54.385908] [INFO ] [MAIN ] Update Progress: 222/2365 symbols completed. BBN took 19.8s. Estimated remaining: 4h 19m 2s. Rate: 8.3 symbols/min [2025-10-31T17:26:54.553733] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:54.568309] [DEBUG] [LOCAL ] BBUC: Loaded 13858 existing records from primary storage. [2025-10-31T17:26:54.568497] [INFO ] [MAIN ] BBUC: Loaded 13858 existing records. [2025-10-31T17:26:54.664898] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-31T17:26:54.745725] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:54.745927] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-31T17:26:54.745974] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-31T17:26:54.746153] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-31T17:26:54.746209] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-31T17:26:55.097900] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:55.148569] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T17:26:55.162962] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-31T17:26:55.457724] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-31T17:26:56.150392] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T17:26:56.152278] [INFO ] [REMOTE ] BBDO: Full fetch complete (7458 records). [2025-10-31T17:26:56.152345] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-31T17:26:56.261582] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-31T17:26:56.539348] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-31T17:26:56.539450] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-31T17:26:56.539636] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-31T17:26:56.539714] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-31T17:26:56.540084] [DEBUG] [LOCAL ] BBDO: Trimmed 7458 records to 4962 (keeping 200 days of data) [2025-10-31T17:26:56.571044] [DEBUG] [LOCAL ] BBDO: Primary data saved (4962 records). [2025-10-31T17:26:56.571189] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-31T17:26:56.571300] [INFO ] [MAIN ] Update Progress: 223/2365 symbols completed. BBDO took 24.0s. Estimated remaining: 4h 18m 6s. Rate: 8.3 symbols/min [2025-10-31T17:26:56.728061] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-31T17:26:56.750895] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:26:56.795308] [DEBUG] [LOCAL ] BBVA: Loaded 49335 existing records from primary storage. [2025-10-31T17:26:56.795630] [INFO ] [MAIN ] BBVA: Loaded 49335 existing records. [2025-10-31T17:26:56.968148] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:26:56.968397] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-31T17:26:56.968459] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-31T17:26:56.968894] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-31T17:26:56.968954] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-31T17:26:57.062744] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-31T17:26:57.335743] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:26:57.410192] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-31T17:26:57.857667] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-31T17:26:58.487698] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-31T17:26:58.657664] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-31T17:26:58.970520] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-31T17:26:59.457712] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-31T17:26:59.841249] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-31T17:27:00.257719] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-31T17:27:00.781753] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T17:27:01.057690] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-31T17:27:01.857689] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-31T17:27:02.015504] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T17:27:02.172695] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-31T17:27:02.657686] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-31T17:27:03.457696] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-31T17:27:04.002730] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T17:27:04.216282] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T17:27:04.257680] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-31T17:27:04.951290] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-31T17:27:05.057707] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-31T17:27:05.736870] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-31T17:27:05.857672] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-31T17:27:06.478252] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-31T17:27:06.657627] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-31T17:27:07.208461] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-31T17:27:07.457674] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-31T17:27:08.188634] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T17:27:08.257623] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-31T17:27:08.644511] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-31T17:27:09.057680] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-31T17:27:09.857675] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-31T17:27:10.203594] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T17:27:10.395223] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-31T17:27:10.657686] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-31T17:27:11.457692] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-31T17:27:11.699514] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T17:27:12.110728] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T17:27:12.114125] [INFO ] [REMOTE ] BBU: Full fetch complete (7700 records). [2025-10-31T17:27:12.114200] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-31T17:27:12.262742] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-31T17:27:12.513691] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-31T17:27:12.513770] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-31T17:27:12.513956] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-31T17:27:12.513993] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-31T17:27:12.514373] [DEBUG] [LOCAL ] BBU: Trimmed 7700 records to 6042 (keeping 200 days of data) [2025-10-31T17:27:12.548415] [DEBUG] [LOCAL ] BBU: Primary data saved (6042 records). [2025-10-31T17:27:12.548501] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-31T17:27:12.548573] [INFO ] [MAIN ] Update Progress: 224/2365 symbols completed. BBU took 20.9s. Estimated remaining: 4h 19m 23s. Rate: 8.3 symbols/min [2025-10-31T17:27:12.723403] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:27:12.749428] [DEBUG] [LOCAL ] BBW: Loaded 26994 existing records from primary storage. [2025-10-31T17:27:12.749690] [INFO ] [MAIN ] BBW: Loaded 26994 existing records. [2025-10-31T17:27:12.929151] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:27:12.929384] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-31T17:27:12.929432] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-31T17:27:12.929899] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-31T17:27:12.929958] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-31T17:27:13.070725] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-31T17:27:13.289340] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:27:13.576413] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-31T17:27:13.587619] [INFO ] [REMOTE ] BBDC: Full fetch complete (48930 records). [2025-10-31T17:27:13.587874] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-31T17:27:13.862773] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-31T17:27:13.977150] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-31T17:27:13.977225] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-31T17:27:13.977785] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-31T17:27:13.977849] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-31T17:27:13.978862] [DEBUG] [LOCAL ] BBDC: Trimmed 48930 records to 32700 (keeping 200 days of data) [2025-10-31T17:27:14.166018] [DEBUG] [LOCAL ] BBDC: Primary data saved (32700 records). [2025-10-31T17:27:14.166147] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-31T17:27:14.166223] [INFO ] [MAIN ] Update Progress: 225/2365 symbols completed. BBDC took 46.0s. Estimated remaining: 4h 18m 21s. Rate: 8.3 symbols/min [2025-10-31T17:27:14.360962] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:27:14.407986] [DEBUG] [LOCAL ] BBWI: Loaded 53981 existing records from primary storage. [2025-10-31T17:27:14.408315] [INFO ] [MAIN ] BBWI: Loaded 53981 existing records. [2025-10-31T17:27:14.598159] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:27:14.598958] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-31T17:27:14.599125] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-31T17:27:14.599819] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-31T17:27:14.600089] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-31T17:27:14.631901] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T17:27:14.658277] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-31T17:27:14.912026] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-31T17:27:15.036273] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:27:15.457635] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-31T17:27:15.795502] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T17:27:16.257680] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-31T17:27:16.891709] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T17:27:17.057683] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-31T17:27:17.398099] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T17:27:17.835040] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-31T17:27:17.857623] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-31T17:27:18.608078] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-31T17:27:18.657675] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-31T17:27:19.457639] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-31T17:27:19.538398] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:27:20.257725] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-31T17:27:20.715218] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T17:27:20.733690] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T17:27:21.057721] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-31T17:27:21.857722] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-31T17:27:22.223230] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T17:27:22.657693] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-31T17:27:23.160073] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T17:27:23.353565] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T17:27:23.457675] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-31T17:27:24.257615] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-31T17:27:24.356593] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T17:27:25.057635] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-31T17:27:25.613521] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T17:27:25.857708] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-31T17:27:26.177278] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T17:27:26.657675] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-31T17:27:26.718841] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T17:27:27.292869] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T17:27:27.457627] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-31T17:27:28.257694] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-31T17:27:28.397233] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-31T17:27:28.963361] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T17:27:28.968025] [INFO ] [REMOTE ] BBUC: Full fetch complete (19504 records). [2025-10-31T17:27:28.968145] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-31T17:27:29.062758] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-31T17:27:29.338015] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-31T17:27:29.338097] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-31T17:27:29.338455] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-31T17:27:29.338496] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-31T17:27:29.339094] [DEBUG] [LOCAL ] BBUC: Trimmed 19504 records to 13999 (keeping 200 days of data) [2025-10-31T17:27:29.421410] [DEBUG] [LOCAL ] BBUC: Primary data saved (13999 records). [2025-10-31T17:27:29.421540] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-31T17:27:29.421617] [INFO ] [MAIN ] Update Progress: 226/2365 symbols completed. BBUC took 35.0s. Estimated remaining: 4h 19m 30s. Rate: 8.2 symbols/min [2025-10-31T17:27:29.591861] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:27:29.643881] [DEBUG] [LOCAL ] BBY: Loaded 53811 existing records from primary storage. [2025-10-31T17:27:29.644181] [INFO ] [MAIN ] BBY: Loaded 53811 existing records. [2025-10-31T17:27:29.830697] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:27:29.830914] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-31T17:27:29.830961] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-31T17:27:29.831172] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-31T17:27:29.831228] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-31T17:27:29.865073] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-31T17:27:30.188989] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:27:30.237589] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T17:27:30.657689] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-31T17:27:31.180421] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T17:27:31.457674] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-31T17:27:31.825688] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T17:27:31.833940] [INFO ] [REMOTE ] BBW: Full fetch complete (38942 records). [2025-10-31T17:27:31.834166] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-31T17:27:31.834984] [FATAL] [VALIDATOR ] BBW: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:27:31.835079] [FATAL] [MAIN ] BBW: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:27:31.835125] [WARN ] [MAIN ] BBW: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:27:31.835166] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-31T17:27:31.835237] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-31T17:27:31.835287] [INFO ] [LOCAL ] BBW: Starting deletion of derivative data. [2025-10-31T17:27:31.835560] [DEBUG] [LOCAL ] BBW: Deleted derivative data file. [2025-10-31T17:27:31.835708] [INFO ] [MAIN ] Update Progress: 227/2365 symbols completed. BBW took 19.3s. Estimated remaining: 4h 18m 37s. Rate: 8.3 symbols/min [2025-10-31T17:27:32.022025] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:27:32.068630] [DEBUG] [LOCAL ] BC: Loaded 44049 existing records from primary storage. [2025-10-31T17:27:32.069123] [INFO ] [MAIN ] BC: Loaded 44049 existing records. [2025-10-31T17:27:32.256903] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:27:32.257206] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-31T17:27:32.257255] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-31T17:27:32.257515] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-31T17:27:32.257571] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-31T17:27:32.262817] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-31T17:27:32.642338] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:27:32.671403] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T17:27:33.057713] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-31T17:27:33.847706] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T17:27:33.858278] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-31T17:27:34.237628] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T17:27:34.657686] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-31T17:27:35.327978] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-31T17:27:35.457704] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-31T17:27:36.151412] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T17:27:36.257698] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-31T17:27:36.482146] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T17:27:37.057687] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-31T17:27:37.857618] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-31T17:27:37.953298] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-31T17:27:37.964731] [INFO ] [REMOTE ] BBVA: Full fetch complete (71920 records). [2025-10-31T17:27:37.964856] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-31T17:27:38.349052] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-31T17:27:38.349153] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-31T17:27:38.349903] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-31T17:27:38.349964] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-31T17:27:38.351257] [DEBUG] [LOCAL ] BBVA: Trimmed 71920 records to 49698 (keeping 200 days of data) [2025-10-31T17:27:38.669096] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-31T17:27:38.695512] [DEBUG] [LOCAL ] BBVA: Primary data saved (49698 records). [2025-10-31T17:27:38.695974] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-31T17:27:38.696095] [INFO ] [MAIN ] Update Progress: 228/2365 symbols completed. BBVA took 42.1s. Estimated remaining: 4h 18m 26s. Rate: 8.3 symbols/min [2025-10-31T17:27:38.797206] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-31T17:27:38.975750] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:27:39.005399] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T17:27:39.040714] [DEBUG] [LOCAL ] BCAT: Loaded 34186 existing records from primary storage. [2025-10-31T17:27:39.041011] [INFO ] [MAIN ] BCAT: Loaded 34186 existing records. [2025-10-31T17:27:39.250510] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:27:39.250751] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-31T17:27:39.250801] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-31T17:27:39.251025] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-31T17:27:39.251062] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-31T17:27:39.462878] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-31T17:27:39.602818] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:27:40.013744] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-31T17:27:40.257723] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-31T17:27:40.786244] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T17:27:41.057711] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-31T17:27:41.325467] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T17:27:41.857723] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-31T17:27:42.666967] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-31T17:27:42.687986] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-31T17:27:43.314158] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T17:27:43.457611] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-31T17:27:43.672527] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:27:44.257723] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-31T17:27:45.057629] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-31T17:27:45.096905] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T17:27:45.419925] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:27:45.857667] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-31T17:27:46.443440] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-31T17:27:46.657723] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-31T17:27:47.457712] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-31T17:27:47.531408] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-31T17:27:48.107997] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T17:27:48.257671] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-31T17:27:48.313200] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-31T17:27:49.057638] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-31T17:27:49.815690] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-31T17:27:49.857703] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-31T17:27:50.067197] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T17:27:50.657625] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-31T17:27:51.354487] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T17:27:51.457623] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-31T17:27:51.705300] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T17:27:52.257677] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-31T17:27:52.875309] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T17:27:53.057674] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-31T17:27:53.326436] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-31T17:27:53.857724] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-31T17:27:54.224140] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T17:27:54.657631] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-31T17:27:55.375464] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T17:27:55.387619] [INFO ] [REMOTE ] BBWI: Full fetch complete (77640 records). [2025-10-31T17:27:55.387769] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-31T17:27:55.464600] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-31T17:27:55.790858] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-31T17:27:55.791037] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-31T17:27:55.791874] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-31T17:27:55.791951] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-31T17:27:55.801897] [DEBUG] [LOCAL ] BBWI: Trimmed 77640 records to 54371 (keeping 200 days of data) [2025-10-31T17:27:55.818100] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T17:27:56.150915] [DEBUG] [LOCAL ] BBWI: Primary data saved (54371 records). [2025-10-31T17:27:56.151110] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-31T17:27:56.151214] [INFO ] [MAIN ] Update Progress: 229/2365 symbols completed. BBWI took 42.0s. Estimated remaining: 4h 19m 54s. Rate: 8.2 symbols/min [2025-10-31T17:27:56.262743] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-31T17:27:56.326621] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:27:56.354110] [DEBUG] [LOCAL ] BCC: Loaded 28656 existing records from primary storage. [2025-10-31T17:27:56.354350] [INFO ] [MAIN ] BCC: Loaded 28656 existing records. [2025-10-31T17:27:56.533025] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:27:56.533320] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-31T17:27:56.533370] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-31T17:27:56.533680] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-31T17:27:56.533739] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-31T17:27:56.905607] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:27:57.057684] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-31T17:27:57.583973] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:27:57.857685] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-31T17:27:58.091959] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T17:27:58.657678] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-31T17:27:59.304744] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T17:27:59.316939] [INFO ] [REMOTE ] BC: Full fetch complete (64001 records). [2025-10-31T17:27:59.317135] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-31T17:27:59.461258] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-31T17:27:59.744559] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-31T17:27:59.744682] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-31T17:27:59.745476] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-31T17:27:59.745524] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-31T17:27:59.746866] [DEBUG] [LOCAL ] BC: Trimmed 64001 records to 44361 (keeping 200 days of data) [2025-10-31T17:28:00.008778] [DEBUG] [LOCAL ] BC: Primary data saved (44361 records). [2025-10-31T17:28:00.008943] [INFO ] [MAIN ] BC: Full history saved. [2025-10-31T17:28:00.009714] [INFO ] [MAIN ] Update Progress: 230/2365 symbols completed. BC took 28.2s. Estimated remaining: 4h 19m 15s. Rate: 8.2 symbols/min [2025-10-31T17:28:00.174766] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:28:00.226798] [DEBUG] [LOCAL ] BCE: Loaded 52608 existing records from primary storage. [2025-10-31T17:28:00.227198] [INFO ] [MAIN ] BCE: Loaded 52608 existing records. [2025-10-31T17:28:00.406182] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:28:00.406448] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-31T17:28:00.406498] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-31T17:28:00.407053] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-31T17:28:00.407111] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-31T17:28:00.768055] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:28:00.768811] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-31T17:28:00.952006] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-31T17:28:01.057635] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-31T17:28:02.126709] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-31T17:28:02.133669] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-31T17:28:02.376313] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-31T17:28:02.657716] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-31T17:28:03.214565] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T17:28:03.457698] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-31T17:28:03.916078] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T17:28:04.257702] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-31T17:28:04.284453] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T17:28:05.057706] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-31T17:28:05.704850] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T17:28:05.857617] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-31T17:28:05.885591] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T17:28:06.657751] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-31T17:28:07.137201] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T17:28:07.457751] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-31T17:28:08.658318] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T17:28:08.669390] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-31T17:28:09.961958] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T17:28:09.972500] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-31T17:28:11.377881] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T17:28:11.390089] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-31T17:28:12.760154] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T17:28:12.771468] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-31T17:28:13.948609] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T17:28:13.960155] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-31T17:28:15.572237] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-31T17:28:15.586318] [INFO ] [REMOTE ] BCE: Full fetch complete (76084 records). [2025-10-31T17:28:15.586534] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-31T17:28:16.025811] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-31T17:28:16.025901] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-31T17:28:16.026937] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-31T17:28:16.027013] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-31T17:28:16.028888] [DEBUG] [LOCAL ] BCE: Trimmed 76084 records to 52994 (keeping 200 days of data) [2025-10-31T17:28:16.360288] [DEBUG] [LOCAL ] BCE: Primary data saved (52994 records). [2025-10-31T17:28:16.360419] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-31T17:28:16.361458] [INFO ] [MAIN ] Update Progress: 231/2365 symbols completed. BCE took 16.4s. Estimated remaining: 4h 20m 31s. Rate: 8.2 symbols/min [2025-10-31T17:28:16.559323] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:28:16.591377] [DEBUG] [LOCAL ] BCH: Loaded 29646 existing records from primary storage. [2025-10-31T17:28:16.591709] [INFO ] [MAIN ] BCH: Loaded 29646 existing records. [2025-10-31T17:28:16.803541] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:28:16.803836] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-31T17:28:16.803895] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-31T17:28:16.804063] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-31T17:28:16.804104] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-31T17:28:17.178230] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:28:17.178549] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-31T17:28:39.116372] [DEBUG] [REMOTE ] BBY: Error fetching primary data for 2025-09: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-10-31T17:28:39.116514] [WARN ] [REMOTE ] BBY: No data returned for month 2025-09 [2025-10-31T17:28:39.116597] [FATAL] [REMOTE ] BBY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:28:39.116678] [FATAL] [MAIN ] BBY: Failed to fetch primary data. [2025-10-31T17:28:39.116747] [WARN ] [MAIN ] BBY: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:28:39.116814] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-31T17:28:39.116877] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-31T17:28:39.116912] [INFO ] [LOCAL ] BBY: Starting deletion of derivative data. [2025-10-31T17:28:39.117054] [DEBUG] [LOCAL ] BBY: Deleted derivative data file. [2025-10-31T17:28:39.117147] [INFO ] [MAIN ] Update Progress: 232/2365 symbols completed. BBY took 1m 10s. Estimated remaining: 4h 22m 46s. Rate: 8.1 symbols/min [2025-10-31T17:28:39.295456] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:28:39.324500] [DEBUG] [LOCAL ] BCO: Loaded 24261 existing records from primary storage. [2025-10-31T17:28:39.324770] [INFO ] [MAIN ] BCO: Loaded 24261 existing records. [2025-10-31T17:28:39.510060] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:28:39.510283] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-31T17:28:39.510332] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-31T17:28:39.510558] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-31T17:28:39.510616] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-31T17:28:39.868523] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:28:39.868849] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-31T17:28:40.033233] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (22.85 seconds). [2025-10-31T17:28:40.038284] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-31T17:28:40.182444] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (33.52 seconds). [2025-10-31T17:28:40.190581] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-31T17:28:40.356554] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (41.70 seconds). [2025-10-31T17:28:40.364395] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-31T17:28:40.757616] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T17:28:40.762869] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-31T17:28:40.845776] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T17:28:40.851801] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-31T17:28:41.193601] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T17:28:41.211495] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-31T17:28:41.228535] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T17:28:41.238699] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-31T17:28:41.434381] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-31T17:28:41.440232] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-31T17:28:42.078366] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T17:28:42.084752] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-31T17:28:42.126546] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-31T17:28:42.134312] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-31T17:28:42.194370] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-31T17:28:42.200325] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-31T17:28:42.354359] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T17:28:42.361970] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-31T17:28:43.012323] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-31T17:28:43.020800] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-31T17:28:43.049840] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-31T17:28:43.057239] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-31T17:28:43.213191] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T17:28:43.221827] [INFO ] [REMOTE ] BCC: Full fetch complete (41779 records). [2025-10-31T17:28:43.221949] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-31T17:28:43.591528] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T17:28:43.633939] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-31T17:28:43.634430] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-31T17:28:43.634081] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-31T17:28:43.635905] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-31T17:28:43.635981] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-31T17:28:43.637034] [DEBUG] [LOCAL ] BCC: Trimmed 41779 records to 28898 (keeping 200 days of data) [2025-10-31T17:28:43.818527] [DEBUG] [LOCAL ] BCC: Primary data saved (28898 records). [2025-10-31T17:28:43.818688] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-31T17:28:43.818782] [INFO ] [MAIN ] Update Progress: 233/2365 symbols completed. BCC took 47.7s. Estimated remaining: 4h 22m 14s. Rate: 8.1 symbols/min [2025-10-31T17:28:43.989837] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T17:28:44.024541] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:28:44.031856] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-31T17:28:44.059954] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T17:28:44.067472] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-31T17:28:44.113881] [DEBUG] [LOCAL ] BCS: Loaded 53824 existing records from primary storage. [2025-10-31T17:28:44.114237] [INFO ] [MAIN ] BCS: Loaded 53824 existing records. [2025-10-31T17:28:44.286857] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:28:44.287099] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-31T17:28:44.287149] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-31T17:28:44.287361] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-31T17:28:44.287398] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-31T17:28:44.643514] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:28:44.643910] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-31T17:28:44.694025] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-31T17:28:44.702155] [INFO ] [REMOTE ] BCAT: Full fetch complete (49983 records). [2025-10-31T17:28:44.702262] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-31T17:28:45.068950] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T17:28:45.125032] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-31T17:28:45.125495] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-31T17:28:45.125377] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-31T17:28:45.135208] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-31T17:28:45.141132] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-31T17:28:45.143541] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T17:28:45.150498] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-31T17:28:45.151750] [DEBUG] [LOCAL ] BCAT: Trimmed 49983 records to 34426 (keeping 200 days of data) [2025-10-31T17:28:45.356835] [DEBUG] [LOCAL ] BCAT: Primary data saved (34426 records). [2025-10-31T17:28:45.356968] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-31T17:28:45.357045] [INFO ] [MAIN ] Update Progress: 234/2365 symbols completed. BCAT took 1m 7s. Estimated remaining: 4h 21m 13s. Rate: 8.2 symbols/min [2025-10-31T17:28:45.524998] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:28:45.552266] [DEBUG] [LOCAL ] BCSF: Loaded 27908 existing records from primary storage. [2025-10-31T17:28:45.552514] [INFO ] [MAIN ] BCSF: Loaded 27908 existing records. [2025-10-31T17:28:45.728114] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:28:45.728343] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-31T17:28:45.728391] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-31T17:28:45.728691] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-31T17:28:45.728750] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-31T17:28:46.096424] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:28:46.097022] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-31T17:28:46.117109] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-31T17:28:46.123778] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-31T17:28:46.166207] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T17:28:46.174935] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-31T17:28:46.309816] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-31T17:28:46.320220] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-31T17:28:46.913063] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:28:46.918420] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-31T17:28:46.957503] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T17:28:46.964677] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-31T17:28:47.024378] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-31T17:28:47.030415] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-31T17:28:47.623809] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T17:28:47.628287] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-31T17:28:47.792896] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T17:28:47.798977] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-31T17:28:47.828071] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-31T17:28:47.839537] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-31T17:28:47.890411] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T17:28:47.897317] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-31T17:28:48.607178] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-31T17:28:48.614156] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-31T17:28:48.713674] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T17:28:48.718093] [INFO ] [REMOTE ] BCO: Full fetch complete (35836 records). [2025-10-31T17:28:48.718178] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-31T17:28:49.115118] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-31T17:28:49.116356] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-31T17:28:49.115688] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-31T17:28:49.116941] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-31T17:28:49.126753] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-31T17:28:49.127099] [INFO ] [REMOTE ] BCH: Full fetch complete (41719 records). [2025-10-31T17:28:49.127181] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-31T17:28:49.213345] [DEBUG] [LOCAL ] BCO: Trimmed 35836 records to 24398 (keeping 200 days of data) [2025-10-31T17:28:49.693028] [DEBUG] [LOCAL ] BCO: Primary data saved (24398 records). [2025-10-31T17:28:49.693282] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-31T17:28:49.693509] [INFO ] [MAIN ] Update Progress: 235/2365 symbols completed. BCO took 10.6s. Estimated remaining: 4h 20m 38s. Rate: 8.2 symbols/min [2025-10-31T17:28:49.685332] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-31T17:28:49.693742] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-31T17:28:49.694400] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-31T17:28:49.725891] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-31T17:28:49.850827] [DEBUG] [LOCAL ] BCH: Trimmed 41719 records to 29797 (keeping 200 days of data) [2025-10-31T17:28:49.964091] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T17:28:49.976200] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:28:49.943887] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-31T17:28:50.030370] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-31T17:28:50.033873] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-31T17:28:50.097172] [DEBUG] [LOCAL ] BCX: Loaded 21626 existing records from primary storage. [2025-10-31T17:28:50.113838] [INFO ] [MAIN ] BCX: Loaded 21626 existing records. [2025-10-31T17:28:50.208027] [DEBUG] [LOCAL ] BCH: Primary data saved (29797 records). [2025-10-31T17:28:50.226295] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-31T17:28:50.237766] [INFO ] [MAIN ] Update Progress: 236/2365 symbols completed. BCH took 33.9s. Estimated remaining: 4h 19m 30s. Rate: 8.2 symbols/min [2025-10-31T17:28:50.430555] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:28:50.477585] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-31T17:28:50.495770] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-31T17:28:50.495706] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:28:50.496165] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-31T17:28:50.496221] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-31T17:28:50.692400] [DEBUG] [LOCAL ] BDC: Loaded 23690 existing records from primary storage. [2025-10-31T17:28:50.738158] [INFO ] [MAIN ] BDC: Loaded 23690 existing records. [2025-10-31T17:28:51.079985] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:28:51.085667] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:28:51.086212] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-31T17:28:51.087352] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-31T17:28:51.087438] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-31T17:28:51.093278] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-31T17:28:51.102299] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-31T17:28:51.115004] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T17:28:51.185063] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-31T17:28:51.480678] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:28:51.480985] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-31T17:28:51.522210] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T17:28:51.537910] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-31T17:28:52.052264] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T17:28:52.060486] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-31T17:28:52.077071] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-31T17:28:52.083366] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-31T17:28:52.366929] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T17:28:52.372091] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-31T17:28:52.791384] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-31T17:28:52.797910] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-31T17:28:52.892331] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T17:28:52.915626] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-31T17:28:52.916728] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-31T17:28:52.922348] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-31T17:28:53.195676] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-31T17:28:53.201108] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-31T17:28:53.579358] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-31T17:28:53.588211] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-31T17:28:53.661712] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T17:28:53.669027] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-31T17:28:54.058783] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-31T17:28:54.064927] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-31T17:28:54.303514] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-31T17:28:54.314742] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-31T17:28:54.332757] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T17:28:54.339548] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-31T17:28:54.460040] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-31T17:28:54.469142] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-31T17:28:54.930552] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-31T17:28:54.937865] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-31T17:28:55.101861] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-31T17:28:55.457625] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-31T17:28:55.558326] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-31T17:28:55.566394] [INFO ] [REMOTE ] BCSF: Full fetch complete (40374 records). [2025-10-31T17:28:55.566518] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-31T17:28:56.031716] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T17:28:56.050419] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-31T17:28:56.058412] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-31T17:28:56.056659] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-31T17:28:56.070305] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-31T17:28:56.071402] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-31T17:28:56.073335] [DEBUG] [LOCAL ] BCSF: Trimmed 40374 records to 28155 (keeping 200 days of data) [2025-10-31T17:28:56.248119] [DEBUG] [LOCAL ] BCSF: Primary data saved (28155 records). [2025-10-31T17:28:56.253019] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-31T17:28:56.254014] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T17:28:56.253573] [INFO ] [MAIN ] Update Progress: 237/2365 symbols completed. BCSF took 10.9s. Estimated remaining: 4h 19m 11s. Rate: 8.2 symbols/min [2025-10-31T17:28:56.259024] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-31T17:28:57.010934] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T17:28:57.057607] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-31T17:28:57.864387] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-31T17:28:57.865516] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T17:28:58.657669] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-31T17:28:59.424997] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T17:28:59.424612] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-31T17:28:59.457606] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-31T17:29:00.257726] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-31T17:29:01.057669] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-31T17:29:01.273434] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-31T17:29:01.439013] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T17:29:01.830875] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T17:29:01.857612] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-31T17:29:02.657702] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-31T17:29:02.920409] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-31T17:29:02.926325] [INFO ] [REMOTE ] BCX: Full fetch complete (33173 records). [2025-10-31T17:29:02.926425] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-31T17:29:03.288413] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-31T17:29:03.288493] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-31T17:29:03.289025] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-31T17:29:03.289088] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-31T17:29:03.289852] [DEBUG] [LOCAL ] BCX: Trimmed 33173 records to 21751 (keeping 200 days of data) [2025-10-31T17:29:03.413447] [DEBUG] [LOCAL ] BCX: Primary data saved (21751 records). [2025-10-31T17:29:03.413561] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-31T17:29:03.413630] [INFO ] [MAIN ] Update Progress: 238/2365 symbols completed. BCX took 13.7s. Estimated remaining: 4h 19m 2s. Rate: 8.2 symbols/min [2025-10-31T17:29:03.457721] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-31T17:29:04.280876] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-31T17:29:04.286383] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-31T17:29:04.386012] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-31T17:29:04.398442] [INFO ] [REMOTE ] BCS: Full fetch complete (77533 records). [2025-10-31T17:29:04.398603] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-31T17:29:04.776253] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-31T17:29:04.776329] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-31T17:29:04.777109] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-31T17:29:04.777171] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-31T17:29:04.781807] [DEBUG] [LOCAL ] BCS: Trimmed 77533 records to 54214 (keeping 200 days of data) [2025-10-31T17:29:05.093386] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-31T17:29:05.106220] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-31T17:29:05.123584] [DEBUG] [LOCAL ] BCS: Primary data saved (54214 records). [2025-10-31T17:29:05.123975] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-31T17:29:05.124082] [INFO ] [MAIN ] Update Progress: 239/2365 symbols completed. BCS took 21.3s. Estimated remaining: 4h 18m 5s. Rate: 8.2 symbols/min [2025-10-31T17:29:06.069459] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-31T17:29:06.075121] [INFO ] [REMOTE ] BDC: Full fetch complete (35736 records). [2025-10-31T17:29:06.075209] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-31T17:29:06.463021] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-31T17:29:06.463111] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-31T17:29:06.463559] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-31T17:29:06.463599] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-31T17:29:06.464325] [DEBUG] [LOCAL ] BDC: Trimmed 35736 records to 23868 (keeping 200 days of data) [2025-10-31T17:29:06.605746] [DEBUG] [LOCAL ] BDC: Primary data saved (23868 records). [2025-10-31T17:29:06.605863] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-31T17:29:06.605934] [INFO ] [MAIN ] Update Progress: 240/2365 symbols completed. BDC took 16.4s. Estimated remaining: 4h 17m 6s. Rate: 8.3 symbols/min [2025-10-31T17:29:07.285897] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:07.333948] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:07.304742] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:07.373241] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:07.408264] [DEBUG] [LOCAL ] BDJ: Loaded 29022 existing records from primary storage. [2025-10-31T17:29:07.419328] [INFO ] [MAIN ] BDJ: Loaded 29022 existing records. [2025-10-31T17:29:07.618966] [DEBUG] [LOCAL ] BE: Loaded 54051 existing records from primary storage. [2025-10-31T17:29:07.648460] [INFO ] [MAIN ] BE: Loaded 54051 existing records. [2025-10-31T17:29:07.648260] [DEBUG] [LOCAL ] BDN: Loaded 47889 existing records from primary storage. [2025-10-31T17:29:07.671006] [DEBUG] [LOCAL ] BDX: Loaded 52404 existing records from primary storage. [2025-10-31T17:29:07.700579] [INFO ] [MAIN ] BDN: Loaded 47889 existing records. [2025-10-31T17:29:07.723955] [INFO ] [MAIN ] BDX: Loaded 52404 existing records. [2025-10-31T17:29:07.963367] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:29:08.017232] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-31T17:29:08.041619] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-31T17:29:08.235995] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-31T17:29:08.295598] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-31T17:29:08.498588] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:29:08.579928] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:29:08.595815] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-31T17:29:08.637703] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-31T17:29:08.642079] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-31T17:29:08.670423] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-31T17:29:08.689898] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:29:08.728199] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-31T17:29:08.705681] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-31T17:29:08.700405] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-31T17:29:08.758534] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-31T17:29:08.758462] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-31T17:29:08.778717] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-31T17:29:08.853470] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-31T17:29:08.923385] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-31T17:29:09.406454] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:09.445829] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-31T17:29:09.961010] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:10.033128] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-31T17:29:10.092212] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:10.092532] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-31T17:29:10.096248] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:10.097086] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-31T17:29:10.783635] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T17:29:10.790186] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-31T17:29:11.443225] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T17:29:11.454163] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-31T17:29:11.483571] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T17:29:11.493236] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-31T17:29:11.754156] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T17:29:11.760987] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-31T17:29:11.866472] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-31T17:29:12.257689] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-31T17:29:12.618220] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T17:29:12.661595] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T17:29:12.686710] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T17:29:13.057685] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-31T17:29:13.717040] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T17:29:13.857715] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-31T17:29:14.360974] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:29:14.657688] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-31T17:29:15.457620] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-31T17:29:15.607145] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-31T17:29:15.737812] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T17:29:16.257624] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-31T17:29:16.717844] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T17:29:17.057676] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-31T17:29:17.857637] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-31T17:29:17.994702] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-31T17:29:18.092232] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-31T17:29:18.657727] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-31T17:29:19.012689] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T17:29:19.457676] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-31T17:29:20.222988] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-31T17:29:20.257618] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-31T17:29:20.308186] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-31T17:29:21.057676] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-31T17:29:21.773442] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T17:29:21.857629] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-31T17:29:22.228391] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T17:29:22.657615] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-31T17:29:22.698365] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T17:29:23.457635] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-31T17:29:24.067446] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T17:29:24.214637] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T17:29:24.257699] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-31T17:29:25.057685] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-31T17:29:25.571476] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T17:29:25.857699] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-31T17:29:26.390755] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T17:29:26.657717] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-31T17:29:26.776900] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T17:29:27.457670] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-31T17:29:28.259521] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-31T17:29:28.266523] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-31T17:29:28.686742] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T17:29:28.988887] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-31T17:29:29.057636] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-31T17:29:29.857677] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-31T17:29:30.067296] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T17:29:30.074461] [INFO ] [REMOTE ] BDJ: Full fetch complete (42454 records). [2025-10-31T17:29:30.074610] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-31T17:29:30.451194] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-31T17:29:30.451271] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-31T17:29:30.451797] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-31T17:29:30.451859] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-31T17:29:30.452796] [DEBUG] [LOCAL ] BDJ: Trimmed 42454 records to 29179 (keeping 200 days of data) [2025-10-31T17:29:30.623797] [DEBUG] [LOCAL ] BDJ: Primary data saved (29179 records). [2025-10-31T17:29:30.623937] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-31T17:29:30.624016] [INFO ] [MAIN ] Update Progress: 241/2365 symbols completed. BDJ took 24.0s. Estimated remaining: 4h 19m 27s. Rate: 8.2 symbols/min [2025-10-31T17:29:30.666902] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-31T17:29:30.800695] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:30.800887] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-31T17:29:30.800929] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-31T17:29:30.801042] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-31T17:29:30.801084] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-31T17:29:30.801141] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-31T17:29:30.801173] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-31T17:29:31.158373] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:31.248775] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T17:29:31.457676] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-31T17:29:31.915218] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T17:29:32.257687] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-31T17:29:32.863610] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T17:29:33.057699] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-31T17:29:33.381474] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-31T17:29:33.857679] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-31T17:29:34.247689] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-31T17:29:34.657679] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-31T17:29:35.224827] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T17:29:35.457704] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-31T17:29:36.257710] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-31T17:29:36.468575] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-31T17:29:36.690370] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T17:29:36.869131] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-31T17:29:37.057705] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-31T17:29:37.717331] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T17:29:37.857674] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-31T17:29:38.657689] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-31T17:29:39.457672] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-31T17:29:40.035146] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-31T17:29:40.048353] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-31T17:29:40.048531] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-31T17:29:40.295760] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-31T17:29:40.505524] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-31T17:29:40.532118] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-31T17:29:40.538437] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-31T17:29:40.540172] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-31T17:29:40.541029] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-31T17:29:40.543902] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-31T17:29:40.556091] [INFO ] [REMOTE ] BDX: Full fetch complete (75367 records). [2025-10-31T17:29:40.557836] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-31T17:29:40.558767] [INFO ] [REMOTE ] BDN: Full fetch complete (69419 records). [2025-10-31T17:29:40.580174] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 54441 (keeping 200 days of data) [2025-10-31T17:29:40.604696] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-31T17:29:40.738933] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-31T17:29:41.066390] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-31T17:29:41.454779] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T17:29:41.552481] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-31T17:29:41.585391] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-31T17:29:41.638083] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-31T17:29:41.671616] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-31T17:29:41.720357] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-31T17:29:41.720588] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-31T17:29:41.721623] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-31T17:29:41.763003] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-31T17:29:41.790905] [DEBUG] [LOCAL ] BDX: Trimmed 75367 records to 52789 (keeping 200 days of data) [2025-10-31T17:29:41.867062] [DEBUG] [LOCAL ] BE: Primary data saved (54441 records). [2025-10-31T17:29:41.866882] [DEBUG] [LOCAL ] BDN: Trimmed 69419 records to 48232 (keeping 200 days of data) [2025-10-31T17:29:41.866972] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-31T17:29:41.875592] [INFO ] [MAIN ] BE: Full history saved. [2025-10-31T17:29:41.877514] [INFO ] [MAIN ] Update Progress: 242/2365 symbols completed. BE took 35.3s. Estimated remaining: 4h 19m 54s. Rate: 8.2 symbols/min [2025-10-31T17:29:42.199835] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-31T17:29:42.199743] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:42.565140] [DEBUG] [LOCAL ] BEKE: Loaded 53544 existing records from primary storage. [2025-10-31T17:29:42.584212] [INFO ] [MAIN ] BEKE: Loaded 53544 existing records. [2025-10-31T17:29:42.659044] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-31T17:29:42.643241] [DEBUG] [LOCAL ] BDX: Primary data saved (52789 records). [2025-10-31T17:29:42.686560] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-31T17:29:42.705496] [DEBUG] [LOCAL ] BDN: Primary data saved (48232 records). [2025-10-31T17:29:42.695794] [INFO ] [MAIN ] Update Progress: 243/2365 symbols completed. BDX took 36.1s. Estimated remaining: 4h 18m 50s. Rate: 8.2 symbols/min [2025-10-31T17:29:42.726712] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-31T17:29:42.766449] [INFO ] [MAIN ] Update Progress: 244/2365 symbols completed. BDN took 36.2s. Estimated remaining: 4h 17m 39s. Rate: 8.2 symbols/min [2025-10-31T17:29:42.910678] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-31T17:29:43.024679] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:29:43.063499] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-31T17:29:43.076928] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-31T17:29:43.116450] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-31T17:29:43.110467] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:43.121755] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-31T17:29:43.254983] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:43.466318] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-31T17:29:43.533435] [DEBUG] [LOCAL ] BEN: Loaded 53473 existing records from primary storage. [2025-10-31T17:29:43.603463] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:43.603580] [INFO ] [MAIN ] BEN: Loaded 53473 existing records. [2025-10-31T17:29:43.685142] [DEBUG] [LOCAL ] BEP: Loaded 39132 existing records from primary storage. [2025-10-31T17:29:43.702188] [INFO ] [MAIN ] BEP: Loaded 39132 existing records. [2025-10-31T17:29:43.812684] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-31T17:29:44.000278] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:29:44.022397] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-31T17:29:44.027346] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-31T17:29:44.027171] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:29:44.027685] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-31T17:29:44.027769] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-31T17:29:44.027960] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-31T17:29:44.028050] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-31T17:29:44.060711] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-31T17:29:44.092738] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-31T17:29:44.262864] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-31T17:29:44.731416] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T17:29:44.802140] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:44.781565] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:45.057674] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-31T17:29:45.857690] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-31T17:29:46.263667] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-31T17:29:46.264530] [INFO ] [REMOTE ] BEDU: Full fetch complete (1311 records). [2025-10-31T17:29:46.264594] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-31T17:29:46.464049] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-10-31T17:29:46.464275] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:29:46.464452] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:29:46.464540] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-31T17:29:46.464817] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-31T17:29:46.464888] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-31T17:29:46.465108] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-31T17:29:46.465197] [INFO ] [MAIN ] Update Progress: 245/2365 symbols completed. BEDU took 15.8s. Estimated remaining: 4h 17m 1s. Rate: 8.2 symbols/min [2025-10-31T17:29:46.577843] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T17:29:46.660466] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-31T17:29:46.683845] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:29:46.730564] [DEBUG] [LOCAL ] BEPC: Loaded 46566 existing records from primary storage. [2025-10-31T17:29:46.730956] [INFO ] [MAIN ] BEPC: Loaded 46566 existing records. [2025-10-31T17:29:46.906502] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:29:46.906716] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-31T17:29:46.906770] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-31T17:29:46.907389] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-31T17:29:46.907445] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-31T17:29:47.251780] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:29:47.457624] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-31T17:29:48.121325] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T17:29:48.257737] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-31T17:29:48.729906] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T17:29:49.057684] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-31T17:29:49.204078] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T17:29:49.857728] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-31T17:29:50.366147] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T17:29:50.657672] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-31T17:29:50.972553] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:29:51.457625] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-31T17:29:51.969361] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-31T17:29:52.257664] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-31T17:29:52.585987] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-31T17:29:53.057693] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-31T17:29:53.587973] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T17:29:53.857666] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-31T17:29:54.299409] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T17:29:54.657668] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-31T17:29:54.814549] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-31T17:29:55.457694] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-31T17:29:55.735482] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T17:29:56.257730] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-31T17:29:56.974520] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-31T17:29:57.057706] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-31T17:29:57.392158] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:29:57.857667] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-31T17:29:58.436294] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T17:29:58.657711] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-31T17:29:58.920763] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T17:29:59.457675] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-31T17:29:59.801102] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-31T17:30:00.257669] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-31T17:30:00.929938] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T17:30:01.057631] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-31T17:30:01.857730] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-31T17:30:02.278338] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-31T17:30:02.657757] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-31T17:30:02.734213] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-31T17:30:03.433023] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-31T17:30:03.457732] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-31T17:30:03.747621] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T17:30:04.257675] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-31T17:30:05.057638] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-31T17:30:05.152876] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-31T17:30:05.817894] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-31T17:30:05.857630] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-31T17:30:06.122660] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T17:30:06.657710] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-31T17:30:07.366482] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T17:30:07.457667] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-31T17:30:08.026368] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T17:30:08.257677] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-31T17:30:08.848707] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T17:30:09.057696] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-31T17:30:09.471401] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T17:30:09.857676] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-31T17:30:10.595131] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-31T17:30:10.657724] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-31T17:30:11.457689] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-31T17:30:11.590633] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-31T17:30:11.600964] [INFO ] [REMOTE ] BEP: Full fetch complete (58874 records). [2025-10-31T17:30:11.601119] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-31T17:30:11.601794] [FATAL] [VALIDATOR ] BEP: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:30:11.601885] [FATAL] [MAIN ] BEP: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:30:11.601928] [WARN ] [MAIN ] BEP: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:30:11.602004] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-31T17:30:11.602124] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-31T17:30:11.602179] [INFO ] [LOCAL ] BEP: Starting deletion of derivative data. [2025-10-31T17:30:11.602324] [DEBUG] [LOCAL ] BEP: Deleted derivative data file. [2025-10-31T17:30:11.602398] [INFO ] [MAIN ] Update Progress: 246/2365 symbols completed. BEP took 28.8s. Estimated remaining: 4h 19m 27s. Rate: 8.2 symbols/min [2025-10-31T17:30:11.800876] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:30:11.838043] [DEBUG] [LOCAL ] BEPH: Loaded 4772 existing records from primary storage. [2025-10-31T17:30:11.838868] [INFO ] [MAIN ] BEPH: Loaded 4772 existing records. [2025-10-31T17:30:11.841066] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T17:30:12.044565] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:30:12.044831] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-31T17:30:12.044879] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-31T17:30:12.045026] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-31T17:30:12.045065] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-31T17:30:12.262968] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-31T17:30:12.394997] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:30:13.057680] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-31T17:30:13.557394] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-31T17:30:13.795126] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T17:30:13.857605] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-31T17:30:13.991122] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-31T17:30:14.657639] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-31T17:30:15.014262] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T17:30:15.230741] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T17:30:15.457665] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-31T17:30:16.257676] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-31T17:30:17.062850] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-31T17:30:17.079011] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T17:30:17.092916] [INFO ] [REMOTE ] BEN: Full fetch complete (77038 records). [2025-10-31T17:30:17.093174] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-31T17:30:17.501817] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-31T17:30:17.501917] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-31T17:30:17.502738] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-31T17:30:17.502801] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-31T17:30:17.504236] [DEBUG] [LOCAL ] BEN: Trimmed 77038 records to 53861 (keeping 200 days of data) [2025-10-31T17:30:17.824185] [DEBUG] [LOCAL ] BEN: Primary data saved (53861 records). [2025-10-31T17:30:17.824325] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-31T17:30:17.824404] [INFO ] [MAIN ] Update Progress: 247/2365 symbols completed. BEN took 35.1s. Estimated remaining: 4h 19m 10s. Rate: 8.2 symbols/min [2025-10-31T17:30:17.869303] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-31T17:30:18.005483] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:30:18.011048] [DEBUG] [LOCAL ] BEPI: Loaded 3450 existing records from primary storage. [2025-10-31T17:30:18.011277] [INFO ] [MAIN ] BEPI: Loaded 3450 existing records. [2025-10-31T17:30:18.200708] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:30:18.201037] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-31T17:30:18.201154] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-31T17:30:18.201361] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-31T17:30:18.201429] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-31T17:30:18.463695] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T17:30:18.606935] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:30:18.625073] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-31T17:30:18.636721] [INFO ] [REMOTE ] BEPC: Full fetch complete (68863 records). [2025-10-31T17:30:18.636992] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-31T17:30:18.659373] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-31T17:30:18.780209] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-31T17:30:19.110116] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-31T17:30:19.110228] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-31T17:30:19.111012] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-31T17:30:19.111075] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-31T17:30:19.112356] [DEBUG] [LOCAL ] BEPC: Trimmed 68863 records to 46945 (keeping 200 days of data) [2025-10-31T17:30:19.203244] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T17:30:19.392014] [DEBUG] [LOCAL ] BEPC: Primary data saved (46945 records). [2025-10-31T17:30:19.392151] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-31T17:30:19.392229] [INFO ] [MAIN ] Update Progress: 248/2365 symbols completed. BEPC took 32.9s. Estimated remaining: 4h 18m 14s. Rate: 8.2 symbols/min [2025-10-31T17:30:19.462855] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-31T17:30:19.559395] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:30:19.564295] [DEBUG] [LOCAL ] BEPJ: Loaded 3054 existing records from primary storage. [2025-10-31T17:30:19.564452] [INFO ] [MAIN ] BEPJ: Loaded 3054 existing records. [2025-10-31T17:30:19.752729] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:30:19.753001] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-31T17:30:19.753048] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-31T17:30:19.753182] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-31T17:30:19.753222] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-31T17:30:20.097960] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:30:20.257730] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-31T17:30:20.728796] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T17:30:20.778972] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:30:21.057696] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-31T17:30:21.465586] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-31T17:30:21.857680] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-31T17:30:22.172026] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T17:30:22.657628] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-31T17:30:22.976774] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-31T17:30:23.457683] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-31T17:30:23.782954] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-31T17:30:24.257702] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-31T17:30:24.563236] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T17:30:25.057726] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-31T17:30:25.335510] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-31T17:30:25.857692] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-31T17:30:26.290579] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-31T17:30:26.657684] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-31T17:30:26.967368] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-31T17:30:27.457706] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-31T17:30:28.050101] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T17:30:28.257691] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-31T17:30:28.623998] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T17:30:29.057677] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-31T17:30:29.430861] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T17:30:29.857692] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-31T17:30:30.657698] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-31T17:30:31.054093] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-31T17:30:31.403877] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T17:30:31.417071] [INFO ] [REMOTE ] BEKE: Full fetch complete (76919 records). [2025-10-31T17:30:31.417224] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-31T17:30:31.418043] [FATAL] [VALIDATOR ] BEKE: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:30:31.418129] [FATAL] [MAIN ] BEKE: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:30:31.418182] [WARN ] [MAIN ] BEKE: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:30:31.418289] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-31T17:30:31.418367] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-10-31T17:30:31.418419] [INFO ] [LOCAL ] BEKE: Starting deletion of derivative data. [2025-10-31T17:30:31.418575] [DEBUG] [LOCAL ] BEKE: Deleted derivative data file. [2025-10-31T17:30:31.418721] [INFO ] [MAIN ] Update Progress: 249/2365 symbols completed. BEKE took 49.5s. Estimated remaining: 4h 18m 47s. Rate: 8.2 symbols/min [2025-10-31T17:30:31.462738] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-31T17:30:31.594939] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:30:31.631365] [DEBUG] [LOCAL ] BFAM: Loaded 34193 existing records from primary storage. [2025-10-31T17:30:31.631667] [INFO ] [MAIN ] BFAM: Loaded 34193 existing records. [2025-10-31T17:30:31.845242] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:30:31.845448] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-31T17:30:31.845495] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-31T17:30:31.845897] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-31T17:30:31.845957] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-31T17:30:32.135004] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T17:30:32.213330] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:30:32.257630] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-31T17:30:33.057710] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-31T17:30:33.367215] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T17:30:33.425507] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-31T17:30:33.857638] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-31T17:30:34.161599] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-31T17:30:34.657683] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-31T17:30:35.037732] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-31T17:30:35.038689] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4168 records). [2025-10-31T17:30:35.038769] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-31T17:30:35.394858] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-31T17:30:35.394931] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-31T17:30:35.395055] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-31T17:30:35.395092] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-31T17:30:35.395422] [DEBUG] [LOCAL ] BEPJ: Trimmed 4168 records to 3060 (keeping 200 days of data) [2025-10-31T17:30:35.413524] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3060 records). [2025-10-31T17:30:35.413587] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-31T17:30:35.413673] [INFO ] [MAIN ] Update Progress: 250/2365 symbols completed. BEPJ took 16.0s. Estimated remaining: 4h 18m 11s. Rate: 8.2 symbols/min [2025-10-31T17:30:35.466910] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-31T17:30:35.589573] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:30:35.626038] [DEBUG] [LOCAL ] BFH: Loaded 41335 existing records from primary storage. [2025-10-31T17:30:35.626340] [INFO ] [MAIN ] BFH: Loaded 41335 existing records. [2025-10-31T17:30:35.802686] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:30:35.802925] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-31T17:30:35.802979] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-31T17:30:35.803267] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-31T17:30:35.803323] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-31T17:30:36.065529] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T17:30:36.164534] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:30:36.257686] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-31T17:30:36.629187] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-31T17:30:37.057676] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-31T17:30:37.857673] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-31T17:30:38.350048] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T17:30:38.360732] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T17:30:38.657723] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-31T17:30:39.457700] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-31T17:30:39.825934] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T17:30:39.894987] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T17:30:40.257711] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-31T17:30:40.598136] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-31T17:30:41.057705] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-31T17:30:41.857679] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-31T17:30:41.979997] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T17:30:42.305236] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-31T17:30:42.657671] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-31T17:30:43.457672] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-31T17:30:43.802174] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T17:30:43.917796] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-31T17:30:44.257727] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-31T17:30:45.057705] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-31T17:30:45.525130] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T17:30:45.564567] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-31T17:30:45.565761] [INFO ] [REMOTE ] BEPI: Full fetch complete (4746 records). [2025-10-31T17:30:45.565827] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-31T17:30:45.862707] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-31T17:30:45.920582] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-31T17:30:45.920680] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-31T17:30:45.920853] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-31T17:30:45.920895] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-31T17:30:45.921249] [DEBUG] [LOCAL ] BEPI: Trimmed 4746 records to 3499 (keeping 200 days of data) [2025-10-31T17:30:45.942105] [DEBUG] [LOCAL ] BEPI: Primary data saved (3499 records). [2025-10-31T17:30:45.942179] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-31T17:30:45.942248] [INFO ] [MAIN ] Update Progress: 251/2365 symbols completed. BEPI took 28.1s. Estimated remaining: 4h 18m 31s. Rate: 8.2 symbols/min [2025-10-31T17:30:46.111406] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:30:46.111541] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-31T17:30:46.111578] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-31T17:30:46.111710] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-31T17:30:46.111760] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-31T17:30:46.111804] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-31T17:30:46.111837] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-31T17:30:46.466549] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:30:46.657719] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-31T17:30:47.030746] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T17:30:47.325158] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-31T17:30:47.457633] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-31T17:30:48.257678] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-31T17:30:48.622772] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T17:30:48.946255] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T17:30:48.947858] [INFO ] [REMOTE ] BEPH: Full fetch complete (7451 records). [2025-10-31T17:30:48.947962] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-31T17:30:49.057680] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-31T17:30:49.325617] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-31T17:30:49.325728] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-31T17:30:49.325975] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-31T17:30:49.326021] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-31T17:30:49.326421] [DEBUG] [LOCAL ] BEPH: Trimmed 7451 records to 4825 (keeping 200 days of data) [2025-10-31T17:30:49.355815] [DEBUG] [LOCAL ] BEPH: Primary data saved (4825 records). [2025-10-31T17:30:49.355947] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-31T17:30:49.356028] [INFO ] [MAIN ] Update Progress: 252/2365 symbols completed. BEPH took 37.8s. Estimated remaining: 4h 17m 50s. Rate: 8.2 symbols/min [2025-10-31T17:30:49.522896] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:30:49.523053] [DEBUG] [LOCAL ] BFLY: No existing data file found in primary storage. [2025-10-31T17:30:49.523090] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-10-31T17:30:49.523197] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-31T17:30:49.523236] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-31T17:30:49.523277] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-31T17:30:49.523308] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-31T17:30:49.862786] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-31T17:30:49.900827] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:30:50.277582] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T17:30:50.403076] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T17:30:50.657703] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-31T17:30:51.457721] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-31T17:30:52.094549] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-31T17:30:52.257631] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-31T17:30:52.310757] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-31T17:30:53.057682] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-31T17:30:53.454051] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T17:30:53.811144] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T17:30:53.857686] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-31T17:30:54.657674] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-31T17:30:55.191904] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T17:30:55.319262] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T17:30:55.457634] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-31T17:30:56.003032] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-31T17:30:56.257717] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-31T17:30:57.057750] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-31T17:30:57.543743] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T17:30:57.857672] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-31T17:30:58.046803] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-31T17:30:58.495131] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-31T17:30:58.657670] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-31T17:30:59.279940] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-31T17:30:59.457684] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-31T17:31:00.109618] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T17:31:00.257675] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-31T17:31:01.057712] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-31T17:31:01.178119] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T17:31:01.182188] [INFO ] [REMOTE ] BFK: Full fetch complete (19717 records). [2025-10-31T17:31:01.182269] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-31T17:31:01.534155] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-31T17:31:01.534234] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-31T17:31:01.534572] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-31T17:31:01.534611] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-31T17:31:01.535248] [DEBUG] [LOCAL ] BFK: Trimmed 19717 records to 14059 (keeping 200 days of data) [2025-10-31T17:31:01.615517] [DEBUG] [LOCAL ] BFK: Primary data saved (14059 records). [2025-10-31T17:31:01.615670] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-31T17:31:01.615758] [INFO ] [MAIN ] Update Progress: 253/2365 symbols completed. BFK took 15.7s. Estimated remaining: 4h 18m 24s. Rate: 8.2 symbols/min [2025-10-31T17:31:01.802628] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:31:01.802852] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-10-31T17:31:01.802908] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-10-31T17:31:01.803056] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-31T17:31:01.803112] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-31T17:31:01.803182] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-31T17:31:01.803268] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-31T17:31:01.866493] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-31T17:31:02.234395] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:31:02.416498] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T17:31:02.657680] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-31T17:31:02.765921] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-31T17:31:03.066027] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-31T17:31:03.457687] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-31T17:31:04.257677] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-31T17:31:04.570086] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T17:31:04.775823] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T17:31:05.057724] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-31T17:31:05.857693] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-31T17:31:06.296609] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T17:31:06.657698] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-31T17:31:06.994456] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T17:31:07.457626] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-31T17:31:07.650704] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-31T17:31:08.257678] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-31T17:31:08.821687] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T17:31:09.057675] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-31T17:31:09.613188] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T17:31:09.622956] [INFO ] [REMOTE ] BFH: Full fetch complete (60295 records). [2025-10-31T17:31:09.623076] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-31T17:31:09.866747] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-31T17:31:10.010614] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-31T17:31:10.010732] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-31T17:31:10.011468] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-31T17:31:10.011587] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-31T17:31:10.020557] [DEBUG] [LOCAL ] BFH: Trimmed 60295 records to 41636 (keeping 200 days of data) [2025-10-31T17:31:10.034323] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-31T17:31:10.296407] [DEBUG] [LOCAL ] BFH: Primary data saved (41636 records). [2025-10-31T17:31:10.296583] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-31T17:31:10.296686] [INFO ] [MAIN ] Update Progress: 254/2365 symbols completed. BFH took 34.9s. Estimated remaining: 4h 18m 28s. Rate: 8.2 symbols/min [2025-10-31T17:31:10.463546] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:31:10.476387] [DEBUG] [LOCAL ] BFZ: Loaded 11954 existing records from primary storage. [2025-10-31T17:31:10.476584] [INFO ] [MAIN ] BFZ: Loaded 11954 existing records. [2025-10-31T17:31:10.641139] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T17:31:10.661870] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-31T17:31:10.659893] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:31:10.663947] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-31T17:31:10.664047] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-31T17:31:10.664305] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-31T17:31:10.664367] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-31T17:31:11.112229] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:31:11.457679] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-31T17:31:12.133183] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-31T17:31:12.161517] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T17:31:12.257678] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-31T17:31:12.760150] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T17:31:13.057631] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-31T17:31:13.594616] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-31T17:31:13.857690] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-31T17:31:14.657703] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-31T17:31:14.817184] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T17:31:15.184179] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T17:31:15.457690] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-31T17:31:16.257720] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-31T17:31:17.038200] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-31T17:31:17.057616] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-31T17:31:17.554328] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T17:31:17.563237] [INFO ] [REMOTE ] BFAM: Full fetch complete (48036 records). [2025-10-31T17:31:17.563387] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-31T17:31:17.862871] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-31T17:31:17.948951] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-31T17:31:17.949028] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-31T17:31:17.949567] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-31T17:31:17.949607] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-31T17:31:17.950760] [DEBUG] [LOCAL ] BFAM: Trimmed 48036 records to 34555 (keeping 200 days of data) [2025-10-31T17:31:18.155995] [DEBUG] [LOCAL ] BFAM: Primary data saved (34555 records). [2025-10-31T17:31:18.156150] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-31T17:31:18.156233] [INFO ] [MAIN ] Update Progress: 255/2365 symbols completed. BFAM took 46.7s. Estimated remaining: 4h 18m 25s. Rate: 8.2 symbols/min [2025-10-31T17:31:18.330299] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:31:18.330515] [DEBUG] [LOCAL ] BG: No existing data file found in primary storage. [2025-10-31T17:31:18.330560] [WARN ] [MAIN ] BG: No existing data found, performing full refresh instead. [2025-10-31T17:31:18.330697] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-31T17:31:18.330750] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-31T17:31:18.330797] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-31T17:31:18.330832] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-31T17:31:18.499461] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T17:31:18.660291] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-31T17:31:18.722100] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:31:18.751102] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-31T17:31:19.204314] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-31T17:31:19.457671] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-31T17:31:19.971264] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-31T17:31:20.257669] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-31T17:31:21.057684] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-31T17:31:21.524989] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T17:31:21.857711] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-31T17:31:22.472481] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T17:31:22.657706] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-31T17:31:23.068201] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T17:31:23.457668] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-31T17:31:24.069135] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-31T17:31:24.257696] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-31T17:31:24.561511] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-31T17:31:24.574777] [INFO ] [REMOTE ] BFLY: Full fetch complete (75082 records). [2025-10-31T17:31:24.574959] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-31T17:31:24.575964] [FATAL] [VALIDATOR ] BFLY: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:31:24.576071] [FATAL] [MAIN ] BFLY: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:31:24.576116] [WARN ] [MAIN ] BFLY: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:31:24.576158] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-31T17:31:24.576218] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-31T17:31:24.576255] [INFO ] [LOCAL ] BFLY: Starting deletion of derivative data. [2025-10-31T17:31:24.576295] [DEBUG] [LOCAL ] BFLY: No derivative data file found to delete. [2025-10-31T17:31:24.576355] [INFO ] [MAIN ] Update Progress: 256/2365 symbols completed. BFLY took 35.2s. Estimated remaining: 4h 18m 10s. Rate: 8.2 symbols/min [2025-10-31T17:31:24.769380] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-31T17:31:24.772159] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:31:24.792290] [DEBUG] [LOCAL ] BGB: Loaded 16991 existing records from primary storage. [2025-10-31T17:31:24.792517] [INFO ] [MAIN ] BGB: Loaded 16991 existing records. [2025-10-31T17:31:24.963321] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:31:24.963542] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-31T17:31:24.963588] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-31T17:31:24.963764] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-31T17:31:24.963819] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-31T17:31:25.061338] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-31T17:31:25.321624] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:31:25.669293] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-31T17:31:25.857726] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-31T17:31:26.657687] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-31T17:31:27.162619] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:31:27.457625] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-31T17:31:27.487683] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T17:31:28.050119] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-31T17:31:28.257636] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-31T17:31:28.724826] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-31T17:31:29.057625] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-31T17:31:29.594884] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-31T17:31:29.857673] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-31T17:31:30.619000] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-31T17:31:30.622145] [INFO ] [REMOTE ] BFS: Full fetch complete (13068 records). [2025-10-31T17:31:30.622246] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-31T17:31:30.622767] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:31:30.622871] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:31:30.622946] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:31:30.623018] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-31T17:31:30.623082] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-31T17:31:30.623129] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-31T17:31:30.623203] [DEBUG] [LOCAL ] BFS: No derivative data file found to delete. [2025-10-31T17:31:30.623300] [INFO ] [MAIN ] Update Progress: 257/2365 symbols completed. BFS took 29.0s. Estimated remaining: 4h 17m 52s. Rate: 8.2 symbols/min [2025-10-31T17:31:30.662724] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-31T17:31:30.830018] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:31:30.848725] [DEBUG] [LOCAL ] BGH: Loaded 16760 existing records from primary storage. [2025-10-31T17:31:30.848958] [INFO ] [MAIN ] BGH: Loaded 16760 existing records. [2025-10-31T17:31:31.022897] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:31:31.023137] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-31T17:31:31.023188] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-31T17:31:31.023511] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-31T17:31:31.023568] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-31T17:31:31.372083] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:31:31.457605] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-31T17:31:32.113448] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T17:31:32.257617] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-31T17:31:32.288518] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-31T17:31:32.816355] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-31T17:31:33.057777] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-31T17:31:33.585023] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T17:31:33.857693] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-31T17:31:34.583338] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-31T17:31:34.657616] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-31T17:31:35.457705] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-31T17:31:35.965525] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T17:31:36.179380] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T17:31:36.182349] [INFO ] [REMOTE ] BFZ: Full fetch complete (17600 records). [2025-10-31T17:31:36.182423] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-31T17:31:36.182848] [FATAL] [VALIDATOR ] BFZ: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:31:36.182941] [FATAL] [MAIN ] BFZ: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:31:36.183031] [WARN ] [MAIN ] BFZ: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:31:36.183117] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-31T17:31:36.183192] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-31T17:31:36.183233] [INFO ] [LOCAL ] BFZ: Starting deletion of derivative data. [2025-10-31T17:31:36.183382] [DEBUG] [LOCAL ] BFZ: Deleted derivative data file. [2025-10-31T17:31:36.183467] [INFO ] [MAIN ] Update Progress: 258/2365 symbols completed. BFZ took 25.9s. Estimated remaining: 4h 17m 30s. Rate: 8.2 symbols/min [2025-10-31T17:31:36.262878] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-31T17:31:36.362236] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:31:36.376080] [DEBUG] [LOCAL ] BGR: Loaded 13046 existing records from primary storage. [2025-10-31T17:31:36.376267] [INFO ] [MAIN ] BGR: Loaded 13046 existing records. [2025-10-31T17:31:36.548061] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:31:36.548284] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-31T17:31:36.548338] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-31T17:31:36.548479] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-31T17:31:36.548516] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-31T17:31:36.900123] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:31:36.952113] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-31T17:31:37.057614] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-31T17:31:37.857621] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-31T17:31:37.973632] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T17:31:38.657624] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-31T17:31:38.736798] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T17:31:39.315978] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T17:31:39.457672] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-31T17:31:40.257721] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-31T17:31:40.734302] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T17:31:40.774547] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-31T17:31:41.057686] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-31T17:31:41.857728] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-31T17:31:41.950781] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-31T17:31:42.603028] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T17:31:42.657683] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-31T17:31:43.457690] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-31T17:31:44.130992] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T17:31:44.151167] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-31T17:31:44.257674] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-31T17:31:45.057673] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-31T17:31:45.609502] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T17:31:45.848955] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-31T17:31:45.857605] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-31T17:31:46.497871] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T17:31:46.657697] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-31T17:31:47.457686] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-31T17:31:47.927161] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T17:31:48.248286] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-31T17:31:48.257604] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-31T17:31:48.960894] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-31T17:31:49.057701] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-31T17:31:49.857614] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-31T17:31:49.921324] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-31T17:31:50.608248] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-31T17:31:50.657615] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-31T17:31:51.340240] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T17:31:51.457722] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-31T17:31:52.079613] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-31T17:31:52.257715] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-31T17:31:53.063597] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-31T17:31:53.069383] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T17:31:53.076980] [INFO ] [REMOTE ] BGB: Full fetch complete (26253 records). [2025-10-31T17:31:53.077162] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-31T17:31:53.530930] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-31T17:31:53.531087] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-31T17:31:53.531563] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-31T17:31:53.531609] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-31T17:31:53.532430] [DEBUG] [LOCAL ] BGB: Trimmed 26253 records to 17236 (keeping 200 days of data) [2025-10-31T17:31:53.627256] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-31T17:31:53.651301] [DEBUG] [LOCAL ] BGB: Primary data saved (17236 records). [2025-10-31T17:31:53.651411] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-31T17:31:53.651483] [INFO ] [MAIN ] Update Progress: 259/2365 symbols completed. BGB took 29.1s. Estimated remaining: 4h 18m 45s. Rate: 8.1 symbols/min [2025-10-31T17:31:53.821558] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:31:53.857698] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-31T17:31:53.874725] [DEBUG] [LOCAL ] BGS: Loaded 50834 existing records from primary storage. [2025-10-31T17:31:53.875080] [INFO ] [MAIN ] BGS: Loaded 50834 existing records. [2025-10-31T17:31:54.050566] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:31:54.050819] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-31T17:31:54.050866] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-31T17:31:54.051179] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-31T17:31:54.051219] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-31T17:31:54.413284] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:31:54.657634] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-31T17:31:54.726782] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T17:31:55.457694] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-31T17:31:55.882122] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T17:31:56.058096] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T17:31:56.257672] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-31T17:31:56.967870] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-31T17:31:57.057702] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-31T17:31:57.769125] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T17:31:57.857626] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-31T17:31:58.431701] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-31T17:31:58.443236] [INFO ] [REMOTE ] BG: Full fetch complete (73036 records). [2025-10-31T17:31:58.443358] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-31T17:31:58.670248] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-31T17:31:58.868100] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-31T17:31:58.868188] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-31T17:31:58.869044] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-31T17:31:58.869110] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-31T17:31:58.870490] [DEBUG] [LOCAL ] BG: Trimmed 73036 records to 51068 (keeping 200 days of data) [2025-10-31T17:31:59.170365] [DEBUG] [LOCAL ] BG: Primary data saved (51068 records). [2025-10-31T17:31:59.170490] [INFO ] [MAIN ] BG: Full history saved. [2025-10-31T17:31:59.170560] [INFO ] [MAIN ] Update Progress: 260/2365 symbols completed. BG took 41.0s. Estimated remaining: 4h 18m 23s. Rate: 8.1 symbols/min [2025-10-31T17:31:59.346085] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:31:59.355952] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-31T17:31:59.366699] [DEBUG] [LOCAL ] BGSF: Loaded 8411 existing records from primary storage. [2025-10-31T17:31:59.366909] [INFO ] [MAIN ] BGSF: Loaded 8411 existing records. [2025-10-31T17:31:59.463458] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-31T17:31:59.545395] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:31:59.545639] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-31T17:31:59.545745] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-31T17:31:59.545890] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-31T17:31:59.545928] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-31T17:31:59.906508] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:00.099802] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T17:32:00.257723] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-31T17:32:00.896368] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-31T17:32:01.057683] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-31T17:32:01.363880] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T17:32:01.857679] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-31T17:32:02.657613] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-31T17:32:02.728775] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-31T17:32:03.058813] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T17:32:03.457719] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-31T17:32:03.818734] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-31T17:32:04.257690] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-31T17:32:04.569937] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-31T17:32:05.057668] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-31T17:32:05.857681] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-31T17:32:06.379470] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T17:32:06.657637] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-31T17:32:06.729999] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T17:32:06.734543] [INFO ] [REMOTE ] BGH: Full fetch complete (23016 records). [2025-10-31T17:32:06.734738] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-31T17:32:06.735231] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:32:06.735319] [FATAL] [MAIN ] BGH: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:32:06.735362] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:32:06.735442] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-31T17:32:06.735517] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-31T17:32:06.735584] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-10-31T17:32:06.735769] [DEBUG] [LOCAL ] BGH: Deleted derivative data file. [2025-10-31T17:32:06.735859] [INFO ] [MAIN ] Update Progress: 261/2365 symbols completed. BGH took 36.1s. Estimated remaining: 4h 18m 17s. Rate: 8.1 symbols/min [2025-10-31T17:32:06.909753] [INFO ] [MAIN ] BGSI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:06.909969] [DEBUG] [LOCAL ] BGSI: No existing data file found in primary storage. [2025-10-31T17:32:06.910024] [WARN ] [MAIN ] BGSI: No existing data found, performing full refresh instead. [2025-10-31T17:32:06.910133] [INFO ] [MAIN ] BGSI: Wiping existing primary data before full refresh. [2025-10-31T17:32:06.910175] [INFO ] [LOCAL ] BGSI: Starting deletion of primary data. [2025-10-31T17:32:06.910216] [DEBUG] [LOCAL ] BGSI: No primary data file found to delete. [2025-10-31T17:32:06.910250] [INFO ] [MAIN ] BGSI: Starting full primary refresh. [2025-10-31T17:32:07.274915] [INFO ] [REMOTE ] BGSI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:07.457669] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-31T17:32:07.579672] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T17:32:07.582903] [INFO ] [REMOTE ] BGR: Full fetch complete (19839 records). [2025-10-31T17:32:07.582991] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-31T17:32:07.945113] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-31T17:32:07.945262] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-31T17:32:07.945635] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-31T17:32:07.945728] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-31T17:32:07.946462] [DEBUG] [LOCAL ] BGR: Trimmed 19839 records to 13100 (keeping 200 days of data) [2025-10-31T17:32:08.014304] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-31T17:32:08.038882] [DEBUG] [LOCAL ] BGR: Primary data saved (13100 records). [2025-10-31T17:32:08.039024] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-31T17:32:08.039106] [INFO ] [MAIN ] Update Progress: 262/2365 symbols completed. BGR took 31.9s. Estimated remaining: 4h 17m 21s. Rate: 8.2 symbols/min [2025-10-31T17:32:08.217677] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:08.234415] [DEBUG] [LOCAL ] BGT: Loaded 15852 existing records from primary storage. [2025-10-31T17:32:08.234615] [INFO ] [MAIN ] BGT: Loaded 15852 existing records. [2025-10-31T17:32:08.263361] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-31T17:32:08.432834] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:32:08.433121] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-31T17:32:08.433176] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-31T17:32:08.433456] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-31T17:32:08.433511] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-31T17:32:08.813333] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:09.057705] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-31T17:32:09.741811] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T17:32:09.782628] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T17:32:09.857692] [INFO ] [REMOTE ] BGSI: Fetching primary data for 2025-01. [2025-10-31T17:32:10.003808] [DEBUG] [REMOTE ] BGSI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:32:10.004153] [WARN ] [REMOTE ] BGSI: No data returned for month 2025-01 [2025-10-31T17:32:10.004262] [FATAL] [REMOTE ] BGSI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:32:10.004350] [FATAL] [MAIN ] BGSI: Failed to fetch primary data. [2025-10-31T17:32:10.004427] [WARN ] [MAIN ] BGSI: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:32:10.004513] [INFO ] [LOCAL ] BGSI: Starting deletion of primary data. [2025-10-31T17:32:10.004589] [DEBUG] [LOCAL ] BGSI: No primary data file found to delete. [2025-10-31T17:32:10.004636] [INFO ] [LOCAL ] BGSI: Starting deletion of derivative data. [2025-10-31T17:32:10.004775] [DEBUG] [LOCAL ] BGSI: No derivative data file found to delete. [2025-10-31T17:32:10.004839] [INFO ] [MAIN ] Update Progress: 263/2365 symbols completed. BGSI took 3.3s. Estimated remaining: 4h 16m 31s. Rate: 8.2 symbols/min [2025-10-31T17:32:10.185602] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:10.198411] [DEBUG] [LOCAL ] BGX: Loaded 11016 existing records from primary storage. [2025-10-31T17:32:10.198673] [INFO ] [MAIN ] BGX: Loaded 11016 existing records. [2025-10-31T17:32:10.387567] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:32:10.387789] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-31T17:32:10.387837] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-31T17:32:10.388024] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-31T17:32:10.388079] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-31T17:32:10.662767] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-31T17:32:10.756345] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:11.384062] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-31T17:32:11.457693] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-31T17:32:12.140422] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-31T17:32:12.257678] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-31T17:32:12.891295] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T17:32:13.057690] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-31T17:32:13.857713] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-31T17:32:14.238324] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T17:32:14.313045] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T17:32:14.657699] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-31T17:32:15.350636] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-31T17:32:15.457712] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-31T17:32:16.235078] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T17:32:16.257621] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-31T17:32:17.043370] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T17:32:17.046486] [INFO ] [REMOTE ] BGSF: Full fetch complete (9864 records). [2025-10-31T17:32:17.046560] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-31T17:32:17.066908] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-31T17:32:17.409670] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-31T17:32:17.409757] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-31T17:32:17.410005] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-31T17:32:17.410044] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-31T17:32:17.410463] [DEBUG] [LOCAL ] BGSF: Trimmed 9864 records to 8442 (keeping 200 days of data) [2025-10-31T17:32:17.458452] [DEBUG] [LOCAL ] BGSF: Primary data saved (8442 records). [2025-10-31T17:32:17.458574] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-31T17:32:17.458671] [INFO ] [MAIN ] Update Progress: 264/2365 symbols completed. BGSF took 18.3s. Estimated remaining: 4h 16m 24s. Rate: 8.2 symbols/min [2025-10-31T17:32:17.622469] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:17.642301] [DEBUG] [LOCAL ] BGY: Loaded 21243 existing records from primary storage. [2025-10-31T17:32:17.642531] [INFO ] [MAIN ] BGY: Loaded 21243 existing records. [2025-10-31T17:32:17.813529] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:32:17.813783] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-31T17:32:17.813859] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-31T17:32:17.814266] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-31T17:32:17.814335] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-31T17:32:17.862766] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-31T17:32:18.172744] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:18.587446] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T17:32:18.587840] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T17:32:18.657687] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-31T17:32:19.457700] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-31T17:32:19.847260] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T17:32:20.224287] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-31T17:32:20.257606] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-31T17:32:20.970302] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-31T17:32:21.057633] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-31T17:32:21.572571] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-31T17:32:21.857711] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-31T17:32:22.446027] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-31T17:32:22.657677] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-31T17:32:23.457677] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-31T17:32:23.506568] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T17:32:24.086249] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T17:32:24.257729] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-31T17:32:24.970864] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T17:32:24.974492] [INFO ] [REMOTE ] BGT: Full fetch complete (23509 records). [2025-10-31T17:32:24.974595] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-31T17:32:25.062825] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-31T17:32:25.379735] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-31T17:32:25.379822] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-31T17:32:25.380253] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-31T17:32:25.380318] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-31T17:32:25.381023] [DEBUG] [LOCAL ] BGT: Trimmed 23509 records to 15966 (keeping 200 days of data) [2025-10-31T17:32:25.477053] [DEBUG] [LOCAL ] BGT: Primary data saved (15966 records). [2025-10-31T17:32:25.477182] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-31T17:32:25.477263] [INFO ] [MAIN ] Update Progress: 265/2365 symbols completed. BGT took 17.4s. Estimated remaining: 4h 16m 23s. Rate: 8.2 symbols/min [2025-10-31T17:32:25.689249] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:25.697108] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T17:32:25.718499] [DEBUG] [LOCAL ] BH: Loaded 16799 existing records from primary storage. [2025-10-31T17:32:25.718818] [INFO ] [MAIN ] BH: Loaded 16799 existing records. [2025-10-31T17:32:25.862779] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-31T17:32:25.922785] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:32:25.922990] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-31T17:32:25.923038] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-31T17:32:25.923378] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-31T17:32:25.923435] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-31T17:32:26.289460] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:26.662488] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-31T17:32:26.666153] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T17:32:27.457720] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-31T17:32:27.963419] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T17:32:28.006830] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T17:32:28.257638] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-31T17:32:28.785088] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T17:32:29.057688] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-31T17:32:29.857683] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-31T17:32:30.258535] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-31T17:32:30.299345] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T17:32:30.657746] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-31T17:32:31.117474] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-31T17:32:31.457698] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-31T17:32:31.987894] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T17:32:32.257755] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-31T17:32:33.057736] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-31T17:32:33.565221] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-31T17:32:33.567052] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T17:32:33.857665] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-31T17:32:34.657630] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-31T17:32:34.836269] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-31T17:32:35.457674] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-31T17:32:36.145727] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T17:32:36.165742] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-31T17:32:36.170132] [INFO ] [REMOTE ] BGS: Full fetch complete (72729 records). [2025-10-31T17:32:36.170250] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-31T17:32:36.262747] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-31T17:32:36.552572] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-31T17:32:36.552695] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-31T17:32:36.553468] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-31T17:32:36.553517] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-31T17:32:36.554908] [DEBUG] [LOCAL ] BGS: Trimmed 72729 records to 51201 (keeping 200 days of data) [2025-10-31T17:32:36.841553] [DEBUG] [LOCAL ] BGS: Primary data saved (51201 records). [2025-10-31T17:32:36.841741] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-31T17:32:36.843053] [INFO ] [MAIN ] Update Progress: 266/2365 symbols completed. BGS took 43.2s. Estimated remaining: 4h 16m 47s. Rate: 8.2 symbols/min [2025-10-31T17:32:37.009070] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:37.056019] [DEBUG] [LOCAL ] BHC: Loaded 46776 existing records from primary storage. [2025-10-31T17:32:37.056310] [INFO ] [MAIN ] BHC: Loaded 46776 existing records. [2025-10-31T17:32:37.076486] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-31T17:32:37.195342] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-31T17:32:37.261063] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:32:37.261251] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-31T17:32:37.261298] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-31T17:32:37.261709] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-31T17:32:37.261766] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-31T17:32:37.613397] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:37.857625] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-31T17:32:37.973176] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-31T17:32:38.657692] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-31T17:32:39.077609] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T17:32:39.384159] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T17:32:39.457669] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-31T17:32:40.186896] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T17:32:40.257721] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-31T17:32:40.757139] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-31T17:32:41.057669] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-31T17:32:41.857677] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-31T17:32:42.175440] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T17:32:42.537320] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T17:32:42.657719] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-31T17:32:43.457633] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-31T17:32:43.536397] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T17:32:44.257721] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-31T17:32:44.560071] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T17:32:44.745705] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-31T17:32:45.057689] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-31T17:32:45.857729] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-31T17:32:45.943161] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-31T17:32:46.655940] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T17:32:46.659964] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-31T17:32:47.228491] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-31T17:32:47.457668] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-31T17:32:48.251190] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-31T17:32:48.257602] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-31T17:32:48.919459] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T17:32:49.057695] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-31T17:32:49.718544] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T17:32:49.857677] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-31T17:32:50.610305] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T17:32:50.614481] [INFO ] [REMOTE ] BH: Full fetch complete (19675 records). [2025-10-31T17:32:50.614576] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-31T17:32:50.662768] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-31T17:32:51.001665] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-31T17:32:51.001749] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-31T17:32:51.002197] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-31T17:32:51.002267] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-31T17:32:51.002965] [DEBUG] [LOCAL ] BH: Trimmed 19675 records to 16852 (keeping 200 days of data) [2025-10-31T17:32:51.099986] [DEBUG] [LOCAL ] BH: Primary data saved (16852 records). [2025-10-31T17:32:51.100124] [INFO ] [MAIN ] BH: Full history saved. [2025-10-31T17:32:51.100202] [INFO ] [MAIN ] Update Progress: 267/2365 symbols completed. BH took 25.6s. Estimated remaining: 4h 17m 34s. Rate: 8.1 symbols/min [2025-10-31T17:32:51.276533] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:51.276757] [DEBUG] [LOCAL ] BHE: No existing data file found in primary storage. [2025-10-31T17:32:51.276827] [WARN ] [MAIN ] BHE: No existing data found, performing full refresh instead. [2025-10-31T17:32:51.276999] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-31T17:32:51.277045] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-31T17:32:51.277088] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-10-31T17:32:51.277122] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-31T17:32:51.401038] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T17:32:51.462889] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-31T17:32:51.670180] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:52.257691] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-31T17:32:52.320334] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-31T17:32:52.323930] [INFO ] [REMOTE ] BGX: Full fetch complete (16555 records). [2025-10-31T17:32:52.324002] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-31T17:32:52.692036] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-31T17:32:52.692128] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-31T17:32:52.692489] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-31T17:32:52.692529] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-31T17:32:52.693075] [DEBUG] [LOCAL ] BGX: Trimmed 16555 records to 11131 (keeping 200 days of data) [2025-10-31T17:32:52.758338] [DEBUG] [LOCAL ] BGX: Primary data saved (11131 records). [2025-10-31T17:32:52.758467] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-31T17:32:52.758541] [INFO ] [MAIN ] Update Progress: 268/2365 symbols completed. BGX took 42.8s. Estimated remaining: 4h 16m 42s. Rate: 8.2 symbols/min [2025-10-31T17:32:52.929111] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:52.950340] [DEBUG] [LOCAL ] BHK: Loaded 24373 existing records from primary storage. [2025-10-31T17:32:52.950586] [INFO ] [MAIN ] BHK: Loaded 24373 existing records. [2025-10-31T17:32:53.062872] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-31T17:32:53.136556] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:32:53.136971] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-31T17:32:53.137087] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-31T17:32:53.142798] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-31T17:32:53.142955] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-31T17:32:53.164914] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T17:32:53.241033] [INFO ] [REMOTE ] BGY: Full fetch complete (32906 records). [2025-10-31T17:32:53.260365] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-31T17:32:53.859946] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-31T17:32:53.859833] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:53.953187] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-31T17:32:53.953331] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-31T17:32:53.953860] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-31T17:32:53.953942] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-31T17:32:53.955086] [DEBUG] [LOCAL ] BGY: Trimmed 32906 records to 21343 (keeping 200 days of data) [2025-10-31T17:32:54.067443] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T17:32:54.094346] [DEBUG] [LOCAL ] BGY: Primary data saved (21343 records). [2025-10-31T17:32:54.094464] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-31T17:32:54.094538] [INFO ] [MAIN ] Update Progress: 269/2365 symbols completed. BGY took 36.6s. Estimated remaining: 4h 15m 48s. Rate: 8.2 symbols/min [2025-10-31T17:32:54.263126] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:32:54.312449] [DEBUG] [LOCAL ] BHP: Loaded 53748 existing records from primary storage. [2025-10-31T17:32:54.312786] [INFO ] [MAIN ] BHP: Loaded 53748 existing records. [2025-10-31T17:32:54.488580] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:32:54.488826] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-31T17:32:54.488872] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-31T17:32:54.489306] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-31T17:32:54.489362] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-31T17:32:54.669626] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-31T17:32:54.857425] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:32:55.457629] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-31T17:32:55.470835] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-31T17:32:55.601298] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-31T17:32:56.257626] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-31T17:32:56.995105] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-31T17:32:57.057622] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-31T17:32:57.175176] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-31T17:32:57.857668] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-31T17:32:58.406035] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-31T17:32:58.437943] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-31T17:32:58.657707] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-31T17:32:59.457676] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-31T17:32:59.510490] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-31T17:33:00.137185] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-31T17:33:00.257706] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-31T17:33:01.057631] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-31T17:33:01.190774] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T17:33:01.857717] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-31T17:33:02.602117] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-31T17:33:02.657617] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-31T17:33:02.855290] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-31T17:33:03.457717] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-31T17:33:04.203124] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T17:33:04.257627] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-31T17:33:04.784569] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T17:33:05.057682] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-31T17:33:05.750799] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T17:33:05.844068] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-31T17:33:05.857631] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-31T17:33:06.657701] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-31T17:33:07.272105] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-31T17:33:07.457619] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-31T17:33:07.844431] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T17:33:08.257666] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-31T17:33:08.971587] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-31T17:33:09.057631] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-31T17:33:09.411023] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T17:33:09.857663] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-31T17:33:09.990725] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-31T17:33:10.657768] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-31T17:33:10.657834] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-31T17:33:11.457718] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-31T17:33:11.819508] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T17:33:12.257733] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-31T17:33:12.883755] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:33:12.927271] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T17:33:13.057624] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-31T17:33:13.857621] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-31T17:33:13.966095] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T17:33:14.657737] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-31T17:33:15.283783] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-31T17:33:15.457622] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-31T17:33:16.094898] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-31T17:33:16.106268] [INFO ] [REMOTE ] BHC: Full fetch complete (67730 records). [2025-10-31T17:33:16.106401] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-31T17:33:16.262857] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-31T17:33:16.500115] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-31T17:33:16.500189] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-31T17:33:16.500907] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-31T17:33:16.500969] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-31T17:33:16.502223] [DEBUG] [LOCAL ] BHC: Trimmed 67730 records to 47161 (keeping 200 days of data) [2025-10-31T17:33:16.754492] [DEBUG] [LOCAL ] BHC: Primary data saved (47161 records). [2025-10-31T17:33:16.754618] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-31T17:33:16.755561] [INFO ] [MAIN ] Update Progress: 270/2365 symbols completed. BHC took 39.9s. Estimated remaining: 4h 17m 40s. Rate: 8.1 symbols/min [2025-10-31T17:33:16.924023] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:33:16.947256] [DEBUG] [LOCAL ] BHR: Loaded 21889 existing records from primary storage. [2025-10-31T17:33:16.947952] [INFO ] [MAIN ] BHR: Loaded 21889 existing records. [2025-10-31T17:33:17.062775] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-31T17:33:17.138941] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:33:17.139441] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-31T17:33:17.139827] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-31T17:33:17.140438] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-31T17:33:17.140739] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-31T17:33:17.257718] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T17:33:17.552272] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:33:17.547290] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-31T17:33:17.564044] [INFO ] [REMOTE ] BHP: Full fetch complete (77061 records). [2025-10-31T17:33:17.564142] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-31T17:33:17.564876] [FATAL] [VALIDATOR ] BHP: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:33:17.564960] [FATAL] [MAIN ] BHP: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:33:17.565015] [WARN ] [MAIN ] BHP: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:33:17.565101] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-31T17:33:17.565180] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-31T17:33:17.565233] [INFO ] [LOCAL ] BHP: Starting deletion of derivative data. [2025-10-31T17:33:17.565401] [DEBUG] [LOCAL ] BHP: Deleted derivative data file. [2025-10-31T17:33:17.566146] [INFO ] [MAIN ] Update Progress: 271/2365 symbols completed. BHP took 23.5s. Estimated remaining: 4h 16m 42s. Rate: 8.2 symbols/min [2025-10-31T17:33:17.741317] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:33:17.741467] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-31T17:33:17.741526] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-31T17:33:17.741694] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-31T17:33:17.741767] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-31T17:33:17.741835] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-31T17:33:17.741895] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-31T17:33:17.862742] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-31T17:33:18.116992] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:33:18.131395] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T17:33:18.564217] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T17:33:18.657609] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-31T17:33:19.454059] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-31T17:33:19.459140] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-31T17:33:20.257617] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-31T17:33:20.431768] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T17:33:21.046774] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T17:33:21.057604] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-31T17:33:21.859248] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-31T17:33:21.861026] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T17:33:21.866068] [INFO ] [REMOTE ] BHE: Full fetch complete (36242 records). [2025-10-31T17:33:21.866143] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-31T17:33:21.866636] [FATAL] [VALIDATOR ] BHE: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:33:21.866738] [FATAL] [MAIN ] BHE: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:33:21.866800] [WARN ] [MAIN ] BHE: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:33:21.866869] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-31T17:33:21.866929] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-10-31T17:33:21.866965] [INFO ] [LOCAL ] BHE: Starting deletion of derivative data. [2025-10-31T17:33:21.867003] [DEBUG] [LOCAL ] BHE: No derivative data file found to delete. [2025-10-31T17:33:21.867054] [INFO ] [MAIN ] Update Progress: 272/2365 symbols completed. BHE took 30.8s. Estimated remaining: 4h 16m 11s. Rate: 8.2 symbols/min [2025-10-31T17:33:22.040721] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:33:22.087982] [DEBUG] [LOCAL ] BHVN: Loaded 50983 existing records from primary storage. [2025-10-31T17:33:22.088282] [INFO ] [MAIN ] BHVN: Loaded 50983 existing records. [2025-10-31T17:33:22.274258] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-31T17:33:22.279484] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:33:22.279772] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-31T17:33:22.280587] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-31T17:33:22.280828] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-31T17:33:22.280884] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-31T17:33:22.645097] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:33:22.657613] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-31T17:33:23.457673] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-31T17:33:23.811683] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T17:33:24.257658] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-31T17:33:24.339041] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-31T17:33:25.057613] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-31T17:33:25.244417] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T17:33:25.865337] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-31T17:33:25.868853] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T17:33:25.874363] [INFO ] [REMOTE ] BHK: Full fetch complete (30894 records). [2025-10-31T17:33:25.874440] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-31T17:33:25.874962] [FATAL] [VALIDATOR ] BHK: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:33:25.875041] [FATAL] [MAIN ] BHK: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:33:25.875107] [WARN ] [MAIN ] BHK: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:33:25.875176] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-31T17:33:25.875236] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-31T17:33:25.875271] [INFO ] [LOCAL ] BHK: Starting deletion of derivative data. [2025-10-31T17:33:25.875414] [DEBUG] [LOCAL ] BHK: Deleted derivative data file. [2025-10-31T17:33:25.875497] [INFO ] [MAIN ] Update Progress: 273/2365 symbols completed. BHK took 33.1s. Estimated remaining: 4h 15m 38s. Rate: 8.2 symbols/min [2025-10-31T17:33:26.045628] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:33:26.093071] [DEBUG] [LOCAL ] BILL: Loaded 52878 existing records from primary storage. [2025-10-31T17:33:26.093357] [INFO ] [MAIN ] BILL: Loaded 52878 existing records. [2025-10-31T17:33:26.269883] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:33:26.270101] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-31T17:33:26.270146] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-31T17:33:26.270589] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-31T17:33:26.270677] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-31T17:33:26.612204] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T17:33:26.652126] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:33:26.657614] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-31T17:33:27.354862] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T17:33:27.457618] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-31T17:33:28.257961] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-31T17:33:28.258032] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-31T17:33:29.057703] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-31T17:33:29.464093] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T17:33:29.761630] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T17:33:29.857623] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-31T17:33:30.657696] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-31T17:33:30.931932] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-31T17:33:31.287401] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T17:33:31.457694] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-31T17:33:32.257725] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-31T17:33:32.785480] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T17:33:32.992756] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-31T17:33:33.057727] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-31T17:33:33.857685] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-31T17:33:34.297660] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-31T17:33:34.453438] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T17:33:34.657692] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-31T17:33:35.457684] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-31T17:33:35.938957] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T17:33:36.257715] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-31T17:33:36.345634] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-31T17:33:37.057683] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-31T17:33:37.723787] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T17:33:37.757144] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T17:33:37.857673] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-31T17:33:38.657688] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-31T17:33:39.183613] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:33:39.457670] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-31T17:33:39.508586] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-31T17:33:39.723738] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-31T17:33:40.257726] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-31T17:33:41.057671] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-31T17:33:41.303063] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-31T17:33:41.519429] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T17:33:41.857692] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-31T17:33:42.123262] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-31T17:33:42.657747] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-31T17:33:42.891964] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-31T17:33:43.457718] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-31T17:33:44.257704] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-31T17:33:44.599954] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-31T17:33:44.644535] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T17:33:45.057718] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-31T17:33:45.857696] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-31T17:33:46.550022] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T17:33:46.657638] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-31T17:33:46.795104] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-31T17:33:46.801596] [INFO ] [REMOTE ] BHR: Full fetch complete (30907 records). [2025-10-31T17:33:46.801848] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-31T17:33:47.172339] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-31T17:33:47.172449] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-31T17:33:47.172908] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-31T17:33:47.172969] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-31T17:33:47.173677] [DEBUG] [LOCAL ] BHR: Trimmed 30907 records to 22020 (keeping 200 days of data) [2025-10-31T17:33:47.294821] [DEBUG] [LOCAL ] BHR: Primary data saved (22020 records). [2025-10-31T17:33:47.294945] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-31T17:33:47.295021] [INFO ] [MAIN ] Update Progress: 274/2365 symbols completed. BHR took 30.5s. Estimated remaining: 4h 17m 18s. Rate: 8.1 symbols/min [2025-10-31T17:33:47.462880] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-31T17:33:47.465740] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:33:47.496532] [DEBUG] [LOCAL ] BIO: Loaded 23581 existing records from primary storage. [2025-10-31T17:33:47.496927] [INFO ] [MAIN ] BIO: Loaded 23581 existing records. [2025-10-31T17:33:47.689752] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:33:47.690027] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-31T17:33:47.690088] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-31T17:33:47.690359] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-31T17:33:47.690420] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-31T17:33:48.047034] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:33:48.077548] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T17:33:48.257681] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-31T17:33:48.811557] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-31T17:33:49.057693] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-31T17:33:49.079071] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:33:49.336437] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-31T17:33:49.857707] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-31T17:33:50.657696] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-31T17:33:51.145526] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T17:33:51.457731] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-31T17:33:51.975761] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T17:33:52.257620] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-31T17:33:53.063059] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-31T17:33:53.093688] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T17:33:53.107455] [INFO ] [REMOTE ] BHVN: Full fetch complete (70933 records). [2025-10-31T17:33:53.107612] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-31T17:33:53.506229] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-31T17:33:53.506406] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-31T17:33:53.507322] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-31T17:33:53.507406] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-31T17:33:53.508812] [DEBUG] [LOCAL ] BHVN: Trimmed 70933 records to 51366 (keeping 200 days of data) [2025-10-31T17:33:53.651793] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-31T17:33:53.842133] [DEBUG] [LOCAL ] BHVN: Primary data saved (51366 records). [2025-10-31T17:33:53.842515] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-31T17:33:53.842681] [INFO ] [MAIN ] Update Progress: 275/2365 symbols completed. BHVN took 32.0s. Estimated remaining: 4h 17m 4s. Rate: 8.1 symbols/min [2025-10-31T17:33:53.863318] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-31T17:33:53.958550] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-31T17:33:54.072577] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:33:54.110427] [DEBUG] [LOCAL ] BIP: Loaded 38708 existing records from primary storage. [2025-10-31T17:33:54.110793] [INFO ] [MAIN ] BIP: Loaded 38708 existing records. [2025-10-31T17:33:54.292124] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:33:54.292396] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-31T17:33:54.292446] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-31T17:33:54.292855] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-31T17:33:54.292927] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-31T17:33:54.389974] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T17:33:54.401785] [INFO ] [REMOTE ] BHV: Full fetch complete (1409 records). [2025-10-31T17:33:54.401912] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-31T17:33:54.663687] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-31T17:33:54.724343] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-31T17:33:54.731327] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:33:54.737962] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:33:54.764556] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-31T17:33:54.786578] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-31T17:33:54.797257] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-31T17:33:54.797427] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-31T17:33:54.797523] [INFO ] [MAIN ] Update Progress: 276/2365 symbols completed. BHV took 37.2s. Estimated remaining: 4h 16m 8s. Rate: 8.2 symbols/min [2025-10-31T17:33:55.019006] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:33:55.087373] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:33:55.087588] [DEBUG] [LOCAL ] BIPC: No existing data file found in primary storage. [2025-10-31T17:33:55.087633] [WARN ] [MAIN ] BIPC: No existing data found, performing full refresh instead. [2025-10-31T17:33:55.087769] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-31T17:33:55.087813] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-31T17:33:55.087893] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-31T17:33:55.087994] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-31T17:33:55.462882] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-31T17:33:55.557184] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:33:56.140335] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-31T17:33:56.257661] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-31T17:33:56.562846] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-31T17:33:57.057673] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-31T17:33:57.834737] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T17:33:57.847090] [INFO ] [REMOTE ] BILL: Full fetch complete (76135 records). [2025-10-31T17:33:57.847228] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-31T17:33:57.868338] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-31T17:33:58.245263] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-31T17:33:58.245751] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-31T17:33:58.246550] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-31T17:33:58.246624] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-31T17:33:58.274128] [DEBUG] [LOCAL ] BILL: Trimmed 76135 records to 53265 (keeping 200 days of data) [2025-10-31T17:33:58.274004] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T17:33:58.584066] [DEBUG] [LOCAL ] BILL: Primary data saved (53265 records). [2025-10-31T17:33:58.584195] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-31T17:33:58.584273] [INFO ] [MAIN ] Update Progress: 277/2365 symbols completed. BILL took 32.7s. Estimated remaining: 4h 15m 34s. Rate: 8.2 symbols/min [2025-10-31T17:33:58.657705] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-31T17:33:58.965762] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T17:33:59.458060] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-31T17:33:59.600923] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-31T17:34:00.257637] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-31T17:34:00.650587] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T17:34:01.057682] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-31T17:34:01.336073] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T17:34:01.857821] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-31T17:34:01.933385] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:34:02.657727] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-31T17:34:02.982694] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T17:34:03.457734] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-31T17:34:03.847290] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T17:34:04.257623] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-31T17:34:04.277901] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-31T17:34:05.057616] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-31T17:34:05.204742] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-31T17:34:05.857684] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-31T17:34:06.015406] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T17:34:06.657688] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-31T17:34:06.906078] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T17:34:07.457674] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-31T17:34:07.486835] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T17:34:08.257681] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-31T17:34:08.535932] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T17:34:08.972690] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T17:34:09.057634] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-31T17:34:09.857728] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-31T17:34:09.914191] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T17:34:10.657639] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-31T17:34:11.042182] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T17:34:11.457621] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-31T17:34:11.608332] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-31T17:34:11.613317] [INFO ] [REMOTE ] BIO: Full fetch complete (34900 records). [2025-10-31T17:34:11.613402] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-31T17:34:11.990663] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-31T17:34:11.990760] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-31T17:34:11.991263] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-31T17:34:11.991305] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-31T17:34:11.992276] [DEBUG] [LOCAL ] BIO: Trimmed 34900 records to 23756 (keeping 200 days of data) [2025-10-31T17:34:12.134350] [DEBUG] [LOCAL ] BIO: Primary data saved (23756 records). [2025-10-31T17:34:12.134467] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-31T17:34:12.134541] [INFO ] [MAIN ] Update Progress: 278/2365 symbols completed. BIO took 24.8s. Estimated remaining: 4h 16m 13s. Rate: 8.1 symbols/min [2025-10-31T17:34:12.257675] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-31T17:34:12.806708] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T17:34:13.057673] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-31T17:34:13.325132] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T17:34:13.857723] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-31T17:34:14.154925] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T17:34:14.657718] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-31T17:34:15.083961] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T17:34:15.093078] [INFO ] [REMOTE ] BIP: Full fetch complete (57946 records). [2025-10-31T17:34:15.093195] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-31T17:34:15.503722] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-31T17:34:15.503800] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-31T17:34:15.504428] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-31T17:34:15.504468] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-31T17:34:15.505536] [DEBUG] [LOCAL ] BIP: Trimmed 57946 records to 39036 (keeping 200 days of data) [2025-10-31T17:34:15.730900] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T17:34:15.745309] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-31T17:34:15.776012] [DEBUG] [LOCAL ] BIP: Primary data saved (39036 records). [2025-10-31T17:34:15.776142] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-31T17:34:15.776229] [INFO ] [MAIN ] Update Progress: 279/2365 symbols completed. BIP took 21.9s. Estimated remaining: 4h 15m 38s. Rate: 8.2 symbols/min [2025-10-31T17:34:16.855056] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T17:34:16.865020] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-31T17:34:17.890445] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T17:34:17.899171] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-31T17:34:19.022139] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-31T17:34:19.031519] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-31T17:34:20.243278] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-31T17:34:20.252634] [INFO ] [REMOTE ] BIPC: Full fetch complete (60242 records). [2025-10-31T17:34:20.252823] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-31T17:34:20.632133] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-31T17:34:20.632233] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-31T17:34:20.632923] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-31T17:34:20.632986] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-31T17:34:20.634187] [DEBUG] [LOCAL ] BIPC: Trimmed 60242 records to 41234 (keeping 200 days of data) [2025-10-31T17:34:20.870922] [DEBUG] [LOCAL ] BIPC: Primary data saved (41234 records). [2025-10-31T17:34:20.871039] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-31T17:34:20.871111] [INFO ] [MAIN ] Update Progress: 280/2365 symbols completed. BIPC took 26.1s. Estimated remaining: 4h 15m 14s. Rate: 8.2 symbols/min [2025-10-31T17:34:21.381517] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:34:21.456792] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:34:21.514403] [DEBUG] [LOCAL ] BIPH: Loaded 2103 existing records from primary storage. [2025-10-31T17:34:21.590262] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:34:21.590544] [INFO ] [MAIN ] BIPH: Loaded 2103 existing records. [2025-10-31T17:34:21.592939] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:34:21.615678] [DEBUG] [LOCAL ] BIPI: Loaded 2690 existing records from primary storage. [2025-10-31T17:34:21.626044] [DEBUG] [LOCAL ] BIPJ: No existing data file found in primary storage. [2025-10-31T17:34:21.615911] [INFO ] [MAIN ] BIPI: Loaded 2690 existing records. [2025-10-31T17:34:21.631409] [WARN ] [MAIN ] BIPJ: No existing data found, performing full refresh instead. [2025-10-31T17:34:21.699984] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-31T17:34:21.769334] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-31T17:34:21.794949] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-10-31T17:34:21.825863] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-31T17:34:22.021780] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:34:22.033240] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-31T17:34:22.003549] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:34:22.061736] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-31T17:34:22.107836] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-31T17:34:22.114802] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-31T17:34:22.114692] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-31T17:34:22.120235] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-31T17:34:22.126630] [DEBUG] [LOCAL ] BIRK: Loaded 51431 existing records from primary storage. [2025-10-31T17:34:22.126767] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-31T17:34:22.126913] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-31T17:34:22.200061] [INFO ] [MAIN ] BIRK: Loaded 51431 existing records. [2025-10-31T17:34:22.929623] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:34:23.034754] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-31T17:34:23.084189] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-31T17:34:23.123765] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:34:23.139545] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-31T17:34:23.144883] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-31T17:34:23.194355] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-31T17:34:23.357197] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:34:23.409351] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-31T17:34:23.463974] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:34:23.464406] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-31T17:34:23.660185] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-31T17:34:23.671804] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-31T17:34:23.730596] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:34:23.730909] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-31T17:34:24.032732] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T17:34:24.033975] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-31T17:34:24.059582] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-31T17:34:24.061388] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-31T17:34:24.065224] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-31T17:34:24.257627] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-31T17:34:24.309325] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-31T17:34:24.345475] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-31T17:34:24.522873] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-31T17:34:24.854171] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T17:34:25.057686] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-31T17:34:25.395574] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-31T17:34:25.857677] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-31T17:34:26.220966] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-31T17:34:26.657729] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-31T17:34:26.934734] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-31T17:34:27.457699] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-31T17:34:27.825268] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T17:34:28.257711] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-31T17:34:29.057752] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-31T17:34:29.347030] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T17:34:29.497204] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-31T17:34:29.857689] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-31T17:34:30.147320] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-31T17:34:30.657680] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-31T17:34:30.949636] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-31T17:34:31.457674] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-31T17:34:32.257679] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-31T17:34:32.595743] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T17:34:32.657517] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-31T17:34:33.057739] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-31T17:34:33.401228] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-31T17:34:33.857696] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-31T17:34:34.287789] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T17:34:34.657707] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-31T17:34:35.226441] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-31T17:34:35.457674] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-31T17:34:35.811178] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-31T17:34:36.257676] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-31T17:34:36.624090] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-31T17:34:37.057677] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-31T17:34:37.345662] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-31T17:34:37.857728] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-31T17:34:38.124611] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-31T17:34:38.657681] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-31T17:34:39.014821] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-31T17:34:39.457717] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-31T17:34:40.257698] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-31T17:34:40.628425] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-31T17:34:40.629486] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4080 records). [2025-10-31T17:34:40.629553] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-31T17:34:40.992892] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-31T17:34:40.992970] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-31T17:34:40.993132] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-31T17:34:40.993169] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-31T17:34:40.993499] [DEBUG] [LOCAL ] BIPJ: Trimmed 4080 records to 2954 (keeping 200 days of data) [2025-10-31T17:34:41.010821] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2954 records). [2025-10-31T17:34:41.010892] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-31T17:34:41.010952] [INFO ] [MAIN ] Update Progress: 281/2365 symbols completed. BIPJ took 20.1s. Estimated remaining: 4h 16m 41s. Rate: 8.1 symbols/min [2025-10-31T17:34:41.064077] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-31T17:34:41.177257] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:34:41.199579] [DEBUG] [LOCAL ] BIT: Loaded 23804 existing records from primary storage. [2025-10-31T17:34:41.199838] [INFO ] [MAIN ] BIT: Loaded 23804 existing records. [2025-10-31T17:34:41.372984] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:34:41.373185] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-31T17:34:41.373230] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-31T17:34:41.373414] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-31T17:34:41.373470] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-31T17:34:41.476404] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-31T17:34:41.721012] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:34:41.857614] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-31T17:34:42.617015] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-31T17:34:42.657719] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-31T17:34:42.968337] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-31T17:34:42.969848] [INFO ] [REMOTE ] BIPH: Full fetch complete (3558 records). [2025-10-31T17:34:42.969951] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-31T17:34:43.464691] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-31T17:34:43.479259] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-31T17:34:43.479362] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-31T17:34:43.479539] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-31T17:34:43.479579] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-31T17:34:43.480085] [DEBUG] [LOCAL ] BIPH: Trimmed 3558 records to 2121 (keeping 200 days of data) [2025-10-31T17:34:43.494540] [DEBUG] [LOCAL ] BIPH: Primary data saved (2121 records). [2025-10-31T17:34:43.494701] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-31T17:34:43.494797] [INFO ] [MAIN ] Update Progress: 282/2365 symbols completed. BIPH took 22.6s. Estimated remaining: 4h 15m 58s. Rate: 8.1 symbols/min [2025-10-31T17:34:43.719200] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:34:43.778144] [DEBUG] [LOCAL ] BJ: Loaded 51748 existing records from primary storage. [2025-10-31T17:34:43.778540] [INFO ] [MAIN ] BJ: Loaded 51748 existing records. [2025-10-31T17:34:43.969852] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:34:43.970071] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-31T17:34:43.970117] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-31T17:34:43.970295] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-31T17:34:43.970331] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-31T17:34:44.262159] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T17:34:44.260897] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-31T17:34:44.344316] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:34:44.676034] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-31T17:34:45.057670] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-31T17:34:45.495979] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-31T17:34:45.857731] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-31T17:34:46.657693] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-31T17:34:46.882181] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (7.42 seconds). [2025-10-31T17:34:46.903549] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-31T17:34:47.066431] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T17:34:47.457684] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-31T17:34:47.824669] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-31T17:34:47.825777] [INFO ] [REMOTE ] BIPI: Full fetch complete (4484 records). [2025-10-31T17:34:47.825843] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-31T17:34:48.180180] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-31T17:34:48.180255] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-31T17:34:48.180390] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-31T17:34:48.180428] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-31T17:34:48.180826] [DEBUG] [LOCAL ] BIPI: Trimmed 4484 records to 2713 (keeping 200 days of data) [2025-10-31T17:34:48.198014] [DEBUG] [LOCAL ] BIPI: Primary data saved (2713 records). [2025-10-31T17:34:48.198148] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-31T17:34:48.198276] [INFO ] [MAIN ] Update Progress: 283/2365 symbols completed. BIPI took 27.3s. Estimated remaining: 4h 15m 31s. Rate: 8.1 symbols/min [2025-10-31T17:34:48.262892] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-31T17:34:48.370517] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:34:48.422287] [DEBUG] [LOCAL ] BK: Loaded 53916 existing records from primary storage. [2025-10-31T17:34:48.422588] [INFO ] [MAIN ] BK: Loaded 53916 existing records. [2025-10-31T17:34:48.596280] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:34:48.596509] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-31T17:34:48.596556] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-31T17:34:48.597004] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-31T17:34:48.597061] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-31T17:34:48.971795] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:34:49.057621] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-31T17:34:49.738133] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-31T17:34:49.857622] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-31T17:34:50.515827] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T17:34:50.657628] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-31T17:34:50.987806] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:34:51.457635] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-31T17:34:51.855967] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T17:34:52.257672] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-31T17:34:52.800850] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-31T17:34:53.057693] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-31T17:34:53.584979] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T17:34:53.857677] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-31T17:34:54.328952] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T17:34:54.657678] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-31T17:34:55.212519] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T17:34:55.457672] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-31T17:34:56.108573] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T17:34:56.257627] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-31T17:34:56.830222] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T17:34:57.057680] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-31T17:34:57.618387] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T17:34:57.857702] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-31T17:34:58.484348] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:34:58.657729] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-31T17:34:59.207623] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T17:34:59.271958] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-31T17:34:59.457674] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-31T17:35:00.257684] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-31T17:35:00.728827] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T17:35:01.057744] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-31T17:35:01.465064] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T17:35:01.857693] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-31T17:35:02.505169] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T17:35:02.657684] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-31T17:35:03.227254] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T17:35:03.422612] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T17:35:03.457613] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-31T17:35:04.257628] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-31T17:35:04.823300] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T17:35:05.057690] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-31T17:35:05.603866] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T17:35:05.857680] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-31T17:35:06.657714] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-31T17:35:06.845236] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-31T17:35:06.856985] [INFO ] [REMOTE ] BIRK: Full fetch complete (73607 records). [2025-10-31T17:35:06.857107] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-31T17:35:07.251570] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-31T17:35:07.251700] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-31T17:35:07.252528] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-31T17:35:07.252637] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-31T17:35:07.254157] [DEBUG] [LOCAL ] BIRK: Trimmed 73607 records to 51816 (keeping 200 days of data) [2025-10-31T17:35:07.398477] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-31T17:35:07.465110] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-31T17:35:07.592908] [DEBUG] [LOCAL ] BIRK: Primary data saved (51816 records). [2025-10-31T17:35:07.593077] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-31T17:35:07.593170] [INFO ] [MAIN ] Update Progress: 284/2365 symbols completed. BIRK took 46.7s. Estimated remaining: 4h 16m 52s. Rate: 8.1 symbols/min [2025-10-31T17:35:07.769079] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:35:07.800795] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T17:35:07.849819] [DEBUG] [LOCAL ] BKD: Loaded 50670 existing records from primary storage. [2025-10-31T17:35:07.850103] [INFO ] [MAIN ] BKD: Loaded 50670 existing records. [2025-10-31T17:35:08.028113] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:35:08.028331] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-31T17:35:08.028377] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-31T17:35:08.028840] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-31T17:35:08.028900] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-31T17:35:08.259251] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-31T17:35:08.273891] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-31T17:35:08.420025] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:35:09.057683] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-31T17:35:09.857712] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-31T17:35:09.995362] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-31T17:35:10.009498] [INFO ] [REMOTE ] BJ: Full fetch complete (73973 records). [2025-10-31T17:35:10.009708] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-31T17:35:10.010587] [FATAL] [VALIDATOR ] BJ: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:35:10.010720] [FATAL] [MAIN ] BJ: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:35:10.010793] [WARN ] [MAIN ] BJ: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:35:10.010876] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-31T17:35:10.010957] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-10-31T17:35:10.011006] [INFO ] [LOCAL ] BJ: Starting deletion of derivative data. [2025-10-31T17:35:10.011232] [DEBUG] [LOCAL ] BJ: Deleted derivative data file. [2025-10-31T17:35:10.011354] [INFO ] [MAIN ] Update Progress: 285/2365 symbols completed. BJ took 26.5s. Estimated remaining: 4h 16m 8s. Rate: 8.1 symbols/min [2025-10-31T17:35:10.193999] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:35:10.221197] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T17:35:10.259176] [DEBUG] [LOCAL ] BKE: Loaded 33194 existing records from primary storage. [2025-10-31T17:35:10.259467] [INFO ] [MAIN ] BKE: Loaded 33194 existing records. [2025-10-31T17:35:10.449160] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:35:10.449418] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-31T17:35:10.449467] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-31T17:35:10.449786] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-31T17:35:10.449845] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-31T17:35:10.662910] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-31T17:35:10.828551] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:35:11.152386] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T17:35:11.457683] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-31T17:35:11.673679] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:35:12.215181] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-31T17:35:12.257697] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-31T17:35:13.034405] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-31T17:35:13.057629] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-31T17:35:13.857635] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-31T17:35:13.952551] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-31T17:35:14.657730] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-31T17:35:14.983098] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-31T17:35:15.457614] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-31T17:35:15.660988] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-31T17:35:16.257674] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-31T17:35:16.405825] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T17:35:17.057662] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-31T17:35:17.344551] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T17:35:17.857622] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-31T17:35:17.944370] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T17:35:18.505864] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T17:35:18.518835] [INFO ] [REMOTE ] BK: Full fetch complete (77661 records). [2025-10-31T17:35:18.518996] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-31T17:35:18.665205] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-31T17:35:18.944344] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-31T17:35:18.944448] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-31T17:35:18.945548] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-31T17:35:18.945625] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-31T17:35:18.947496] [DEBUG] [LOCAL ] BK: Trimmed 77661 records to 54304 (keeping 200 days of data) [2025-10-31T17:35:19.279871] [DEBUG] [LOCAL ] BK: Primary data saved (54304 records). [2025-10-31T17:35:19.279996] [INFO ] [MAIN ] BK: Full history saved. [2025-10-31T17:35:19.280862] [INFO ] [MAIN ] Update Progress: 286/2365 symbols completed. BK took 31.1s. Estimated remaining: 4h 16m 14s. Rate: 8.1 symbols/min [2025-10-31T17:35:19.447065] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:35:19.457633] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-31T17:35:19.484113] [DEBUG] [LOCAL ] BKH: Loaded 37655 existing records from primary storage. [2025-10-31T17:35:19.484402] [INFO ] [MAIN ] BKH: Loaded 37655 existing records. [2025-10-31T17:35:19.658389] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:35:19.658637] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-31T17:35:19.658749] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-31T17:35:19.659168] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-31T17:35:19.659239] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-31T17:35:20.013706] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:35:20.045345] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T17:35:20.257635] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-31T17:35:20.477095] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-31T17:35:20.483444] [INFO ] [REMOTE ] BIT: Full fetch complete (32322 records). [2025-10-31T17:35:20.483557] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-31T17:35:20.484110] [FATAL] [VALIDATOR ] BIT: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:35:20.484207] [FATAL] [MAIN ] BIT: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:35:20.484280] [WARN ] [MAIN ] BIT: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:35:20.484367] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-31T17:35:20.484445] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-10-31T17:35:20.484488] [INFO ] [LOCAL ] BIT: Starting deletion of derivative data. [2025-10-31T17:35:20.484634] [DEBUG] [LOCAL ] BIT: Deleted derivative data file. [2025-10-31T17:35:20.484762] [INFO ] [MAIN ] Update Progress: 287/2365 symbols completed. BIT took 39.5s. Estimated remaining: 4h 15m 22s. Rate: 8.1 symbols/min [2025-10-31T17:35:20.653952] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:35:20.654172] [DEBUG] [LOCAL ] BKKT: No existing data file found in primary storage. [2025-10-31T17:35:20.654265] [WARN ] [MAIN ] BKKT: No existing data found, performing full refresh instead. [2025-10-31T17:35:20.654349] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-31T17:35:20.654388] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-31T17:35:20.654431] [DEBUG] [LOCAL ] BKKT: No primary data file found to delete. [2025-10-31T17:35:20.654465] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-31T17:35:21.010211] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:35:21.057714] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-31T17:35:21.302463] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-31T17:35:21.857699] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-31T17:35:22.396957] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T17:35:22.657714] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-31T17:35:23.381207] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T17:35:23.457617] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-31T17:35:23.643132] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T17:35:24.257732] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-31T17:35:24.586090] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:35:25.057744] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-31T17:35:25.368305] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-31T17:35:25.857725] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-31T17:35:26.232600] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T17:35:26.657699] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-31T17:35:26.882322] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T17:35:27.457713] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-31T17:35:27.741999] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T17:35:28.257673] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-31T17:35:28.739342] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T17:35:29.057722] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-31T17:35:29.484599] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T17:35:29.857632] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-31T17:35:30.044918] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-31T17:35:30.657723] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-31T17:35:30.928154] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-31T17:35:31.457717] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-31T17:35:31.486585] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-31T17:35:32.257720] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-31T17:35:32.324952] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T17:35:33.057696] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-31T17:35:33.223432] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T17:35:33.857676] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-31T17:35:34.086005] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T17:35:34.657762] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-31T17:35:35.076104] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T17:35:35.457699] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-31T17:35:35.752991] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T17:35:36.257619] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-31T17:35:36.463462] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-31T17:35:37.057614] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-31T17:35:37.252490] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T17:35:37.857681] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-31T17:35:38.397146] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-31T17:35:38.616729] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-31T17:35:38.657672] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-31T17:35:39.457676] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-31T17:35:39.798947] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:35:39.806302] [INFO ] [REMOTE ] BKE: Full fetch complete (49620 records). [2025-10-31T17:35:39.806438] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-31T17:35:40.195967] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-31T17:35:40.196042] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-31T17:35:40.196599] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-31T17:35:40.196638] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-31T17:35:40.197784] [DEBUG] [LOCAL ] BKE: Trimmed 49620 records to 33393 (keeping 200 days of data) [2025-10-31T17:35:40.258666] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-31T17:35:40.402430] [DEBUG] [LOCAL ] BKE: Primary data saved (33393 records). [2025-10-31T17:35:40.402572] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-31T17:35:40.402674] [INFO ] [MAIN ] Update Progress: 288/2365 symbols completed. BKE took 30.4s. Estimated remaining: 4h 16m 45s. Rate: 8.1 symbols/min [2025-10-31T17:35:40.574638] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:35:40.583725] [DEBUG] [LOCAL ] BKN: Loaded 7256 existing records from primary storage. [2025-10-31T17:35:40.583914] [INFO ] [MAIN ] BKN: Loaded 7256 existing records. [2025-10-31T17:35:40.762929] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:35:40.763168] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-31T17:35:40.763216] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-31T17:35:40.763352] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-31T17:35:40.763391] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-31T17:35:41.058598] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-31T17:35:41.146098] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:35:41.169116] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-31T17:35:41.718451] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T17:35:41.730020] [INFO ] [REMOTE ] BKD: Full fetch complete (72227 records). [2025-10-31T17:35:41.730177] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-31T17:35:41.862841] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-31T17:35:42.171853] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-31T17:35:42.172044] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-31T17:35:42.172844] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-31T17:35:42.172929] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-31T17:35:42.174833] [DEBUG] [LOCAL ] BKD: Trimmed 72227 records to 51050 (keeping 200 days of data) [2025-10-31T17:35:42.297632] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T17:35:42.487424] [DEBUG] [LOCAL ] BKD: Primary data saved (51050 records). [2025-10-31T17:35:42.487555] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-31T17:35:42.488448] [INFO ] [MAIN ] Update Progress: 289/2365 symbols completed. BKD took 34.9s. Estimated remaining: 4h 15m 59s. Rate: 8.1 symbols/min [2025-10-31T17:35:42.594822] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T17:35:42.659384] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-31T17:35:42.680066] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:35:42.730032] [DEBUG] [LOCAL ] BKSY: Loaded 49369 existing records from primary storage. [2025-10-31T17:35:42.730369] [INFO ] [MAIN ] BKSY: Loaded 49369 existing records. [2025-10-31T17:35:42.918876] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:35:42.919085] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-31T17:35:42.919130] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-31T17:35:42.919533] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-31T17:35:42.919589] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-31T17:35:43.263759] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:35:43.457603] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-31T17:35:44.115259] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-31T17:35:44.257612] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-31T17:35:44.652432] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-31T17:35:44.791916] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T17:35:45.057622] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-31T17:35:45.857636] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-31T17:35:46.570762] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-31T17:35:46.657619] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-31T17:35:47.060888] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T17:35:47.457675] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-31T17:35:47.918568] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T17:35:48.257718] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-31T17:35:48.965244] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T17:35:49.057626] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-31T17:35:49.545131] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T17:35:49.857737] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-31T17:35:50.245452] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-31T17:35:50.657722] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-31T17:35:51.207337] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-31T17:35:51.218837] [INFO ] [REMOTE ] BKKT: Full fetch complete (52968 records). [2025-10-31T17:35:51.218949] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-31T17:35:51.469413] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-31T17:35:51.596398] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-31T17:35:51.596472] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-31T17:35:51.597081] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-31T17:35:51.597142] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-31T17:35:51.598184] [DEBUG] [LOCAL ] BKKT: Trimmed 52968 records to 38838 (keeping 200 days of data) [2025-10-31T17:35:51.818599] [DEBUG] [LOCAL ] BKKT: Primary data saved (38838 records). [2025-10-31T17:35:51.818739] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-31T17:35:51.818812] [INFO ] [MAIN ] Update Progress: 290/2365 symbols completed. BKKT took 31.3s. Estimated remaining: 4h 16m 6s. Rate: 8.1 symbols/min [2025-10-31T17:35:51.990860] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:35:51.998688] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T17:35:52.031011] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T17:35:52.044487] [DEBUG] [LOCAL ] BKT: Loaded 12933 existing records from primary storage. [2025-10-31T17:35:52.045030] [INFO ] [MAIN ] BKT: Loaded 12933 existing records. [2025-10-31T17:35:52.217428] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:35:52.217709] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-31T17:35:52.217764] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-31T17:35:52.217958] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-31T17:35:52.218012] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-31T17:35:52.262878] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-31T17:35:52.568845] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:35:53.057726] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-31T17:35:53.282859] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T17:35:53.541719] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-31T17:35:53.857679] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-31T17:35:54.495401] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T17:35:54.657681] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-31T17:35:55.457669] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-31T17:35:56.063462] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-31T17:35:56.269947] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-31T17:35:56.273047] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T17:35:56.283039] [INFO ] [REMOTE ] BKH: Full fetch complete (53519 records). [2025-10-31T17:35:56.283192] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-31T17:35:56.723415] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-31T17:35:56.723508] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-31T17:35:56.724299] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-31T17:35:56.724365] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-31T17:35:56.725751] [DEBUG] [LOCAL ] BKH: Trimmed 53519 records to 37991 (keeping 200 days of data) [2025-10-31T17:35:56.838495] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T17:35:56.977244] [DEBUG] [LOCAL ] BKH: Primary data saved (37991 records). [2025-10-31T17:35:56.977379] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-31T17:35:56.978135] [INFO ] [MAIN ] Update Progress: 291/2365 symbols completed. BKH took 37.7s. Estimated remaining: 4h 15m 42s. Rate: 8.1 symbols/min [2025-10-31T17:35:57.062957] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-31T17:35:57.175386] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:35:57.215455] [DEBUG] [LOCAL ] BKU: Loaded 42466 existing records from primary storage. [2025-10-31T17:35:57.215763] [INFO ] [MAIN ] BKU: Loaded 42466 existing records. [2025-10-31T17:35:57.389884] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:35:57.390141] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-31T17:35:57.390206] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-31T17:35:57.390590] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-31T17:35:57.390696] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-31T17:35:57.655233] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-31T17:35:57.757065] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:35:57.857618] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-31T17:35:58.657705] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-31T17:35:59.058534] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T17:35:59.457679] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-31T17:36:00.147689] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-31T17:36:00.168231] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-31T17:36:00.257677] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-31T17:36:00.823527] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T17:36:01.057671] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-31T17:36:01.857670] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-31T17:36:01.972101] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T17:36:02.357025] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-31T17:36:02.657683] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-31T17:36:03.095992] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-31T17:36:03.457687] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-31T17:36:04.075411] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-31T17:36:04.257675] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-31T17:36:05.057677] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-31T17:36:05.857688] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-31T17:36:05.897636] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-31T17:36:06.157154] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T17:36:06.657622] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-31T17:36:06.685175] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T17:36:07.457716] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-31T17:36:07.996456] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T17:36:08.086638] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:36:08.257633] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-31T17:36:08.736327] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T17:36:09.057730] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-31T17:36:09.857625] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-31T17:36:09.896736] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-31T17:36:09.902133] [INFO ] [REMOTE ] BKT: Full fetch complete (17077 records). [2025-10-31T17:36:09.902224] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-31T17:36:10.293050] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-31T17:36:10.293136] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-31T17:36:10.293456] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-31T17:36:10.293494] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-31T17:36:10.294050] [DEBUG] [LOCAL ] BKT: Trimmed 17077 records to 13062 (keeping 200 days of data) [2025-10-31T17:36:10.377327] [DEBUG] [LOCAL ] BKT: Primary data saved (13062 records). [2025-10-31T17:36:10.377457] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-31T17:36:10.377535] [INFO ] [MAIN ] Update Progress: 292/2365 symbols completed. BKT took 18.6s. Estimated remaining: 4h 16m 17s. Rate: 8.1 symbols/min [2025-10-31T17:36:10.552939] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:36:10.580599] [DEBUG] [LOCAL ] BKV: Loaded 29319 existing records from primary storage. [2025-10-31T17:36:10.580874] [INFO ] [MAIN ] BKV: Loaded 29319 existing records. [2025-10-31T17:36:10.662766] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-31T17:36:10.761910] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:36:10.762105] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-31T17:36:10.762171] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-31T17:36:10.762529] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-31T17:36:10.762585] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-31T17:36:11.147328] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:36:11.176713] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T17:36:11.457685] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-31T17:36:12.263623] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-31T17:36:12.270100] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-31T17:36:12.427634] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T17:36:13.057708] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-31T17:36:13.361180] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T17:36:13.562417] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-31T17:36:13.857691] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-31T17:36:14.657686] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-31T17:36:15.457714] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-31T17:36:15.612888] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T17:36:15.959588] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-31T17:36:15.974384] [INFO ] [REMOTE ] BKSY: Full fetch complete (71044 records). [2025-10-31T17:36:15.974558] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-31T17:36:16.159513] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-31T17:36:16.204342] [INFO ] [REMOTE ] BKN: Full fetch complete (11057 records). [2025-10-31T17:36:16.267931] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-31T17:36:16.267787] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-31T17:36:16.607268] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-31T17:36:16.635393] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-31T17:36:16.668400] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-31T17:36:16.679555] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-31T17:36:16.728170] [DEBUG] [LOCAL ] BKSY: Trimmed 71044 records to 49744 (keeping 200 days of data) [2025-10-31T17:36:16.844556] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-31T17:36:16.871191] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-31T17:36:16.875259] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-31T17:36:16.879424] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-31T17:36:16.906064] [DEBUG] [LOCAL ] BKN: Trimmed 11057 records to 7378 (keeping 200 days of data) [2025-10-31T17:36:17.062630] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-31T17:36:17.104557] [DEBUG] [LOCAL ] BKN: Primary data saved (7378 records). [2025-10-31T17:36:17.113717] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-31T17:36:17.116775] [INFO ] [MAIN ] Update Progress: 293/2365 symbols completed. BKN took 36.7s. Estimated remaining: 4h 16m 5s. Rate: 8.1 symbols/min [2025-10-31T17:36:17.123578] [DEBUG] [LOCAL ] BKSY: Primary data saved (49744 records). [2025-10-31T17:36:17.124035] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-31T17:36:17.179822] [INFO ] [MAIN ] Update Progress: 294/2365 symbols completed. BKSY took 34.7s. Estimated remaining: 4h 15m 6s. Rate: 8.1 symbols/min [2025-10-31T17:36:17.406997] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:36:17.492422] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:36:17.517398] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T17:36:17.558273] [DEBUG] [LOCAL ] BLCO: Loaded 34636 existing records from primary storage. [2025-10-31T17:36:17.558626] [INFO ] [MAIN ] BLCO: Loaded 34636 existing records. [2025-10-31T17:36:17.673933] [DEBUG] [LOCAL ] BLD: Loaded 26687 existing records from primary storage. [2025-10-31T17:36:17.710391] [INFO ] [MAIN ] BLD: Loaded 26687 existing records. [2025-10-31T17:36:17.860240] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:36:17.860399] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-31T17:36:17.890158] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-31T17:36:17.891219] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-31T17:36:17.891832] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-31T17:36:17.911162] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-31T17:36:18.012335] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:36:18.062027] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-31T17:36:18.068023] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-31T17:36:18.078575] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-31T17:36:18.078725] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-31T17:36:18.573226] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:36:18.640246] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T17:36:18.668286] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-31T17:36:18.746505] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:36:19.139089] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T17:36:19.457710] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-31T17:36:19.692248] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T17:36:20.257617] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-31T17:36:20.438755] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-31T17:36:21.057621] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-31T17:36:21.078414] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:36:21.857773] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-31T17:36:21.914278] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-31T17:36:22.657704] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-31T17:36:23.041982] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T17:36:23.457734] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-31T17:36:23.598599] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T17:36:24.257730] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-31T17:36:24.484104] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T17:36:25.057633] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-31T17:36:25.440436] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T17:36:25.857667] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-31T17:36:25.912794] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-31T17:36:26.657685] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-31T17:36:26.841495] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T17:36:27.457676] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-31T17:36:27.729337] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T17:36:28.257730] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-31T17:36:28.406963] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-31T17:36:28.989067] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T17:36:29.057723] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-31T17:36:29.857727] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-31T17:36:29.976163] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T17:36:30.641072] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T17:36:30.657617] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-31T17:36:31.457630] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-31T17:36:31.501319] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T17:36:32.257688] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-31T17:36:32.595714] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T17:36:33.057682] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-31T17:36:33.097237] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T17:36:33.857668] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-31T17:36:34.352157] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-31T17:36:34.359920] [INFO ] [REMOTE ] BKV: Full fetch complete (45054 records). [2025-10-31T17:36:34.360040] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-31T17:36:34.662856] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-31T17:36:34.730687] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-31T17:36:34.730769] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-31T17:36:34.731315] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-31T17:36:34.731356] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-31T17:36:34.732311] [DEBUG] [LOCAL ] BKV: Trimmed 45054 records to 29640 (keeping 200 days of data) [2025-10-31T17:36:34.902082] [DEBUG] [LOCAL ] BKV: Primary data saved (29640 records). [2025-10-31T17:36:34.902216] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-31T17:36:34.902309] [INFO ] [MAIN ] Update Progress: 295/2365 symbols completed. BKV took 24.5s. Estimated remaining: 4h 16m 11s. Rate: 8.1 symbols/min [2025-10-31T17:36:35.071472] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:36:35.120688] [DEBUG] [LOCAL ] BLDR: Loaded 52195 existing records from primary storage. [2025-10-31T17:36:35.120984] [INFO ] [MAIN ] BLDR: Loaded 52195 existing records. [2025-10-31T17:36:35.303225] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:36:35.303718] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-31T17:36:35.303816] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-31T17:36:35.304091] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-31T17:36:35.304152] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-31T17:36:35.467310] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-31T17:36:35.534106] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-31T17:36:35.632865] [INFO ] [REMOTE ] BKU: Full fetch complete (61247 records). [2025-10-31T17:36:35.643667] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-31T17:36:35.763857] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:36:35.965089] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T17:36:36.138061] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-31T17:36:36.138185] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-31T17:36:36.139124] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-31T17:36:36.139196] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-31T17:36:36.140892] [DEBUG] [LOCAL ] BKU: Trimmed 61247 records to 42809 (keeping 200 days of data) [2025-10-31T17:36:36.259295] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-31T17:36:36.400526] [DEBUG] [LOCAL ] BKU: Primary data saved (42809 records). [2025-10-31T17:36:36.400673] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-31T17:36:36.401457] [INFO ] [MAIN ] Update Progress: 296/2365 symbols completed. BKU took 39.4s. Estimated remaining: 4h 15m 22s. Rate: 8.1 symbols/min [2025-10-31T17:36:36.569567] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:36:36.585435] [DEBUG] [LOCAL ] BLE: Loaded 13517 existing records from primary storage. [2025-10-31T17:36:36.585700] [INFO ] [MAIN ] BLE: Loaded 13517 existing records. [2025-10-31T17:36:36.765120] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:36:36.765506] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-31T17:36:36.765584] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-31T17:36:36.765820] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-31T17:36:36.765886] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-31T17:36:36.907106] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T17:36:37.062850] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-31T17:36:37.167434] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:36:37.813311] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T17:36:37.857623] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-31T17:36:38.008509] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T17:36:38.657724] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-31T17:36:38.917797] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T17:36:39.457696] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-31T17:36:39.699310] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T17:36:40.081974] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T17:36:40.257681] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-31T17:36:41.057668] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-31T17:36:41.619789] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-31T17:36:41.625933] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T17:36:41.857679] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-31T17:36:42.657667] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-31T17:36:42.693671] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-31T17:36:43.457665] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-31T17:36:43.674092] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T17:36:44.257683] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-31T17:36:44.757728] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:36:44.878043] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T17:36:45.057701] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-31T17:36:45.857674] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-31T17:36:45.927715] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-31T17:36:46.576555] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-31T17:36:46.657633] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-31T17:36:47.457689] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-31T17:36:48.053040] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-31T17:36:48.257721] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-31T17:36:48.517391] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-31T17:36:48.523020] [INFO ] [REMOTE ] BLD: Full fetch complete (39628 records). [2025-10-31T17:36:48.523118] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-31T17:36:48.889706] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-31T17:36:48.889788] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-31T17:36:48.890269] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-31T17:36:48.890308] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-31T17:36:48.891204] [DEBUG] [LOCAL ] BLD: Trimmed 39628 records to 26835 (keeping 200 days of data) [2025-10-31T17:36:49.047894] [DEBUG] [LOCAL ] BLD: Primary data saved (26835 records). [2025-10-31T17:36:49.048061] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-31T17:36:49.048142] [INFO ] [MAIN ] Update Progress: 297/2365 symbols completed. BLD took 31.8s. Estimated remaining: 4h 15m 51s. Rate: 8.1 symbols/min [2025-10-31T17:36:49.062834] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-31T17:36:49.238402] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:36:49.274167] [DEBUG] [LOCAL ] BLK: Loaded 33688 existing records from primary storage. [2025-10-31T17:36:49.274444] [INFO ] [MAIN ] BLK: Loaded 33688 existing records. [2025-10-31T17:36:49.453861] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:36:49.454167] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-31T17:36:49.454267] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-31T17:36:49.454577] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-31T17:36:49.454726] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-31T17:36:49.595944] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T17:36:49.682136] [INFO ] [REMOTE ] BLCO: Full fetch complete (52148 records). [2025-10-31T17:36:49.675099] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-31T17:36:49.692729] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-31T17:36:49.860930] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-31T17:36:50.015959] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:36:50.286825] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-31T17:36:50.286907] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-31T17:36:50.287776] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-31T17:36:50.287867] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-31T17:36:50.289396] [DEBUG] [LOCAL ] BLCO: Trimmed 52148 records to 34888 (keeping 200 days of data) [2025-10-31T17:36:50.485484] [DEBUG] [LOCAL ] BLCO: Primary data saved (34888 records). [2025-10-31T17:36:50.485618] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-31T17:36:50.485732] [INFO ] [MAIN ] Update Progress: 298/2365 symbols completed. BLCO took 33.4s. Estimated remaining: 4h 15m 2s. Rate: 8.1 symbols/min [2025-10-31T17:36:50.654459] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:36:50.664315] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-31T17:36:50.669367] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-31T17:36:50.713095] [DEBUG] [LOCAL ] BLND: Loaded 49534 existing records from primary storage. [2025-10-31T17:36:50.713396] [INFO ] [MAIN ] BLND: Loaded 49534 existing records. [2025-10-31T17:36:50.900960] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:36:50.901204] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-31T17:36:50.901270] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-31T17:36:50.901519] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-31T17:36:50.901587] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-31T17:36:51.278019] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:36:51.457683] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-31T17:36:52.000741] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T17:36:52.055619] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T17:36:52.257638] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-31T17:36:53.057695] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-31T17:36:53.500278] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T17:36:53.857688] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-31T17:36:54.285437] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T17:36:54.657718] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-31T17:36:55.117292] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T17:36:55.167964] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-31T17:36:55.457672] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-31T17:36:56.257680] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-31T17:36:57.035586] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-31T17:36:57.057608] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-31T17:36:57.602978] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T17:36:57.857719] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-31T17:36:58.384271] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T17:36:58.657688] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-31T17:36:59.329627] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T17:36:59.457622] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-31T17:36:59.983409] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T17:37:00.257702] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-31T17:37:00.692611] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T17:37:01.057740] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-31T17:37:01.484707] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-31T17:37:01.857721] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-31T17:37:02.047758] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T17:37:02.657681] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-31T17:37:03.002243] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T17:37:03.457674] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-31T17:37:04.135341] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-31T17:37:04.153985] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T17:37:04.257612] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-31T17:37:04.966068] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T17:37:04.969201] [INFO ] [REMOTE ] BLE: Full fetch complete (19738 records). [2025-10-31T17:37:04.969272] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-31T17:37:05.064398] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-31T17:37:05.332028] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-31T17:37:05.332120] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-31T17:37:05.332531] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-31T17:37:05.332573] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-31T17:37:05.333363] [DEBUG] [LOCAL ] BLE: Trimmed 19738 records to 13635 (keeping 200 days of data) [2025-10-31T17:37:05.416263] [DEBUG] [LOCAL ] BLE: Primary data saved (13635 records). [2025-10-31T17:37:05.416412] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-31T17:37:05.416494] [INFO ] [MAIN ] Update Progress: 299/2365 symbols completed. BLE took 29.0s. Estimated remaining: 4h 15m 47s. Rate: 8.1 symbols/min [2025-10-31T17:37:05.585861] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:05.586038] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-31T17:37:05.586096] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-31T17:37:05.586209] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-31T17:37:05.586249] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-31T17:37:05.586289] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-31T17:37:05.586319] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-31T17:37:05.862853] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-31T17:37:05.936743] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:06.657688] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-31T17:37:06.821257] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-31T17:37:06.833026] [INFO ] [REMOTE ] BLDR: Full fetch complete (74760 records). [2025-10-31T17:37:06.833185] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-31T17:37:07.238159] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-31T17:37:07.238275] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-31T17:37:07.239382] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-31T17:37:07.239595] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-31T17:37:07.269153] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T17:37:07.269288] [DEBUG] [LOCAL ] BLDR: Trimmed 74760 records to 52581 (keeping 200 days of data) [2025-10-31T17:37:07.482527] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-31T17:37:07.593502] [DEBUG] [LOCAL ] BLDR: Primary data saved (52581 records). [2025-10-31T17:37:07.593629] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-31T17:37:07.593742] [INFO ] [MAIN ] Update Progress: 300/2365 symbols completed. BLDR took 32.7s. Estimated remaining: 4h 15m 3s. Rate: 8.1 symbols/min [2025-10-31T17:37:07.774113] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:07.793556] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T17:37:07.811225] [DEBUG] [LOCAL ] BLW: Loaded 12730 existing records from primary storage. [2025-10-31T17:37:07.811449] [INFO ] [MAIN ] BLW: Loaded 12730 existing records. [2025-10-31T17:37:08.019920] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:37:08.020153] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-31T17:37:08.020201] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-31T17:37:08.020414] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-31T17:37:08.020454] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-31T17:37:08.267634] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-31T17:37:08.382733] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:08.842136] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T17:37:09.057701] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-31T17:37:09.217708] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:37:09.218023] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-31T17:37:09.218108] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:37:09.218156] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-31T17:37:09.218219] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:37:09.218289] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-31T17:37:09.218348] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-31T17:37:09.218383] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-31T17:37:09.218421] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-31T17:37:09.218467] [INFO ] [MAIN ] Update Progress: 301/2365 symbols completed. BLSH took 3.8s. Estimated remaining: 4h 14m 16s. Rate: 8.1 symbols/min [2025-10-31T17:37:09.388277] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:09.403674] [DEBUG] [LOCAL ] BLX: Loaded 15111 existing records from primary storage. [2025-10-31T17:37:09.403888] [INFO ] [MAIN ] BLX: Loaded 15111 existing records. [2025-10-31T17:37:09.588770] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:37:09.589068] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-31T17:37:09.589164] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-31T17:37:09.589566] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-31T17:37:09.589677] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-31T17:37:09.709544] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T17:37:09.862942] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-31T17:37:09.981181] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:10.657733] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-31T17:37:11.457686] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-31T17:37:11.490504] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T17:37:11.518413] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-31T17:37:11.527395] [INFO ] [REMOTE ] BLK: Full fetch complete (52465 records). [2025-10-31T17:37:11.527537] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-31T17:37:11.934982] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-31T17:37:11.935063] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-31T17:37:11.935687] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-31T17:37:11.935749] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-31T17:37:11.936812] [DEBUG] [LOCAL ] BLK: Trimmed 52465 records to 34007 (keeping 200 days of data) [2025-10-31T17:37:12.166606] [DEBUG] [LOCAL ] BLK: Primary data saved (34007 records). [2025-10-31T17:37:12.166754] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-31T17:37:12.166835] [INFO ] [MAIN ] Update Progress: 302/2365 symbols completed. BLK took 23.1s. Estimated remaining: 4h 13m 39s. Rate: 8.1 symbols/min [2025-10-31T17:37:12.272593] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-31T17:37:12.293423] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-31T17:37:12.355225] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:12.355338] [DEBUG] [LOCAL ] BMA: No existing data file found in primary storage. [2025-10-31T17:37:12.355391] [WARN ] [MAIN ] BMA: No existing data found, performing full refresh instead. [2025-10-31T17:37:12.355497] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-31T17:37:12.355539] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-31T17:37:12.355578] [DEBUG] [LOCAL ] BMA: No primary data file found to delete. [2025-10-31T17:37:12.355609] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-31T17:37:12.715494] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:12.782830] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-31T17:37:13.057720] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-31T17:37:13.857679] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-31T17:37:14.424954] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T17:37:14.540387] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-31T17:37:14.657703] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-31T17:37:15.422937] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T17:37:15.457612] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-31T17:37:16.174585] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-31T17:37:16.257706] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-31T17:37:17.057696] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-31T17:37:17.338251] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T17:37:17.857675] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-31T17:37:18.436063] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T17:37:18.657632] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-31T17:37:18.866104] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-31T17:37:19.253705] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-31T17:37:19.457678] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-31T17:37:20.257675] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-31T17:37:20.728042] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T17:37:20.920139] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T17:37:21.057705] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-31T17:37:21.765833] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-31T17:37:21.857635] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-31T17:37:22.519069] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T17:37:22.657666] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-31T17:37:23.285831] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-31T17:37:23.457699] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-31T17:37:24.093422] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T17:37:24.257699] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-31T17:37:24.985884] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-31T17:37:25.057701] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-31T17:37:25.857736] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-31T17:37:26.327254] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T17:37:26.383058] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T17:37:26.657689] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-31T17:37:27.457705] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-31T17:37:27.980617] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T17:37:28.257688] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-31T17:37:28.692058] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T17:37:28.804070] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-31T17:37:29.057691] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-31T17:37:29.858026] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-31T17:37:29.859743] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T17:37:29.863855] [INFO ] [REMOTE ] BLX: Full fetch complete (22560 records). [2025-10-31T17:37:29.863925] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-31T17:37:30.222219] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-31T17:37:30.222300] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-31T17:37:30.222689] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-31T17:37:30.222751] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-31T17:37:30.223405] [DEBUG] [LOCAL ] BLX: Trimmed 22560 records to 15235 (keeping 200 days of data) [2025-10-31T17:37:30.311383] [DEBUG] [LOCAL ] BLX: Primary data saved (15235 records). [2025-10-31T17:37:30.311513] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-31T17:37:30.311589] [INFO ] [MAIN ] Update Progress: 303/2365 symbols completed. BLX took 21.1s. Estimated remaining: 4h 14m 44s. Rate: 8.1 symbols/min [2025-10-31T17:37:30.482316] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:30.490310] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T17:37:30.501662] [DEBUG] [LOCAL ] BME: Loaded 11067 existing records from primary storage. [2025-10-31T17:37:30.501862] [INFO ] [MAIN ] BME: Loaded 11067 existing records. [2025-10-31T17:37:30.658294] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-31T17:37:30.677824] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:37:30.678700] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-31T17:37:30.678756] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-31T17:37:30.678911] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-31T17:37:30.678948] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-31T17:37:31.030716] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:31.457635] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-31T17:37:31.822544] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T17:37:32.257675] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-31T17:37:32.366628] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T17:37:33.057712] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-31T17:37:33.862742] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-31T17:37:33.882136] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T17:37:33.902469] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-31T17:37:33.906155] [INFO ] [REMOTE ] BLND: Full fetch complete (72141 records). [2025-10-31T17:37:33.906299] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-31T17:37:34.288883] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-31T17:37:34.288965] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-31T17:37:34.289732] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-31T17:37:34.289794] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-31T17:37:34.291102] [DEBUG] [LOCAL ] BLND: Trimmed 72141 records to 49905 (keeping 200 days of data) [2025-10-31T17:37:34.507183] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T17:37:34.577023] [DEBUG] [LOCAL ] BLND: Primary data saved (49905 records). [2025-10-31T17:37:34.577149] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-31T17:37:34.577225] [INFO ] [MAIN ] Update Progress: 304/2365 symbols completed. BLND took 44.1s. Estimated remaining: 4h 14m 16s. Rate: 8.1 symbols/min [2025-10-31T17:37:34.662988] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-31T17:37:34.744659] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:34.767803] [DEBUG] [LOCAL ] BMEZ: Loaded 24658 existing records from primary storage. [2025-10-31T17:37:34.768082] [INFO ] [MAIN ] BMEZ: Loaded 24658 existing records. [2025-10-31T17:37:34.943176] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:37:34.943412] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-31T17:37:34.943459] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-31T17:37:34.943673] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-31T17:37:34.943730] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-31T17:37:35.295432] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T17:37:35.299126] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:35.457729] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-31T17:37:36.048891] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T17:37:36.257702] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-31T17:37:37.057698] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-31T17:37:37.313587] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T17:37:37.625097] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-31T17:37:37.857696] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-31T17:37:38.418728] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-31T17:37:38.657684] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-31T17:37:39.259354] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-31T17:37:39.457690] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-31T17:37:40.002277] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T17:37:40.257694] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-31T17:37:41.057699] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-31T17:37:41.092324] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T17:37:41.857681] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-31T17:37:42.152870] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T17:37:42.575978] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T17:37:42.579910] [INFO ] [REMOTE ] BLW: Full fetch complete (19225 records). [2025-10-31T17:37:42.580026] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-31T17:37:42.662900] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-31T17:37:42.939953] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-31T17:37:42.940037] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-31T17:37:42.940411] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-31T17:37:42.940450] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-31T17:37:42.941001] [DEBUG] [LOCAL ] BLW: Trimmed 19225 records to 12840 (keeping 200 days of data) [2025-10-31T17:37:43.016524] [DEBUG] [LOCAL ] BLW: Primary data saved (12840 records). [2025-10-31T17:37:43.016687] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-31T17:37:43.016781] [INFO ] [MAIN ] Update Progress: 305/2365 symbols completed. BLW took 35.4s. Estimated remaining: 4h 14m 15s. Rate: 8.1 symbols/min [2025-10-31T17:37:43.180770] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:43.204858] [DEBUG] [LOCAL ] BMI: Loaded 24595 existing records from primary storage. [2025-10-31T17:37:43.205096] [INFO ] [MAIN ] BMI: Loaded 24595 existing records. [2025-10-31T17:37:43.382197] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:37:43.386546] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-31T17:37:43.390146] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-31T17:37:43.390722] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-31T17:37:43.391046] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T17:37:43.391165] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-31T17:37:43.462733] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-31T17:37:43.756250] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:44.257698] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-31T17:37:44.599040] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-31T17:37:44.929950] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T17:37:45.057687] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-31T17:37:45.781164] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T17:37:45.784135] [INFO ] [REMOTE ] BME: Full fetch complete (15456 records). [2025-10-31T17:37:45.784205] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-31T17:37:45.862690] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-31T17:37:46.148137] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-31T17:37:46.148214] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-31T17:37:46.148551] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-31T17:37:46.148590] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-31T17:37:46.149104] [DEBUG] [LOCAL ] BME: Trimmed 15456 records to 11122 (keeping 200 days of data) [2025-10-31T17:37:46.214098] [DEBUG] [LOCAL ] BME: Primary data saved (11122 records). [2025-10-31T17:37:46.214218] [INFO ] [MAIN ] BME: Full history saved. [2025-10-31T17:37:46.214291] [INFO ] [MAIN ] Update Progress: 306/2365 symbols completed. BME took 15.9s. Estimated remaining: 4h 13m 40s. Rate: 8.1 symbols/min [2025-10-31T17:37:46.380614] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:46.384526] [DEBUG] [LOCAL ] BMN: Loaded 2649 existing records from primary storage. [2025-10-31T17:37:46.384697] [INFO ] [MAIN ] BMN: Loaded 2649 existing records. [2025-10-31T17:37:46.564081] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:37:46.564279] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-31T17:37:46.564325] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-31T17:37:46.564470] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-31T17:37:46.564507] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-31T17:37:46.662909] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-31T17:37:46.874512] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:37:46.959703] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:47.457632] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-31T17:37:47.602736] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-31T17:37:48.257706] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-31T17:37:48.440074] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-31T17:37:48.657032] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-31T17:37:49.057684] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-31T17:37:49.379342] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T17:37:49.857743] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-31T17:37:50.657696] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-31T17:37:50.754175] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-31T17:37:51.457629] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-31T17:37:51.566015] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-31T17:37:52.244108] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T17:37:52.257606] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-31T17:37:53.057635] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-31T17:37:53.126544] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-31T17:37:53.857668] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-31T17:37:54.126851] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-31T17:37:54.249421] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T17:37:54.657681] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-31T17:37:55.378483] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-31T17:37:55.457665] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-31T17:37:55.803824] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-31T17:37:56.257666] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-31T17:37:57.057681] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-31T17:37:57.666025] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T17:37:57.676438] [INFO ] [REMOTE ] BMA: Full fetch complete (52882 records). [2025-10-31T17:37:57.676589] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-31T17:37:57.859079] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-31T17:37:58.094461] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-31T17:37:58.094663] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-31T17:37:58.095319] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-31T17:37:58.095415] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-31T17:37:58.114616] [DEBUG] [LOCAL ] BMA: Trimmed 52882 records to 37465 (keeping 200 days of data) [2025-10-31T17:37:58.114483] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-31T17:37:58.355846] [DEBUG] [LOCAL ] BMA: Primary data saved (37465 records). [2025-10-31T17:37:58.356011] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-31T17:37:58.356115] [INFO ] [MAIN ] Update Progress: 307/2365 symbols completed. BMA took 46.2s. Estimated remaining: 4h 14m 4s. Rate: 8.1 symbols/min [2025-10-31T17:37:58.537713] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:37:58.576026] [DEBUG] [LOCAL ] BMO: Loaded 40703 existing records from primary storage. [2025-10-31T17:37:58.576309] [INFO ] [MAIN ] BMO: Loaded 40703 existing records. [2025-10-31T17:37:58.662568] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-31T17:37:58.762572] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:37:58.762990] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-31T17:37:58.763045] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-31T17:37:58.763375] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-31T17:37:58.763433] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-31T17:37:58.954361] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T17:37:59.146713] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:37:59.159698] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-31T17:37:59.457608] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-31T17:37:59.735546] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-31T17:38:00.257680] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-31T17:38:00.623955] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T17:38:01.057628] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-31T17:38:01.385326] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-31T17:38:01.857673] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-31T17:38:02.657635] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-31T17:38:02.681635] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-31T17:38:03.457677] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-31T17:38:03.789553] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-31T17:38:03.891049] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-31T17:38:04.257638] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-31T17:38:04.983767] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T17:38:05.057678] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-31T17:38:05.857706] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-31T17:38:05.887302] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T17:38:06.657664] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-31T17:38:06.862567] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T17:38:07.054902] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-31T17:38:07.056821] [INFO ] [REMOTE ] BMN: Full fetch complete (3825 records). [2025-10-31T17:38:07.056901] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-31T17:38:07.456349] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-31T17:38:07.456451] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-31T17:38:07.456604] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-31T17:38:07.456665] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-31T17:38:07.457036] [DEBUG] [LOCAL ] BMN: Trimmed 3825 records to 2707 (keeping 200 days of data) [2025-10-31T17:38:07.457672] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-31T17:38:07.474917] [DEBUG] [LOCAL ] BMN: Primary data saved (2707 records). [2025-10-31T17:38:07.475003] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-31T17:38:07.475078] [INFO ] [MAIN ] Update Progress: 308/2365 symbols completed. BMN took 21.3s. Estimated remaining: 4h 14m 8s. Rate: 8.1 symbols/min [2025-10-31T17:38:07.642778] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:38:07.707295] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-31T17:38:07.707667] [INFO ] [MAIN ] BMY: Loaded 54147 existing records. [2025-10-31T17:38:07.883370] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:38:07.883598] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-31T17:38:07.883668] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-31T17:38:07.884414] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-31T17:38:07.884472] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-31T17:38:08.240543] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:38:08.257622] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-31T17:38:08.364136] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T17:38:09.057690] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-31T17:38:09.278133] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T17:38:09.857680] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-31T17:38:09.953857] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-31T17:38:09.959592] [INFO ] [REMOTE ] BMEZ: Full fetch complete (38489 records). [2025-10-31T17:38:09.959724] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-31T17:38:10.340678] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-31T17:38:10.340771] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-31T17:38:10.341263] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-31T17:38:10.341305] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-31T17:38:10.342239] [DEBUG] [LOCAL ] BMEZ: Trimmed 38489 records to 24854 (keeping 200 days of data) [2025-10-31T17:38:10.485981] [DEBUG] [LOCAL ] BMEZ: Primary data saved (24854 records). [2025-10-31T17:38:10.486094] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-31T17:38:10.486167] [INFO ] [MAIN ] Update Progress: 309/2365 symbols completed. BMEZ took 35.9s. Estimated remaining: 4h 13m 31s. Rate: 8.1 symbols/min [2025-10-31T17:38:10.655115] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:38:10.657770] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-31T17:38:10.711462] [DEBUG] [LOCAL ] BN: Loaded 53357 existing records from primary storage. [2025-10-31T17:38:10.711791] [INFO ] [MAIN ] BN: Loaded 53357 existing records. [2025-10-31T17:38:10.904145] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:38:10.904396] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-31T17:38:10.904446] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-31T17:38:10.904819] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-31T17:38:10.904876] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-31T17:38:11.254549] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:38:11.379584] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T17:38:11.457618] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-31T17:38:11.852687] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T17:38:12.257669] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-31T17:38:12.882610] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-31T17:38:12.912080] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T17:38:13.057624] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-31T17:38:13.857669] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-31T17:38:14.546808] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-31T17:38:14.657627] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-31T17:38:15.227703] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T17:38:15.457622] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-31T17:38:15.483338] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T17:38:16.257633] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-31T17:38:16.656102] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T17:38:17.062064] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-31T17:38:17.065544] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T17:38:17.857733] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-31T17:38:18.205622] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-31T17:38:18.657684] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-31T17:38:18.976748] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-31T17:38:19.457680] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-31T17:38:19.812176] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T17:38:20.257684] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-31T17:38:20.837319] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T17:38:21.057688] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-31T17:38:21.526518] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T17:38:21.857733] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-31T17:38:22.053030] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T17:38:22.657692] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-31T17:38:23.457735] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-31T17:38:23.699241] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T17:38:23.707017] [INFO ] [REMOTE ] BMI: Full fetch complete (34285 records). [2025-10-31T17:38:23.707262] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-31T17:38:24.119907] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-31T17:38:24.120469] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-31T17:38:24.121024] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-31T17:38:24.123385] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-31T17:38:24.123236] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-31T17:38:24.136717] [DEBUG] [LOCAL ] BMI: Trimmed 34285 records to 24772 (keeping 200 days of data) [2025-10-31T17:38:24.257768] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-31T17:38:24.293019] [DEBUG] [LOCAL ] BMI: Primary data saved (24772 records). [2025-10-31T17:38:24.293155] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-31T17:38:24.293237] [INFO ] [MAIN ] Update Progress: 310/2365 symbols completed. BMI took 41.3s. Estimated remaining: 4h 14m 6s. Rate: 8.1 symbols/min [2025-10-31T17:38:24.465564] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:38:24.465876] [DEBUG] [LOCAL ] BNED: No existing data file found in primary storage. [2025-10-31T17:38:24.465939] [WARN ] [MAIN ] BNED: No existing data found, performing full refresh instead. [2025-10-31T17:38:24.466055] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-31T17:38:24.466118] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-31T17:38:24.466237] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-10-31T17:38:24.466477] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-31T17:38:24.820464] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T17:38:24.868445] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:38:25.057679] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-31T17:38:25.643001] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T17:38:25.857727] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-31T17:38:26.124338] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T17:38:26.657732] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-31T17:38:26.975170] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T17:38:27.457703] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-31T17:38:27.517863] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-31T17:38:28.257691] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-31T17:38:28.737892] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T17:38:29.057679] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-31T17:38:29.696367] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-31T17:38:29.857674] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-31T17:38:30.069599] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T17:38:30.081096] [INFO ] [REMOTE ] BMO: Full fetch complete (59741 records). [2025-10-31T17:38:30.081355] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-31T17:38:30.489220] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-31T17:38:30.489318] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-31T17:38:30.490055] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-31T17:38:30.490119] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-31T17:38:30.491394] [DEBUG] [LOCAL ] BMO: Trimmed 59741 records to 41022 (keeping 200 days of data) [2025-10-31T17:38:30.673793] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-31T17:38:30.766244] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-31T17:38:30.788862] [DEBUG] [LOCAL ] BMO: Primary data saved (41022 records). [2025-10-31T17:38:30.789003] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-31T17:38:30.790210] [INFO ] [MAIN ] Update Progress: 311/2365 symbols completed. BMO took 32.4s. Estimated remaining: 4h 13m 53s. Rate: 8.1 symbols/min [2025-10-31T17:38:30.959013] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:38:30.967744] [DEBUG] [LOCAL ] BNH: Loaded 4500 existing records from primary storage. [2025-10-31T17:38:30.968003] [INFO ] [MAIN ] BNH: Loaded 4500 existing records. [2025-10-31T17:38:31.148762] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:38:31.149005] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-31T17:38:31.149095] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-31T17:38:31.149288] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-31T17:38:31.149345] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-31T17:38:31.462913] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-31T17:38:31.514279] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:38:32.229274] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-31T17:38:32.257600] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-31T17:38:32.853131] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-31T17:38:33.002306] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-31T17:38:33.057690] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-31T17:38:33.395804] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-31T17:38:33.857687] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-31T17:38:34.220838] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T17:38:34.657680] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-31T17:38:34.958837] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-31T17:38:35.457672] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-31T17:38:35.928135] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-31T17:38:36.257687] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-31T17:38:37.057677] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-31T17:38:37.792190] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-31T17:38:37.857623] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-31T17:38:38.372156] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-31T17:38:38.662813] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-31T17:38:38.680173] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-31T17:38:39.457753] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-31T17:38:39.826481] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-31T17:38:40.257618] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-31T17:38:40.289389] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-31T17:38:41.057679] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-31T17:38:41.631376] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T17:38:41.857672] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-31T17:38:41.885907] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T17:38:42.657692] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-31T17:38:43.295281] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T17:38:43.307760] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-31T17:38:43.307923] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-31T17:38:43.461575] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-31T17:38:43.492320] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-31T17:38:43.744465] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-31T17:38:43.744561] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-31T17:38:43.745370] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-31T17:38:43.745432] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-31T17:38:43.746850] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 54537 (keeping 200 days of data) [2025-10-31T17:38:44.072005] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-10-31T17:38:44.072134] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-31T17:38:44.073038] [INFO ] [MAIN ] Update Progress: 312/2365 symbols completed. BMY took 36.6s. Estimated remaining: 4h 14m 24s. Rate: 8.1 symbols/min [2025-10-31T17:38:44.239166] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:38:44.244822] [DEBUG] [LOCAL ] BNJ: Loaded 2450 existing records from primary storage. [2025-10-31T17:38:44.245018] [INFO ] [MAIN ] BNJ: Loaded 2450 existing records. [2025-10-31T17:38:44.265509] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-31T17:38:44.427030] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:38:44.427380] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-31T17:38:44.427489] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-31T17:38:44.427685] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-31T17:38:44.427755] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-31T17:38:44.546427] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T17:38:44.736168] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-31T17:38:44.807085] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:38:45.057611] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-31T17:38:45.514422] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-31T17:38:45.857663] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-31T17:38:46.657618] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-31T17:38:46.840196] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T17:38:46.985114] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-31T17:38:47.457717] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-31T17:38:48.257672] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-31T17:38:48.364169] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T17:38:48.733103] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T17:38:49.057691] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-31T17:38:49.394498] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-31T17:38:49.857674] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-31T17:38:50.657695] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-31T17:38:51.032879] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-31T17:38:51.457676] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-31T17:38:51.834329] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-31T17:38:51.846551] [INFO ] [REMOTE ] BN: Full fetch complete (76955 records). [2025-10-31T17:38:51.846752] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-31T17:38:52.147820] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T17:38:52.162162] [INFO ] [REMOTE ] BNH: Full fetch complete (6812 records). [2025-10-31T17:38:52.162382] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-31T17:38:52.275378] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-31T17:38:52.380418] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-31T17:38:52.397377] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-31T17:38:52.403245] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-31T17:38:52.424546] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-31T17:38:52.490107] [DEBUG] [LOCAL ] BN: Trimmed 76955 records to 53747 (keeping 200 days of data) [2025-10-31T17:38:52.953904] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-31T17:38:52.954742] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-31T17:38:52.957122] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-31T17:38:52.959083] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-31T17:38:52.961821] [DEBUG] [LOCAL ] BNH: Trimmed 6812 records to 4529 (keeping 200 days of data) [2025-10-31T17:38:53.047677] [DEBUG] [LOCAL ] BNH: Primary data saved (4529 records). [2025-10-31T17:38:53.072092] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-31T17:38:53.053932] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-31T17:38:53.076460] [INFO ] [MAIN ] Update Progress: 313/2365 symbols completed. BNH took 22.3s. Estimated remaining: 4h 14m 27s. Rate: 8.1 symbols/min [2025-10-31T17:38:53.199630] [DEBUG] [LOCAL ] BN: Primary data saved (53747 records). [2025-10-31T17:38:53.205432] [INFO ] [MAIN ] BN: Full history saved. [2025-10-31T17:38:53.210682] [INFO ] [MAIN ] Update Progress: 314/2365 symbols completed. BN took 42.7s. Estimated remaining: 4h 13m 32s. Rate: 8.1 symbols/min [2025-10-31T17:38:53.312104] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:38:53.461103] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T17:38:53.463638] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:38:53.505941] [DEBUG] [LOCAL ] BNL: Loaded 47140 existing records from primary storage. [2025-10-31T17:38:53.518210] [INFO ] [MAIN ] BNL: Loaded 47140 existing records. [2025-10-31T17:38:53.565117] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-31T17:38:53.657514] [DEBUG] [LOCAL ] BNS: Loaded 51641 existing records from primary storage. [2025-10-31T17:38:53.683343] [INFO ] [MAIN ] BNS: Loaded 51641 existing records. [2025-10-31T17:38:53.800560] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:38:53.821928] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-31T17:38:53.822002] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-31T17:38:53.822420] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-31T17:38:53.822480] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-31T17:38:53.873000] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-31T17:38:53.984443] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:38:54.009754] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-31T17:38:54.014021] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-31T17:38:54.014361] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-31T17:38:54.014426] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-31T17:38:54.336265] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-31T17:38:54.668309] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-31T17:38:54.763264] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:38:54.771872] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:38:55.061486] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-31T17:38:55.457676] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-31T17:38:56.257694] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-31T17:38:56.550874] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T17:38:57.057675] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-31T17:38:57.530031] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-31T17:38:57.604671] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T17:38:57.857697] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-31T17:38:58.657621] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-31T17:38:58.792152] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T17:38:58.797210] [INFO ] [REMOTE ] BNED: Full fetch complete (41036 records). [2025-10-31T17:38:58.797308] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-31T17:38:59.171222] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-31T17:38:59.171291] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-31T17:38:59.171807] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-31T17:38:59.171868] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-31T17:38:59.172681] [DEBUG] [LOCAL ] BNED: Trimmed 41036 records to 28078 (keeping 200 days of data) [2025-10-31T17:38:59.323167] [DEBUG] [LOCAL ] BNED: Primary data saved (28078 records). [2025-10-31T17:38:59.323284] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-31T17:38:59.323351] [INFO ] [MAIN ] Update Progress: 315/2365 symbols completed. BNED took 35.0s. Estimated remaining: 4h 13m 16s. Rate: 8.1 symbols/min [2025-10-31T17:38:59.466177] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-31T17:38:59.499477] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:38:59.504755] [DEBUG] [LOCAL ] BNT: Loaded 3318 existing records from primary storage. [2025-10-31T17:38:59.504943] [INFO ] [MAIN ] BNT: Loaded 3318 existing records. [2025-10-31T17:38:59.688037] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:38:59.688372] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-31T17:38:59.688508] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-31T17:38:59.688768] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-31T17:38:59.688839] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-31T17:38:59.795417] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-31T17:38:59.970293] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-31T17:39:00.079425] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:39:00.257632] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-31T17:39:01.057721] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-31T17:39:01.440440] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-31T17:39:01.443534] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T17:39:01.857615] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-31T17:39:02.657666] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-31T17:39:03.083489] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-31T17:39:03.084755] [INFO ] [REMOTE ] BNJ: Full fetch complete (3864 records). [2025-10-31T17:39:03.084825] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-31T17:39:03.444709] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-31T17:39:03.444878] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-31T17:39:03.445025] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-31T17:39:03.468796] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-31T17:39:03.460881] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-31T17:39:03.472961] [DEBUG] [LOCAL ] BNJ: Trimmed 3864 records to 2471 (keeping 200 days of data) [2025-10-31T17:39:03.475741] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-31T17:39:03.503097] [DEBUG] [LOCAL ] BNJ: Primary data saved (2471 records). [2025-10-31T17:39:03.503225] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-31T17:39:03.503300] [INFO ] [MAIN ] Update Progress: 316/2365 symbols completed. BNJ took 19.4s. Estimated remaining: 4h 12m 48s. Rate: 8.1 symbols/min [2025-10-31T17:39:03.710213] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:39:03.722547] [DEBUG] [LOCAL ] BNY: Loaded 7193 existing records from primary storage. [2025-10-31T17:39:03.722800] [INFO ] [MAIN ] BNY: Loaded 7193 existing records. [2025-10-31T17:39:03.943144] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-31T17:39:03.949549] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:39:03.949841] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-31T17:39:03.951247] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-31T17:39:03.951407] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-31T17:39:03.951455] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-31T17:39:04.262822] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-31T17:39:04.395450] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:39:04.631298] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T17:39:05.057627] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-31T17:39:05.342981] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-31T17:39:05.857701] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-31T17:39:06.292064] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T17:39:06.657680] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-31T17:39:07.229320] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-31T17:39:07.457635] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-31T17:39:08.257728] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-31T17:39:08.541574] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-31T17:39:08.544168] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T17:39:09.057698] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-31T17:39:09.286780] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-31T17:39:09.857717] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-31T17:39:10.239753] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-31T17:39:10.657678] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-31T17:39:11.457682] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-31T17:39:11.862332] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T17:39:11.928802] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T17:39:12.257689] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-31T17:39:13.057682] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-31T17:39:13.349933] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T17:39:13.370059] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-31T17:39:13.857677] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-31T17:39:14.353416] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-31T17:39:14.657679] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-31T17:39:15.272018] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T17:39:15.273730] [INFO ] [REMOTE ] BNT: Full fetch complete (4904 records). [2025-10-31T17:39:15.273802] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-31T17:39:15.463331] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-31T17:39:15.628545] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-31T17:39:15.628615] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-31T17:39:15.628780] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-31T17:39:15.628834] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-31T17:39:15.629173] [DEBUG] [LOCAL ] BNT: Trimmed 4904 records to 3366 (keeping 200 days of data) [2025-10-31T17:39:15.648773] [DEBUG] [LOCAL ] BNT: Primary data saved (3366 records). [2025-10-31T17:39:15.648847] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-31T17:39:15.648913] [INFO ] [MAIN ] Update Progress: 317/2365 symbols completed. BNT took 16.3s. Estimated remaining: 4h 13m 11s. Rate: 8.1 symbols/min [2025-10-31T17:39:16.257729] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-31T17:39:16.700125] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T17:39:17.057744] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-31T17:39:17.537006] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T17:39:17.709514] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T17:39:17.857743] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-31T17:39:18.279464] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-31T17:39:18.657668] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-31T17:39:19.092943] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-31T17:39:19.457714] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-31T17:39:20.257624] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-31T17:39:20.688898] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-31T17:39:20.688693] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T17:39:21.057686] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-31T17:39:21.857729] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-31T17:39:22.279429] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T17:39:22.657672] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-31T17:39:23.246093] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T17:39:23.457669] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-31T17:39:23.826164] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T17:39:23.988708] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T17:39:24.257681] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-31T17:39:25.057688] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-31T17:39:25.463422] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T17:39:25.857684] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-31T17:39:26.398198] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-31T17:39:26.617611] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-31T17:39:26.628460] [INFO ] [REMOTE ] BNL: Full fetch complete (67424 records). [2025-10-31T17:39:26.628665] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-31T17:39:26.662952] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-31T17:39:27.012055] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-31T17:39:27.012162] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-31T17:39:27.013207] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-31T17:39:27.013288] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-31T17:39:27.014695] [DEBUG] [LOCAL ] BNL: Trimmed 67424 records to 47483 (keeping 200 days of data) [2025-10-31T17:39:27.307871] [DEBUG] [LOCAL ] BNL: Primary data saved (47483 records). [2025-10-31T17:39:27.308049] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-31T17:39:27.308141] [INFO ] [MAIN ] Update Progress: 318/2365 symbols completed. BNL took 34.2s. Estimated remaining: 4h 13m 31s. Rate: 8.1 symbols/min [2025-10-31T17:39:27.457695] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-31T17:39:27.989280] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-31T17:39:28.128057] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T17:39:28.257676] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-31T17:39:28.871478] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T17:39:28.874227] [INFO ] [REMOTE ] BNY: Full fetch complete (10444 records). [2025-10-31T17:39:28.874304] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-31T17:39:29.062752] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-31T17:39:29.269839] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-31T17:39:29.269907] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-31T17:39:29.270295] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-31T17:39:29.270336] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-31T17:39:29.270822] [DEBUG] [LOCAL ] BNY: Trimmed 10444 records to 7272 (keeping 200 days of data) [2025-10-31T17:39:29.318564] [DEBUG] [LOCAL ] BNY: Primary data saved (7272 records). [2025-10-31T17:39:29.318717] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-31T17:39:29.318807] [INFO ] [MAIN ] Update Progress: 319/2365 symbols completed. BNY took 25.8s. Estimated remaining: 4h 12m 49s. Rate: 8.1 symbols/min [2025-10-31T17:39:30.486099] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T17:39:30.498693] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-31T17:39:31.813793] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:39:31.826970] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-31T17:39:33.330509] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T17:39:33.342419] [INFO ] [REMOTE ] BNS: Full fetch complete (74525 records). [2025-10-31T17:39:33.342580] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-31T17:39:33.721822] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-31T17:39:33.721897] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-31T17:39:33.722662] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-31T17:39:33.722725] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-31T17:39:33.724051] [DEBUG] [LOCAL ] BNS: Trimmed 74525 records to 52009 (keeping 200 days of data) [2025-10-31T17:39:34.023866] [DEBUG] [LOCAL ] BNS: Primary data saved (52009 records). [2025-10-31T17:39:34.023991] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-31T17:39:34.024515] [INFO ] [MAIN ] Update Progress: 320/2365 symbols completed. BNS took 40.8s. Estimated remaining: 4h 12m 24s. Rate: 8.1 symbols/min [2025-10-31T17:39:34.615823] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:39:34.686952] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:39:34.728996] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:39:34.729197] [DEBUG] [LOCAL ] BOC: No existing data file found in primary storage. [2025-10-31T17:39:34.730191] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:39:34.730396] [WARN ] [MAIN ] BOC: No existing data found, performing full refresh instead. [2025-10-31T17:39:34.731723] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-31T17:39:34.731823] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-31T17:39:34.731883] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-10-31T17:39:34.731958] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-31T17:39:34.877835] [DEBUG] [LOCAL ] BOE: Loaded 17474 existing records from primary storage. [2025-10-31T17:39:34.891412] [INFO ] [MAIN ] BOE: Loaded 17474 existing records. [2025-10-31T17:39:35.028410] [DEBUG] [LOCAL ] BOH: Loaded 30663 existing records from primary storage. [2025-10-31T17:39:35.048903] [INFO ] [MAIN ] BOH: Loaded 30663 existing records. [2025-10-31T17:39:35.028863] [DEBUG] [LOCAL ] BOND: Loaded 32479 existing records from primary storage. [2025-10-31T17:39:35.104463] [INFO ] [MAIN ] BOND: Loaded 32479 existing records. [2025-10-31T17:39:35.407427] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:39:35.497174] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-31T17:39:35.543989] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-31T17:39:35.664457] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:39:35.655002] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-31T17:39:35.687603] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-31T17:39:35.691401] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-31T17:39:35.691292] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:39:35.711198] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-31T17:39:35.722215] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:39:35.732455] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-31T17:39:35.747122] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-31T17:39:35.752791] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-31T17:39:35.752512] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-31T17:39:35.758055] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-31T17:39:35.798679] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-31T17:39:35.861939] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-31T17:39:36.749591] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:39:36.776922] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-31T17:39:36.780590] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:39:36.801992] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:39:36.802607] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-31T17:39:36.802366] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-31T17:39:36.815569] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T17:39:36.820689] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-31T17:39:37.395334] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T17:39:37.398820] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-31T17:39:37.669006] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T17:39:37.675167] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-31T17:39:37.730088] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T17:39:37.737563] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-31T17:39:37.767721] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T17:39:37.857711] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-31T17:39:38.101388] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T17:39:38.384222] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T17:39:38.483413] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T17:39:38.657628] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-31T17:39:38.767758] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T17:39:39.458954] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-31T17:39:39.462786] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T17:39:40.257608] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-31T17:39:40.335411] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T17:39:40.967774] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T17:39:41.057669] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-31T17:39:41.740957] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T17:39:41.857747] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-31T17:39:42.657619] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-31T17:39:42.857822] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T17:39:43.319621] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-31T17:39:43.457605] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-31T17:39:44.180390] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T17:39:44.257605] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-31T17:39:45.002804] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-31T17:39:45.057629] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-31T17:39:45.857687] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-31T17:39:45.942837] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-31T17:39:46.657695] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-31T17:39:46.889879] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-31T17:39:47.457620] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-31T17:39:47.483341] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-31T17:39:48.227637] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T17:39:48.257601] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-31T17:39:49.045088] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T17:39:49.049524] [INFO ] [REMOTE ] BOC: Full fetch complete (25766 records). [2025-10-31T17:39:49.049670] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-31T17:39:49.062769] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-31T17:39:49.409884] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-31T17:39:49.409956] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-31T17:39:49.410300] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-31T17:39:49.410339] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-31T17:39:49.410960] [DEBUG] [LOCAL ] BOC: Trimmed 25766 records to 18029 (keeping 200 days of data) [2025-10-31T17:39:49.509587] [DEBUG] [LOCAL ] BOC: Primary data saved (18029 records). [2025-10-31T17:39:49.509736] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-31T17:39:49.509810] [INFO ] [MAIN ] Update Progress: 321/2365 symbols completed. BOC took 15.5s. Estimated remaining: 4h 13m 8s. Rate: 8.1 symbols/min [2025-10-31T17:39:49.673600] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:39:49.709934] [DEBUG] [LOCAL ] BOOT: Loaded 39411 existing records from primary storage. [2025-10-31T17:39:49.710197] [INFO ] [MAIN ] BOOT: Loaded 39411 existing records. [2025-10-31T17:39:49.862441] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-31T17:39:49.885247] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:39:49.886488] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-31T17:39:49.886571] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-31T17:39:49.886767] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-31T17:39:49.886823] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-31T17:39:50.210603] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-31T17:39:50.266134] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:39:50.657616] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-31T17:39:50.797441] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-31T17:39:51.457673] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-31T17:39:51.923927] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T17:39:52.257667] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-31T17:39:52.299325] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T17:39:52.875251] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-31T17:39:53.057673] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-31T17:39:53.857698] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-31T17:39:54.236132] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T17:39:54.657722] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-31T17:39:55.096518] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T17:39:55.457799] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-31T17:39:55.663896] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T17:39:56.257640] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-31T17:39:56.392344] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-31T17:39:56.735909] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-31T17:39:57.057698] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-31T17:39:57.857715] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-31T17:39:58.367261] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T17:39:58.657691] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-31T17:39:58.811764] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T17:39:59.457631] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-31T17:39:59.567844] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T17:40:00.257705] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-31T17:40:00.514788] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T17:40:01.027496] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T17:40:01.057694] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-31T17:40:01.857622] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-31T17:40:02.548590] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T17:40:02.556795] [INFO ] [REMOTE ] BOH: Full fetch complete (45557 records). [2025-10-31T17:40:02.556921] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-31T17:40:02.658095] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-31T17:40:02.839195] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T17:40:02.971137] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-31T17:40:02.971228] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-31T17:40:02.971833] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-31T17:40:02.971900] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-31T17:40:02.973067] [DEBUG] [LOCAL ] BOH: Trimmed 45557 records to 30929 (keeping 200 days of data) [2025-10-31T17:40:03.169742] [DEBUG] [LOCAL ] BOH: Primary data saved (30929 records). [2025-10-31T17:40:03.169867] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-31T17:40:03.170925] [INFO ] [MAIN ] Update Progress: 322/2365 symbols completed. BOH took 29.1s. Estimated remaining: 4h 13m 40s. Rate: 8.1 symbols/min [2025-10-31T17:40:03.334047] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:03.382971] [DEBUG] [LOCAL ] BORR: Loaded 51411 existing records from primary storage. [2025-10-31T17:40:03.383251] [INFO ] [MAIN ] BORR: Loaded 51411 existing records. [2025-10-31T17:40:03.462875] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-31T17:40:03.559470] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:40:03.559690] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-31T17:40:03.559750] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-31T17:40:03.559929] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-31T17:40:03.559972] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-31T17:40:03.899064] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:40:04.148530] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T17:40:04.257683] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-31T17:40:04.407220] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-31T17:40:04.413008] [INFO ] [REMOTE ] BOE: Full fetch complete (26611 records). [2025-10-31T17:40:04.413105] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-31T17:40:04.845808] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-31T17:40:04.845944] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-31T17:40:04.846495] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-31T17:40:04.846565] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-31T17:40:04.847305] [DEBUG] [LOCAL ] BOE: Trimmed 26611 records to 17571 (keeping 200 days of data) [2025-10-31T17:40:04.964057] [DEBUG] [LOCAL ] BOE: Primary data saved (17571 records). [2025-10-31T17:40:04.964216] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-31T17:40:04.964317] [INFO ] [MAIN ] Update Progress: 323/2365 symbols completed. BOE took 30.9s. Estimated remaining: 4h 12m 57s. Rate: 8.1 symbols/min [2025-10-31T17:40:05.062847] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-31T17:40:05.206280] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:05.229367] [DEBUG] [LOCAL ] BOW: Loaded 22660 existing records from primary storage. [2025-10-31T17:40:05.229692] [INFO ] [MAIN ] BOW: Loaded 22660 existing records. [2025-10-31T17:40:05.424990] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:40:05.425528] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-31T17:40:05.425616] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-31T17:40:05.425981] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-31T17:40:05.426099] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-31T17:40:05.848242] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:40:05.850679] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-31T17:40:05.860165] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-31T17:40:06.252834] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T17:40:06.657670] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-31T17:40:07.200942] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T17:40:07.457632] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-31T17:40:07.728302] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T17:40:07.992618] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-31T17:40:08.257636] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-31T17:40:08.876090] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-31T17:40:09.057634] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-31T17:40:09.857708] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-31T17:40:10.029042] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T17:40:10.657716] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-31T17:40:10.887491] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T17:40:11.457637] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-31T17:40:11.716521] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-31T17:40:11.724343] [INFO ] [REMOTE ] BOND: Full fetch complete (46699 records). [2025-10-31T17:40:11.724454] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-31T17:40:12.110359] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-31T17:40:12.110446] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-31T17:40:12.111020] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-31T17:40:12.111082] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-31T17:40:12.112010] [DEBUG] [LOCAL ] BOND: Trimmed 46699 records to 32750 (keeping 200 days of data) [2025-10-31T17:40:12.265516] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-31T17:40:12.311325] [DEBUG] [LOCAL ] BOND: Primary data saved (32750 records). [2025-10-31T17:40:12.311427] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-31T17:40:12.311500] [INFO ] [MAIN ] Update Progress: 324/2365 symbols completed. BOND took 38.3s. Estimated remaining: 4h 12m 49s. Rate: 8.1 symbols/min [2025-10-31T17:40:12.484145] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:12.484315] [DEBUG] [LOCAL ] BOX: No existing data file found in primary storage. [2025-10-31T17:40:12.484352] [WARN ] [MAIN ] BOX: No existing data found, performing full refresh instead. [2025-10-31T17:40:12.484460] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-31T17:40:12.484502] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-31T17:40:12.484544] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-31T17:40:12.484584] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-31T17:40:12.841525] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:40:12.866857] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T17:40:13.057626] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-31T17:40:13.487293] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T17:40:13.857717] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-31T17:40:14.657668] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-31T17:40:14.945630] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T17:40:14.979143] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-31T17:40:15.457724] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-31T17:40:16.086158] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T17:40:16.257687] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-31T17:40:16.570779] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:40:17.057695] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-31T17:40:17.697483] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T17:40:17.857704] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-31T17:40:18.551935] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-31T17:40:18.657705] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-31T17:40:19.113420] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T17:40:19.122179] [INFO ] [REMOTE ] BOOT: Full fetch complete (59609 records). [2025-10-31T17:40:19.122301] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-31T17:40:19.459203] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-31T17:40:19.509572] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-31T17:40:19.509685] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-31T17:40:19.510389] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-31T17:40:19.510432] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-31T17:40:19.511703] [DEBUG] [LOCAL ] BOOT: Trimmed 59609 records to 39665 (keeping 200 days of data) [2025-10-31T17:40:19.749614] [DEBUG] [LOCAL ] BOOT: Primary data saved (39665 records). [2025-10-31T17:40:19.749777] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-31T17:40:19.749858] [INFO ] [MAIN ] Update Progress: 325/2365 symbols completed. BOOT took 30.2s. Estimated remaining: 4h 12m 41s. Rate: 8.1 symbols/min [2025-10-31T17:40:19.933826] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:19.968491] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T17:40:20.023243] [DEBUG] [LOCAL ] BP: Loaded 54095 existing records from primary storage. [2025-10-31T17:40:20.023556] [INFO ] [MAIN ] BP: Loaded 54095 existing records. [2025-10-31T17:40:20.195930] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:40:20.196152] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-31T17:40:20.196197] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-31T17:40:20.196817] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-31T17:40:20.196872] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-31T17:40:20.262828] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-31T17:40:20.546878] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:40:20.803666] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T17:40:21.057719] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-31T17:40:21.811331] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-31T17:40:21.857662] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-31T17:40:22.657703] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-31T17:40:22.878973] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-31T17:40:23.098060] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T17:40:23.457692] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-31T17:40:23.970841] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T17:40:24.257690] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-31T17:40:24.946877] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-31T17:40:25.057672] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-31T17:40:25.349776] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T17:40:25.857712] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-31T17:40:26.071702] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T17:40:26.657697] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-31T17:40:27.100976] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T17:40:27.457668] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-31T17:40:27.999492] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T17:40:28.257701] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-31T17:40:28.699781] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T17:40:29.057633] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-31T17:40:29.838665] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T17:40:29.857615] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-31T17:40:30.456098] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-31T17:40:30.657667] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-31T17:40:31.053142] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T17:40:31.457701] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-31T17:40:31.887805] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T17:40:32.257671] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-31T17:40:32.826334] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-31T17:40:32.839242] [INFO ] [REMOTE ] BOX: Full fetch complete (72377 records). [2025-10-31T17:40:32.839501] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-31T17:40:33.066145] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-31T17:40:33.316901] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-31T17:40:33.317029] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-31T17:40:33.318227] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-31T17:40:33.318306] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-31T17:40:33.320452] [DEBUG] [LOCAL ] BOX: Trimmed 72377 records to 50712 (keeping 200 days of data) [2025-10-31T17:40:33.640628] [DEBUG] [LOCAL ] BOX: Primary data saved (50712 records). [2025-10-31T17:40:33.640865] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-31T17:40:33.640959] [INFO ] [MAIN ] Update Progress: 326/2365 symbols completed. BOX took 21.3s. Estimated remaining: 4h 13m 14s. Rate: 8.1 symbols/min [2025-10-31T17:40:33.842988] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:33.863203] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-31T17:40:33.878884] [DEBUG] [LOCAL ] BR: Loaded 34592 existing records from primary storage. [2025-10-31T17:40:33.879179] [INFO ] [MAIN ] BR: Loaded 34592 existing records. [2025-10-31T17:40:34.077954] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:40:34.079439] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T17:40:34.084773] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-31T17:40:34.085471] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-31T17:40:34.086186] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-31T17:40:34.086249] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-31T17:40:34.412872] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-31T17:40:34.498986] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:40:34.657611] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-31T17:40:35.371903] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-31T17:40:35.383402] [INFO ] [REMOTE ] BORR: Full fetch complete (74530 records). [2025-10-31T17:40:35.383522] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-31T17:40:35.462769] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-31T17:40:35.799680] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-31T17:40:35.799807] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-31T17:40:35.800802] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-31T17:40:35.800939] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-31T17:40:35.809114] [DEBUG] [LOCAL ] BORR: Trimmed 74530 records to 51788 (keeping 200 days of data) [2025-10-31T17:40:35.821845] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T17:40:36.112193] [DEBUG] [LOCAL ] BORR: Primary data saved (51788 records). [2025-10-31T17:40:36.112322] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-31T17:40:36.113072] [INFO ] [MAIN ] Update Progress: 327/2365 symbols completed. BORR took 32.9s. Estimated remaining: 4h 12m 36s. Rate: 8.1 symbols/min [2025-10-31T17:40:36.279262] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-31T17:40:36.282762] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:36.337061] [DEBUG] [LOCAL ] BRBR: Loaded 52257 existing records from primary storage. [2025-10-31T17:40:36.337371] [INFO ] [MAIN ] BRBR: Loaded 52257 existing records. [2025-10-31T17:40:36.509001] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:40:36.509207] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-31T17:40:36.509264] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-31T17:40:36.509442] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-31T17:40:36.509529] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-31T17:40:36.853712] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:40:37.034996] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-31T17:40:37.057622] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-31T17:40:37.124148] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-31T17:40:37.857701] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-31T17:40:38.053139] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T17:40:38.657701] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-31T17:40:39.385757] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T17:40:39.386313] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T17:40:39.457628] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-31T17:40:40.220108] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T17:40:40.257615] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-31T17:40:40.930766] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T17:40:41.057701] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-31T17:40:41.857685] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-31T17:40:42.667164] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-31T17:40:42.688141] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-31T17:40:42.860762] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T17:40:43.457710] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-31T17:40:43.888765] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T17:40:44.257688] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-31T17:40:44.364813] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-31T17:40:45.057681] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-31T17:40:45.491051] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T17:40:45.857673] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-31T17:40:46.657685] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-31T17:40:46.698343] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-31T17:40:47.051174] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T17:40:47.457723] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-31T17:40:47.686362] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T17:40:48.257725] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-31T17:40:48.656552] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T17:40:49.057755] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-31T17:40:49.161978] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T17:40:49.857701] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-31T17:40:50.043584] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T17:40:50.049905] [INFO ] [REMOTE ] BOW: Full fetch complete (32311 records). [2025-10-31T17:40:50.050010] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-31T17:40:50.467472] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-31T17:40:50.467579] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-31T17:40:50.468239] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-31T17:40:50.468304] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-31T17:40:50.469453] [DEBUG] [LOCAL ] BOW: Trimmed 32311 records to 22802 (keeping 200 days of data) [2025-10-31T17:40:50.608465] [DEBUG] [LOCAL ] BOW: Primary data saved (22802 records). [2025-10-31T17:40:50.608676] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-31T17:40:50.608797] [INFO ] [MAIN ] Update Progress: 328/2365 symbols completed. BOW took 45.6s. Estimated remaining: 4h 13m 12s. Rate: 8.0 symbols/min [2025-10-31T17:40:50.668732] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-31T17:40:50.808635] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:50.832873] [DEBUG] [LOCAL ] BRC: Loaded 17976 existing records from primary storage. [2025-10-31T17:40:50.833285] [INFO ] [MAIN ] BRC: Loaded 17976 existing records. [2025-10-31T17:40:51.043534] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:40:51.044077] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-31T17:40:51.044185] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-31T17:40:51.044561] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-31T17:40:51.044832] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-31T17:40:51.416597] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-31T17:40:51.461981] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-31T17:40:51.506466] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:40:52.211162] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T17:40:52.257633] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-31T17:40:52.489756] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T17:40:53.057673] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-31T17:40:53.857677] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-31T17:40:54.183767] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-31T17:40:54.196910] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-31T17:40:54.197084] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-31T17:40:54.553567] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-31T17:40:54.655702] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-31T17:40:54.655789] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-31T17:40:54.656569] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-31T17:40:54.656611] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-31T17:40:54.657622] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-31T17:40:54.659033] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 54485 (keeping 200 days of data) [2025-10-31T17:40:54.791184] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-31T17:40:55.009977] [DEBUG] [LOCAL ] BP: Primary data saved (54485 records). [2025-10-31T17:40:55.010137] [INFO ] [MAIN ] BP: Full history saved. [2025-10-31T17:40:55.010404] [INFO ] [MAIN ] Update Progress: 329/2365 symbols completed. BP took 35.3s. Estimated remaining: 4h 12m 46s. Rate: 8.1 symbols/min [2025-10-31T17:40:55.180173] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:55.216125] [DEBUG] [LOCAL ] BRCC: Loaded 40333 existing records from primary storage. [2025-10-31T17:40:55.216408] [INFO ] [MAIN ] BRCC: Loaded 40333 existing records. [2025-10-31T17:40:55.399667] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:40:55.399883] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-31T17:40:55.399952] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-31T17:40:55.400219] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-31T17:40:55.400277] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-31T17:40:55.462916] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-31T17:40:55.761555] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:40:55.786734] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T17:40:56.257617] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-31T17:40:56.911447] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-31T17:40:57.057620] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-31T17:40:57.263344] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T17:40:57.857678] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-31T17:40:58.311461] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T17:40:58.657676] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-31T17:40:59.120291] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T17:40:59.129556] [INFO ] [REMOTE ] BR: Full fetch complete (50230 records). [2025-10-31T17:40:59.129700] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-31T17:40:59.463219] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-31T17:40:59.513570] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-31T17:40:59.513670] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-31T17:40:59.514213] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-31T17:40:59.514255] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-31T17:40:59.515222] [DEBUG] [LOCAL ] BR: Trimmed 50230 records to 34946 (keeping 200 days of data) [2025-10-31T17:40:59.727619] [DEBUG] [LOCAL ] BR: Primary data saved (34946 records). [2025-10-31T17:40:59.727832] [INFO ] [MAIN ] BR: Full history saved. [2025-10-31T17:40:59.728183] [INFO ] [MAIN ] Update Progress: 330/2365 symbols completed. BR took 26.1s. Estimated remaining: 4h 12m 22s. Rate: 8.1 symbols/min [2025-10-31T17:40:59.864216] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T17:40:59.931293] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:40:59.931485] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-31T17:40:59.931526] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-31T17:40:59.931638] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-31T17:40:59.931736] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-31T17:40:59.931785] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-31T17:40:59.931820] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-31T17:41:00.258165] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-31T17:41:00.299609] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:00.312866] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-31T17:41:01.057695] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-31T17:41:01.272352] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:41:01.857902] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-31T17:41:02.349132] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T17:41:02.657711] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-31T17:41:02.720229] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-31T17:41:02.810754] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:41:02.811062] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-31T17:41:02.811149] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:41:02.811196] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-31T17:41:02.811231] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:41:02.811270] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-31T17:41:02.811325] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-31T17:41:02.811361] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-31T17:41:02.811400] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-31T17:41:02.811446] [INFO ] [MAIN ] Update Progress: 331/2365 symbols completed. BRCE took 3.1s. Estimated remaining: 4h 11m 47s. Rate: 8.1 symbols/min [2025-10-31T17:41:03.003755] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:03.003947] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-31T17:41:03.003989] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-31T17:41:03.004105] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-31T17:41:03.004147] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-31T17:41:03.004200] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-31T17:41:03.004266] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-31T17:41:03.367243] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:03.457691] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-31T17:41:03.610390] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:41:03.610740] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-31T17:41:03.610826] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:41:03.610875] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-31T17:41:03.610932] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:41:03.611004] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-31T17:41:03.611101] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-31T17:41:03.611152] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-31T17:41:03.611197] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-31T17:41:03.611242] [INFO ] [MAIN ] Update Progress: 332/2365 symbols completed. BRIE took 0.8s. Estimated remaining: 4h 10m 59s. Rate: 8.1 symbols/min [2025-10-31T17:41:03.789769] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:03.845466] [DEBUG] [LOCAL ] BRO: Loaded 52499 existing records from primary storage. [2025-10-31T17:41:03.845847] [INFO ] [MAIN ] BRO: Loaded 52499 existing records. [2025-10-31T17:41:04.026527] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:41:04.026779] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-31T17:41:04.026866] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-31T17:41:04.027264] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-31T17:41:04.027320] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-31T17:41:04.262858] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-31T17:41:04.415497] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:05.057702] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-31T17:41:05.177973] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T17:41:05.857624] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-31T17:41:06.442268] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-31T17:41:06.559982] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T17:41:06.657687] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-31T17:41:07.457710] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-31T17:41:08.157123] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-31T17:41:08.256768] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T17:41:08.264190] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-31T17:41:08.269697] [INFO ] [REMOTE ] BRBR: Full fetch complete (73480 records). [2025-10-31T17:41:08.269861] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-31T17:41:08.664519] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-31T17:41:08.664610] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-31T17:41:08.665413] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-31T17:41:08.665477] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-31T17:41:08.667047] [DEBUG] [LOCAL ] BRBR: Trimmed 73480 records to 52641 (keeping 200 days of data) [2025-10-31T17:41:08.986992] [DEBUG] [LOCAL ] BRBR: Primary data saved (52641 records). [2025-10-31T17:41:08.987116] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-31T17:41:08.987785] [INFO ] [MAIN ] Update Progress: 333/2365 symbols completed. BRBR took 32.9s. Estimated remaining: 4h 10m 40s. Rate: 8.1 symbols/min [2025-10-31T17:41:09.062724] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-31T17:41:09.172591] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:09.221602] [DEBUG] [LOCAL ] BROS: Loaded 53684 existing records from primary storage. [2025-10-31T17:41:09.221917] [INFO ] [MAIN ] BROS: Loaded 53684 existing records. [2025-10-31T17:41:09.397866] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:41:09.398154] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-31T17:41:09.398206] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-31T17:41:09.398520] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-31T17:41:09.398559] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-31T17:41:09.777067] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:09.779003] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-31T17:41:09.857677] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-31T17:41:10.318351] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T17:41:10.657671] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-31T17:41:11.379278] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T17:41:11.457609] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-31T17:41:11.488566] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-31T17:41:12.257724] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-31T17:41:12.856512] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-31T17:41:13.057741] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-31T17:41:13.302235] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T17:41:13.716242] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T17:41:13.857695] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-31T17:41:14.555139] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T17:41:14.657699] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-31T17:41:15.457713] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-31T17:41:15.973210] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T17:41:16.257673] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-31T17:41:16.543076] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T17:41:17.057690] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-31T17:41:17.171187] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T17:41:17.175802] [INFO ] [REMOTE ] BRC: Full fetch complete (28045 records). [2025-10-31T17:41:17.175968] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-31T17:41:17.176538] [FATAL] [VALIDATOR ] BRC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:41:17.176688] [FATAL] [MAIN ] BRC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:41:17.176783] [WARN ] [MAIN ] BRC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:41:17.176857] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-31T17:41:17.176920] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-10-31T17:41:17.176957] [INFO ] [LOCAL ] BRC: Starting deletion of derivative data. [2025-10-31T17:41:17.177107] [DEBUG] [LOCAL ] BRC: Deleted derivative data file. [2025-10-31T17:41:17.177201] [INFO ] [MAIN ] Update Progress: 334/2365 symbols completed. BRC took 26.6s. Estimated remaining: 4h 10m 37s. Rate: 8.1 symbols/min [2025-10-31T17:41:17.358010] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:17.358180] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-31T17:41:17.358238] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-31T17:41:17.358350] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-31T17:41:17.358392] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-31T17:41:17.358454] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-31T17:41:17.358503] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-31T17:41:17.724139] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:17.857672] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-31T17:41:18.007296] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:41:18.007542] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-31T17:41:18.007628] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:41:18.007749] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-31T17:41:18.007818] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:41:18.007920] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-31T17:41:18.007997] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-31T17:41:18.008035] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-31T17:41:18.008125] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-31T17:41:18.008179] [INFO ] [MAIN ] Update Progress: 335/2365 symbols completed. BRSL took 0.8s. Estimated remaining: 4h 9m 50s. Rate: 8.1 symbols/min [2025-10-31T17:41:18.184765] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:18.219712] [DEBUG] [LOCAL ] BRSP: Loaded 36160 existing records from primary storage. [2025-10-31T17:41:18.220041] [INFO ] [MAIN ] BRSP: Loaded 36160 existing records. [2025-10-31T17:41:18.416737] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:41:18.417032] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-31T17:41:18.417242] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-31T17:41:18.417702] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-31T17:41:18.417874] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-31T17:41:18.662735] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-31T17:41:18.675024] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-31T17:41:18.838857] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:19.457676] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-31T17:41:20.132423] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-31T17:41:20.257626] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-31T17:41:20.488957] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T17:41:21.057671] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-31T17:41:21.730582] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T17:41:21.857666] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-31T17:41:22.335621] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T17:41:22.657666] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-31T17:41:23.457616] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-31T17:41:23.530134] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-31T17:41:23.801155] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T17:41:24.257722] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-31T17:41:24.531244] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T17:41:25.057685] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-31T17:41:25.571581] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T17:41:25.857741] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-31T17:41:26.083050] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T17:41:26.657713] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-31T17:41:27.415938] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-31T17:41:27.457612] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-31T17:41:27.733285] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T17:41:28.257701] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-31T17:41:28.802182] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T17:41:29.057704] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-31T17:41:29.539999] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T17:41:29.857670] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-31T17:41:30.384701] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T17:41:30.657724] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-31T17:41:31.278239] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T17:41:31.286901] [INFO ] [REMOTE ] BRCC: Full fetch complete (57374 records). [2025-10-31T17:41:31.286994] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-31T17:41:31.460835] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-31T17:41:31.661940] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-31T17:41:31.662014] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-31T17:41:31.662635] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-31T17:41:31.662714] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-31T17:41:31.663776] [DEBUG] [LOCAL ] BRCC: Trimmed 57374 records to 40657 (keeping 200 days of data) [2025-10-31T17:41:31.882019] [DEBUG] [LOCAL ] BRCC: Primary data saved (40657 records). [2025-10-31T17:41:31.882132] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-31T17:41:31.882205] [INFO ] [MAIN ] Update Progress: 336/2365 symbols completed. BRCC took 36.9s. Estimated remaining: 4h 10m 22s. Rate: 8.1 symbols/min [2025-10-31T17:41:32.054078] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:32.061038] [DEBUG] [LOCAL ] BRT: Loaded 5235 existing records from primary storage. [2025-10-31T17:41:32.061189] [INFO ] [MAIN ] BRT: Loaded 5235 existing records. [2025-10-31T17:41:32.240519] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:41:32.241070] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-31T17:41:32.241159] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-31T17:41:32.241389] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-31T17:41:32.241505] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-31T17:41:32.273214] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-31T17:41:32.593032] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-31T17:41:32.644001] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:32.640539] [INFO ] [REMOTE ] BRO: Full fetch complete (75202 records). [2025-10-31T17:41:32.644151] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-31T17:41:33.038212] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-31T17:41:33.038377] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-31T17:41:33.039404] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-31T17:41:33.039515] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-31T17:41:33.041042] [DEBUG] [LOCAL ] BRO: Trimmed 75202 records to 52889 (keeping 200 days of data) [2025-10-31T17:41:33.094791] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-31T17:41:33.291838] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-31T17:41:33.424610] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T17:41:33.441285] [DEBUG] [LOCAL ] BRO: Primary data saved (52889 records). [2025-10-31T17:41:33.441402] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-31T17:41:33.441537] [INFO ] [MAIN ] Update Progress: 337/2365 symbols completed. BRO took 29.8s. Estimated remaining: 4h 9m 39s. Rate: 8.1 symbols/min [2025-10-31T17:41:33.607462] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:33.626973] [DEBUG] [LOCAL ] BRW: Loaded 20994 existing records from primary storage. [2025-10-31T17:41:33.627202] [INFO ] [MAIN ] BRW: Loaded 20994 existing records. [2025-10-31T17:41:33.743261] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-31T17:41:33.808754] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:41:33.808973] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-31T17:41:33.809027] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-31T17:41:33.809181] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-31T17:41:33.809222] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-31T17:41:33.862768] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-31T17:41:34.162573] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:34.657684] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-31T17:41:34.918607] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T17:41:35.448057] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T17:41:35.457610] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-31T17:41:36.161377] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-31T17:41:36.257699] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-31T17:41:37.057722] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-31T17:41:37.382209] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:41:37.857671] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-31T17:41:38.224982] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T17:41:38.500514] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-31T17:41:38.657678] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-31T17:41:39.080741] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-31T17:41:39.457728] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-31T17:41:40.257716] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-31T17:41:40.916250] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T17:41:40.949576] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T17:41:41.057622] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-31T17:41:41.857687] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-31T17:41:42.545985] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-31T17:41:42.571993] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-31T17:41:42.657679] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-31T17:41:43.457682] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-31T17:41:43.696747] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T17:41:44.257668] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-31T17:41:44.816009] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-31T17:41:45.057623] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-31T17:41:45.111533] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-31T17:41:45.857677] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-31T17:41:46.107227] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T17:41:46.194451] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-31T17:41:46.657673] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-31T17:41:47.043404] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-31T17:41:47.457717] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-31T17:41:48.193234] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-31T17:41:48.257674] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-31T17:41:49.057677] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-31T17:41:49.356921] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T17:41:49.857681] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-31T17:41:50.279907] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-31T17:41:50.657613] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-31T17:41:50.791078] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-31T17:41:50.803288] [INFO ] [REMOTE ] BROS: Full fetch complete (77277 records). [2025-10-31T17:41:50.803421] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-31T17:41:51.126177] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-31T17:41:51.227525] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-31T17:41:51.227594] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-31T17:41:51.228612] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-31T17:41:51.228720] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-31T17:41:51.230663] [DEBUG] [LOCAL ] BROS: Trimmed 77277 records to 54073 (keeping 200 days of data) [2025-10-31T17:41:51.457760] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-31T17:41:51.541999] [DEBUG] [LOCAL ] BROS: Primary data saved (54073 records). [2025-10-31T17:41:51.542114] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-31T17:41:51.542812] [INFO ] [MAIN ] Update Progress: 338/2365 symbols completed. BROS took 42.6s. Estimated remaining: 4h 10m 36s. Rate: 8.1 symbols/min [2025-10-31T17:41:51.707770] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:51.757743] [DEBUG] [LOCAL ] BRX: Loaded 52199 existing records from primary storage. [2025-10-31T17:41:51.758064] [INFO ] [MAIN ] BRX: Loaded 52199 existing records. [2025-10-31T17:41:51.930776] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:41:51.931024] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-31T17:41:51.931076] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-31T17:41:51.931435] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-31T17:41:51.931480] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-31T17:41:52.249297] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-31T17:41:52.264841] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-31T17:41:52.331368] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:53.057698] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-31T17:41:53.410091] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-31T17:41:53.418482] [INFO ] [REMOTE ] BRSP: Full fetch complete (53939 records). [2025-10-31T17:41:53.418628] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-31T17:41:53.792836] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-31T17:41:53.792908] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-31T17:41:53.793508] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-31T17:41:53.793549] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-31T17:41:53.794558] [DEBUG] [LOCAL ] BRSP: Trimmed 53939 records to 36442 (keeping 200 days of data) [2025-10-31T17:41:53.874538] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-31T17:41:54.000108] [DEBUG] [LOCAL ] BRSP: Primary data saved (36442 records). [2025-10-31T17:41:54.000246] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-31T17:41:54.000325] [INFO ] [MAIN ] Update Progress: 339/2365 symbols completed. BRSP took 36.0s. Estimated remaining: 4h 9m 59s. Rate: 8.1 symbols/min [2025-10-31T17:41:54.176234] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:54.209190] [DEBUG] [LOCAL ] BSAC: Loaded 32463 existing records from primary storage. [2025-10-31T17:41:54.209570] [INFO ] [MAIN ] BSAC: Loaded 32463 existing records. [2025-10-31T17:41:54.394783] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:41:54.395177] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-31T17:41:54.395251] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-31T17:41:54.395515] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-31T17:41:54.395675] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-31T17:41:54.529756] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-31T17:41:54.662785] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-31T17:41:54.803109] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:54.817990] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-31T17:41:55.297329] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T17:41:55.457710] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-31T17:41:56.083549] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T17:41:56.085848] [INFO ] [REMOTE ] BRT: Full fetch complete (7119 records). [2025-10-31T17:41:56.085916] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-31T17:41:56.262440] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-31T17:41:56.516256] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-31T17:41:56.516358] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-31T17:41:56.516558] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-31T17:41:56.516601] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-31T17:41:56.517049] [DEBUG] [LOCAL ] BRT: Trimmed 7119 records to 5279 (keeping 200 days of data) [2025-10-31T17:41:56.554928] [DEBUG] [LOCAL ] BRT: Primary data saved (5279 records). [2025-10-31T17:41:56.555073] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-31T17:41:56.555153] [INFO ] [MAIN ] Update Progress: 340/2365 symbols completed. BRT took 24.7s. Estimated remaining: 4h 9m 22s. Rate: 8.1 symbols/min [2025-10-31T17:41:56.740927] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:41:56.779195] [DEBUG] [LOCAL ] BSBR: Loaded 35785 existing records from primary storage. [2025-10-31T17:41:56.779551] [INFO ] [MAIN ] BSBR: Loaded 35785 existing records. [2025-10-31T17:41:57.041214] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:41:57.041497] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-31T17:41:57.041547] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-31T17:41:57.041930] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-31T17:41:57.041988] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-31T17:41:57.068887] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-31T17:41:57.523516] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:41:57.584294] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T17:41:57.755190] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-31T17:41:57.857607] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-31T17:41:58.657664] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-31T17:41:58.899916] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T17:41:59.457612] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-31T17:41:59.534324] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T17:42:00.257713] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-31T17:42:00.469344] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:42:01.057704] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-31T17:42:01.381638] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T17:42:01.857668] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-31T17:42:01.920825] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-31T17:42:02.657692] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-31T17:42:02.908634] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T17:42:03.457684] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-31T17:42:04.019109] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T17:42:04.257731] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-31T17:42:04.333686] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T17:42:05.057690] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-31T17:42:05.622668] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T17:42:05.857697] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-31T17:42:05.902398] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-31T17:42:06.657683] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-31T17:42:06.758534] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T17:42:07.457697] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-31T17:42:07.835963] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T17:42:08.257675] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-31T17:42:08.311210] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-31T17:42:09.057679] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-31T17:42:09.273768] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T17:42:09.857696] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-31T17:42:10.137672] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T17:42:10.657624] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-31T17:42:10.716514] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-31T17:42:11.457732] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-31T17:42:11.842529] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T17:42:12.257716] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-31T17:42:12.481102] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-31T17:42:12.489597] [INFO ] [REMOTE ] BRW: Full fetch complete (29818 records). [2025-10-31T17:42:12.489797] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-31T17:42:12.867414] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-31T17:42:12.867492] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-31T17:42:12.867998] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-31T17:42:12.868059] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-31T17:42:12.868767] [DEBUG] [LOCAL ] BRW: Trimmed 29818 records to 21124 (keeping 200 days of data) [2025-10-31T17:42:12.990260] [DEBUG] [LOCAL ] BRW: Primary data saved (21124 records). [2025-10-31T17:42:12.990379] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-31T17:42:12.990455] [INFO ] [MAIN ] Update Progress: 341/2365 symbols completed. BRW took 39.5s. Estimated remaining: 4h 10m 9s. Rate: 8.1 symbols/min [2025-10-31T17:42:13.064286] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-31T17:42:13.163444] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:42:13.173335] [DEBUG] [LOCAL ] BSL: Loaded 8036 existing records from primary storage. [2025-10-31T17:42:13.173536] [INFO ] [MAIN ] BSL: Loaded 8036 existing records. [2025-10-31T17:42:13.370843] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:42:13.373661] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-31T17:42:13.374141] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-31T17:42:13.375129] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T17:42:13.382414] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-31T17:42:13.382581] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-31T17:42:13.728525] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:42:13.857667] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-31T17:42:14.268020] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T17:42:14.657672] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-31T17:42:14.837505] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T17:42:15.457709] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-31T17:42:15.901563] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T17:42:15.946548] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-31T17:42:16.257702] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-31T17:42:17.057738] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-31T17:42:17.454712] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-31T17:42:17.461853] [INFO ] [REMOTE ] BSAC: Full fetch complete (45701 records). [2025-10-31T17:42:17.461989] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-31T17:42:17.834562] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-31T17:42:17.834627] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-31T17:42:17.835275] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-31T17:42:17.835338] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-31T17:42:17.836472] [DEBUG] [LOCAL ] BSAC: Trimmed 45701 records to 32655 (keeping 200 days of data) [2025-10-31T17:42:17.886491] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-31T17:42:18.029919] [DEBUG] [LOCAL ] BSAC: Primary data saved (32655 records). [2025-10-31T17:42:18.030153] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-31T17:42:18.030277] [INFO ] [MAIN ] Update Progress: 342/2365 symbols completed. BSAC took 24.0s. Estimated remaining: 4h 9m 47s. Rate: 8.1 symbols/min [2025-10-31T17:42:18.169929] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T17:42:18.246046] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:42:18.282805] [DEBUG] [LOCAL ] BSM: Loaded 31939 existing records from primary storage. [2025-10-31T17:42:18.283094] [INFO ] [MAIN ] BSM: Loaded 31939 existing records. [2025-10-31T17:42:18.498707] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:42:18.499283] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-31T17:42:18.499364] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-31T17:42:18.508364] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-31T17:42:18.508449] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-31T17:42:18.508783] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-31T17:42:18.662813] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-31T17:42:18.898099] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:42:19.457673] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-31T17:42:19.685699] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-31T17:42:20.257619] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-31T17:42:20.448905] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T17:42:21.057696] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-31T17:42:21.326497] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T17:42:21.610977] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T17:42:21.857692] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-31T17:42:22.657705] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-31T17:42:22.921113] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T17:42:23.457703] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-31T17:42:24.106341] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T17:42:24.118328] [INFO ] [REMOTE ] BRX: Full fetch complete (75190 records). [2025-10-31T17:42:24.118462] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-31T17:42:24.264487] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-31T17:42:24.529525] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-31T17:42:24.529763] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-31T17:42:24.530588] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-31T17:42:24.537757] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-31T17:42:24.551762] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T17:42:24.560900] [DEBUG] [LOCAL ] BRX: Trimmed 75190 records to 52585 (keeping 200 days of data) [2025-10-31T17:42:24.865541] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-31T17:42:24.882364] [DEBUG] [LOCAL ] BRX: Primary data saved (52585 records). [2025-10-31T17:42:24.882504] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-31T17:42:24.883193] [INFO ] [MAIN ] Update Progress: 343/2365 symbols completed. BRX took 33.3s. Estimated remaining: 4h 9m 37s. Rate: 8.1 symbols/min [2025-10-31T17:42:25.055386] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:42:25.057735] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-31T17:42:25.075228] [DEBUG] [LOCAL ] BST: Loaded 18060 existing records from primary storage. [2025-10-31T17:42:25.075455] [INFO ] [MAIN ] BST: Loaded 18060 existing records. [2025-10-31T17:42:25.248146] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:42:25.248379] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-31T17:42:25.248425] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-31T17:42:25.248685] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-31T17:42:25.248741] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-31T17:42:25.532017] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-31T17:42:25.604455] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:42:25.857664] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-31T17:42:26.432109] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-31T17:42:26.657684] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-31T17:42:27.164423] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-31T17:42:27.457626] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-31T17:42:28.257697] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-31T17:42:28.392973] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-31T17:42:29.057687] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-31T17:42:29.196699] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T17:42:29.416392] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-31T17:42:29.857689] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-31T17:42:30.657689] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-31T17:42:31.086100] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T17:42:31.094258] [INFO ] [REMOTE ] BSBR: Full fetch complete (50762 records). [2025-10-31T17:42:31.094417] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-31T17:42:31.468455] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-31T17:42:31.528310] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T17:42:31.527728] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-31T17:42:31.533341] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-31T17:42:31.534174] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-31T17:42:31.534247] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-31T17:42:31.535418] [DEBUG] [LOCAL ] BSBR: Trimmed 50762 records to 36001 (keeping 200 days of data) [2025-10-31T17:42:31.743534] [DEBUG] [LOCAL ] BSBR: Primary data saved (36001 records). [2025-10-31T17:42:31.743701] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-31T17:42:31.743791] [INFO ] [MAIN ] Update Progress: 344/2365 symbols completed. BSBR took 35.2s. Estimated remaining: 4h 9m 26s. Rate: 8.1 symbols/min [2025-10-31T17:42:31.949960] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:42:31.977004] [DEBUG] [LOCAL ] BSTZ: Loaded 24281 existing records from primary storage. [2025-10-31T17:42:31.977293] [INFO ] [MAIN ] BSTZ: Loaded 24281 existing records. [2025-10-31T17:42:32.158596] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-31T17:42:32.161716] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:42:32.164912] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-31T17:42:32.165274] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-31T17:42:32.165480] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-31T17:42:32.165536] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-31T17:42:32.263188] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-31T17:42:32.511636] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:42:32.930927] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T17:42:32.933754] [INFO ] [REMOTE ] BSL: Full fetch complete (12995 records). [2025-10-31T17:42:32.933919] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-31T17:42:33.071049] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-31T17:42:33.291323] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-31T17:42:33.291397] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-31T17:42:33.291707] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-31T17:42:33.291767] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-31T17:42:33.292221] [DEBUG] [LOCAL ] BSL: Trimmed 12995 records to 8059 (keeping 200 days of data) [2025-10-31T17:42:33.340188] [DEBUG] [LOCAL ] BSL: Primary data saved (8059 records). [2025-10-31T17:42:33.340317] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-31T17:42:33.340391] [INFO ] [MAIN ] Update Progress: 345/2365 symbols completed. BSL took 20.3s. Estimated remaining: 4h 8m 45s. Rate: 8.1 symbols/min [2025-10-31T17:42:33.522245] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:42:33.582537] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-31T17:42:33.582981] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-10-31T17:42:33.777806] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:42:33.778116] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-31T17:42:33.778177] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-31T17:42:33.778686] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-31T17:42:33.778791] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-31T17:42:33.862887] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-31T17:42:34.149136] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:42:34.170841] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T17:42:34.657672] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-31T17:42:34.716792] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-31T17:42:35.457720] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-31T17:42:35.588620] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-31T17:42:36.257728] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-31T17:42:36.862690] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T17:42:37.057680] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-31T17:42:37.226537] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T17:42:37.857687] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-31T17:42:37.920766] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-31T17:42:38.534203] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-31T17:42:38.657680] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-31T17:42:39.457685] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-31T17:42:39.541722] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T17:42:40.257707] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-31T17:42:40.417869] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-31T17:42:41.057718] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-31T17:42:41.633945] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-31T17:42:41.739222] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T17:42:41.857675] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-31T17:42:42.545110] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T17:42:42.657682] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-31T17:42:43.373086] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T17:42:43.457704] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-31T17:42:44.194251] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-31T17:42:44.257742] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-31T17:42:45.062859] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-31T17:42:45.077301] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-31T17:42:45.857672] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-31T17:42:46.463847] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-31T17:42:46.574071] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-31T17:42:46.657618] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-31T17:42:47.457667] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-31T17:42:48.235456] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T17:42:48.257636] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-31T17:42:48.406948] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T17:42:49.057684] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-31T17:42:49.705591] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T17:42:49.857627] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-31T17:42:49.886930] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T17:42:50.657675] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-31T17:42:51.194855] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T17:42:51.457682] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-31T17:42:51.557681] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-31T17:42:52.257624] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-31T17:42:52.382286] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-31T17:42:53.057693] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-31T17:42:53.654232] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T17:42:53.857628] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-31T17:42:54.071044] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-31T17:42:54.657680] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-31T17:42:55.356985] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T17:42:55.457614] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-31T17:42:55.616752] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T17:42:56.257717] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-31T17:42:57.055013] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T17:42:57.060682] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-31T17:42:57.857618] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-31T17:42:57.872981] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-31T17:42:57.929590] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T17:42:57.933860] [INFO ] [REMOTE ] BST: Full fetch complete (28220 records). [2025-10-31T17:42:57.933937] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-31T17:42:58.307073] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-31T17:42:58.307158] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-31T17:42:58.307696] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-31T17:42:58.307759] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-31T17:42:58.308479] [DEBUG] [LOCAL ] BST: Trimmed 28220 records to 18214 (keeping 200 days of data) [2025-10-31T17:42:58.418177] [DEBUG] [LOCAL ] BST: Primary data saved (18214 records). [2025-10-31T17:42:58.418321] [INFO ] [MAIN ] BST: Full history saved. [2025-10-31T17:42:58.418400] [INFO ] [MAIN ] Update Progress: 346/2365 symbols completed. BST took 33.5s. Estimated remaining: 4h 10m 20s. Rate: 8.1 symbols/min [2025-10-31T17:42:58.606905] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:42:58.625226] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T17:42:58.634336] [DEBUG] [LOCAL ] BTA: Loaded 5613 existing records from primary storage. [2025-10-31T17:42:58.634526] [INFO ] [MAIN ] BTA: Loaded 5613 existing records. [2025-10-31T17:42:58.662758] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-31T17:42:58.812577] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:42:58.812822] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-31T17:42:58.812869] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-31T17:42:58.813007] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-31T17:42:58.813046] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-31T17:42:59.161572] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:42:59.332160] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T17:42:59.344548] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-31T17:42:59.344724] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-31T17:42:59.462859] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-31T17:42:59.733582] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-31T17:42:59.733681] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-31T17:42:59.734472] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-31T17:42:59.734514] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-31T17:42:59.735937] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 54468 (keeping 200 days of data) [2025-10-31T17:43:00.046869] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-10-31T17:43:00.046994] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-31T17:43:00.047068] [INFO ] [MAIN ] Update Progress: 347/2365 symbols completed. BSX took 26.7s. Estimated remaining: 4h 9m 39s. Rate: 8.1 symbols/min [2025-10-31T17:43:00.212935] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:00.257670] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-31T17:43:00.258772] [DEBUG] [LOCAL ] BTE: Loaded 53042 existing records from primary storage. [2025-10-31T17:43:00.259787] [INFO ] [MAIN ] BTE: Loaded 53042 existing records. [2025-10-31T17:43:00.437086] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:43:00.437305] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-31T17:43:00.437354] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-31T17:43:00.437924] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-31T17:43:00.437983] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-31T17:43:00.820831] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:00.845841] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-31T17:43:00.854793] [INFO ] [REMOTE ] BSM: Full fetch complete (46383 records). [2025-10-31T17:43:00.855044] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-31T17:43:01.062269] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-31T17:43:01.194086] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T17:43:01.307451] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-31T17:43:01.307545] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-31T17:43:01.308313] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-31T17:43:01.308406] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-31T17:43:01.309672] [DEBUG] [LOCAL ] BSM: Trimmed 46383 records to 32110 (keeping 200 days of data) [2025-10-31T17:43:01.502734] [DEBUG] [LOCAL ] BSM: Primary data saved (32110 records). [2025-10-31T17:43:01.502873] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-31T17:43:01.502953] [INFO ] [MAIN ] Update Progress: 348/2365 symbols completed. BSM took 43.5s. Estimated remaining: 4h 8m 57s. Rate: 8.1 symbols/min [2025-10-31T17:43:01.671586] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:01.728610] [DEBUG] [LOCAL ] BTI: Loaded 53973 existing records from primary storage. [2025-10-31T17:43:01.729037] [INFO ] [MAIN ] BTI: Loaded 53973 existing records. [2025-10-31T17:43:01.862740] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-31T17:43:01.881925] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:43:01.942414] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:43:01.942620] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-31T17:43:01.942702] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-31T17:43:01.943064] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-31T17:43:01.943138] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-31T17:43:02.315024] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:02.657692] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-31T17:43:02.986748] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T17:43:02.993699] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36037 records). [2025-10-31T17:43:02.993877] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-31T17:43:03.367678] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-31T17:43:03.367764] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-31T17:43:03.368313] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-31T17:43:03.368379] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-31T17:43:03.369214] [DEBUG] [LOCAL ] BSTZ: Trimmed 36037 records to 24457 (keeping 200 days of data) [2025-10-31T17:43:03.437082] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-31T17:43:03.462752] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-31T17:43:03.526461] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24457 records). [2025-10-31T17:43:03.526590] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-31T17:43:03.526686] [INFO ] [MAIN ] Update Progress: 349/2365 symbols completed. BSTZ took 31.8s. Estimated remaining: 4h 8m 19s. Rate: 8.1 symbols/min [2025-10-31T17:43:03.695807] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:03.705470] [DEBUG] [LOCAL ] BTO: Loaded 8649 existing records from primary storage. [2025-10-31T17:43:03.705636] [INFO ] [MAIN ] BTO: Loaded 8649 existing records. [2025-10-31T17:43:03.879498] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:43:03.879740] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-31T17:43:03.879791] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-31T17:43:03.879932] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-31T17:43:03.879969] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-31T17:43:04.232739] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:04.257609] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-31T17:43:04.954157] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T17:43:04.994104] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-31T17:43:05.057674] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-31T17:43:05.567357] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-31T17:43:05.857667] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-31T17:43:06.223046] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-31T17:43:06.657732] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-31T17:43:07.196935] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-31T17:43:07.457695] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-31T17:43:08.257722] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-31T17:43:08.672763] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-31T17:43:08.803285] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-31T17:43:09.057715] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-31T17:43:09.480911] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-31T17:43:09.857719] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-31T17:43:10.657718] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-31T17:43:11.168846] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T17:43:11.186219] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T17:43:11.457677] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-31T17:43:12.257710] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-31T17:43:12.570951] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:43:12.604592] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-31T17:43:13.057680] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-31T17:43:13.607031] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-31T17:43:13.857683] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-31T17:43:14.355780] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-31T17:43:14.657722] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-31T17:43:15.457724] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-31T17:43:16.256372] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-31T17:43:16.266587] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-31T17:43:16.713461] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T17:43:16.791920] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T17:43:17.057749] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-31T17:43:17.655130] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T17:43:17.857718] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-31T17:43:18.657725] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-31T17:43:19.272999] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T17:43:19.457721] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-31T17:43:19.960200] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T17:43:20.070847] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T17:43:20.257696] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-31T17:43:21.057675] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-31T17:43:21.463950] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-31T17:43:21.858402] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-31T17:43:21.863749] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-31T17:43:22.280784] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T17:43:22.657711] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-31T17:43:23.457692] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-31T17:43:23.999737] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-31T17:43:24.068765] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-31T17:43:24.257626] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-31T17:43:24.902035] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T17:43:24.905082] [INFO ] [REMOTE ] BTO: Full fetch complete (13198 records). [2025-10-31T17:43:24.905159] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-31T17:43:25.063036] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-31T17:43:25.295004] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-31T17:43:25.295101] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-31T17:43:25.295518] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-31T17:43:25.295560] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-31T17:43:25.296215] [DEBUG] [LOCAL ] BTO: Trimmed 13198 records to 8698 (keeping 200 days of data) [2025-10-31T17:43:25.358300] [DEBUG] [LOCAL ] BTO: Primary data saved (8698 records). [2025-10-31T17:43:25.358435] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-31T17:43:25.358514] [INFO ] [MAIN ] Update Progress: 350/2365 symbols completed. BTO took 21.8s. Estimated remaining: 4h 9m 34s. Rate: 8.1 symbols/min [2025-10-31T17:43:25.559070] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:25.577323] [DEBUG] [LOCAL ] BTT: Loaded 15016 existing records from primary storage. [2025-10-31T17:43:25.577572] [INFO ] [MAIN ] BTT: Loaded 15016 existing records. [2025-10-31T17:43:25.752806] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:43:25.753073] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-31T17:43:25.753120] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-31T17:43:25.753329] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-31T17:43:25.753386] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-31T17:43:25.834966] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-31T17:43:25.865443] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-31T17:43:25.877426] [INFO ] [REMOTE ] BTA: Full fetch complete (8789 records). [2025-10-31T17:43:25.906782] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-31T17:43:26.405440] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:26.508162] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-31T17:43:26.508251] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-31T17:43:26.508431] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-31T17:43:26.508470] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-31T17:43:26.508968] [DEBUG] [LOCAL ] BTA: Trimmed 8789 records to 5637 (keeping 200 days of data) [2025-10-31T17:43:26.542080] [DEBUG] [LOCAL ] BTA: Primary data saved (5637 records). [2025-10-31T17:43:26.542216] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-31T17:43:26.542298] [INFO ] [MAIN ] Update Progress: 351/2365 symbols completed. BTA took 28.1s. Estimated remaining: 4h 8m 51s. Rate: 8.1 symbols/min [2025-10-31T17:43:26.662832] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-31T17:43:26.711109] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:26.762697] [DEBUG] [LOCAL ] BTU: Loaded 53707 existing records from primary storage. [2025-10-31T17:43:26.763053] [INFO ] [MAIN ] BTU: Loaded 53707 existing records. [2025-10-31T17:43:26.934540] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:43:26.934747] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-31T17:43:26.934798] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-31T17:43:26.935087] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-31T17:43:26.935143] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-31T17:43:27.277033] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:27.407500] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-31T17:43:27.457639] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-31T17:43:28.248710] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T17:43:28.259395] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-31T17:43:28.725469] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T17:43:29.057712] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-31T17:43:29.756111] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T17:43:29.857691] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-31T17:43:30.501217] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-31T17:43:30.614121] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-31T17:43:30.657611] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-31T17:43:31.457683] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-31T17:43:32.257727] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-31T17:43:32.336331] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-31T17:43:32.710058] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T17:43:32.846372] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T17:43:33.057687] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-31T17:43:33.857630] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-31T17:43:34.455458] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T17:43:34.526590] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-31T17:43:34.657696] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-31T17:43:35.457721] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-31T17:43:36.030445] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T17:43:36.159151] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T17:43:36.257684] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-31T17:43:37.057699] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-31T17:43:37.756455] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T17:43:37.777553] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-31T17:43:37.857728] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-31T17:43:38.657677] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-31T17:43:39.457687] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-31T17:43:39.530615] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-31T17:43:39.911284] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T17:43:40.055040] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-31T17:43:40.257702] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-31T17:43:41.057685] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-31T17:43:41.857735] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-31T17:43:42.020048] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-31T17:43:42.032219] [INFO ] [REMOTE ] BTI: Full fetch complete (77660 records). [2025-10-31T17:43:42.032379] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-31T17:43:42.430813] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-31T17:43:42.430893] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-31T17:43:42.431700] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-31T17:43:42.431855] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-31T17:43:42.433325] [DEBUG] [LOCAL ] BTI: Trimmed 77660 records to 54363 (keeping 200 days of data) [2025-10-31T17:43:42.578879] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T17:43:42.593453] [INFO ] [REMOTE ] BTE: Full fetch complete (76353 records). [2025-10-31T17:43:42.594312] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-31T17:43:42.660630] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-31T17:43:43.207126] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-31T17:43:43.208956] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-31T17:43:43.217724] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-31T17:43:43.220477] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-31T17:43:43.235285] [DEBUG] [LOCAL ] BTI: Primary data saved (54363 records). [2025-10-31T17:43:43.235638] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-31T17:43:43.236720] [INFO ] [MAIN ] Update Progress: 352/2365 symbols completed. BTI took 41.7s. Estimated remaining: 4h 9m 37s. Rate: 8.1 symbols/min [2025-10-31T17:43:43.308175] [DEBUG] [LOCAL ] BTE: Trimmed 76353 records to 53417 (keeping 200 days of data) [2025-10-31T17:43:43.532957] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:43.540552] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T17:43:43.546831] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-31T17:43:43.547039] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-31T17:43:43.556415] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-31T17:43:43.568361] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-31T17:43:43.619461] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-31T17:43:43.671806] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-31T17:43:43.677097] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-31T17:43:43.679607] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-31T17:43:44.066976] [DEBUG] [LOCAL ] BTE: Primary data saved (53417 records). [2025-10-31T17:43:44.086737] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-31T17:43:44.089029] [INFO ] [MAIN ] Update Progress: 353/2365 symbols completed. BTE took 44.0s. Estimated remaining: 4h 8m 52s. Rate: 8.1 symbols/min [2025-10-31T17:43:44.217849] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:44.262769] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-31T17:43:44.327104] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T17:43:44.358603] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:44.362439] [DEBUG] [LOCAL ] BTZ: No existing data file found in primary storage. [2025-10-31T17:43:44.362818] [WARN ] [MAIN ] BTZ: No existing data found, performing full refresh instead. [2025-10-31T17:43:44.362933] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-31T17:43:44.362975] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-31T17:43:44.363015] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-10-31T17:43:44.363046] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-31T17:43:44.758166] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:45.057694] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-31T17:43:45.678167] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-31T17:43:45.678668] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-31T17:43:45.857671] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-31T17:43:46.657682] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-31T17:43:47.216565] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T17:43:47.446820] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T17:43:47.457611] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-31T17:43:48.257749] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-31T17:43:48.427117] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:43:48.427427] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-31T17:43:48.427517] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:43:48.427589] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-31T17:43:48.427690] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:43:48.427772] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-31T17:43:48.427850] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-31T17:43:48.427938] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-31T17:43:48.428010] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-31T17:43:48.428070] [INFO ] [MAIN ] Update Progress: 354/2365 symbols completed. BTX took 5.2s. Estimated remaining: 4h 8m 27s. Rate: 8.1 symbols/min [2025-10-31T17:43:48.608357] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:48.663770] [DEBUG] [LOCAL ] BUD: Loaded 52966 existing records from primary storage. [2025-10-31T17:43:48.664066] [INFO ] [MAIN ] BUD: Loaded 52966 existing records. [2025-10-31T17:43:48.844427] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:43:48.844661] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-31T17:43:48.844775] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-31T17:43:48.844963] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-31T17:43:48.845007] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-31T17:43:49.062710] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-31T17:43:49.215146] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:49.244929] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-31T17:43:49.827862] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-31T17:43:49.857616] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-31T17:43:50.567748] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T17:43:50.657695] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-31T17:43:51.307728] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T17:43:51.311930] [INFO ] [REMOTE ] BTT: Full fetch complete (22475 records). [2025-10-31T17:43:51.312092] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-31T17:43:51.465795] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-31T17:43:51.704857] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-31T17:43:51.704969] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-31T17:43:51.705900] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-31T17:43:51.705967] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-31T17:43:51.706896] [DEBUG] [LOCAL ] BTT: Trimmed 22475 records to 15157 (keeping 200 days of data) [2025-10-31T17:43:51.808424] [DEBUG] [LOCAL ] BTT: Primary data saved (15157 records). [2025-10-31T17:43:51.808625] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-31T17:43:51.808966] [INFO ] [MAIN ] Update Progress: 355/2365 symbols completed. BTT took 26.5s. Estimated remaining: 4h 7m 57s. Rate: 8.1 symbols/min [2025-10-31T17:43:51.990164] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:52.002964] [DEBUG] [LOCAL ] BUI: Loaded 11597 existing records from primary storage. [2025-10-31T17:43:52.003234] [INFO ] [MAIN ] BUI: Loaded 11597 existing records. [2025-10-31T17:43:52.175621] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:43:52.175843] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-31T17:43:52.175892] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-31T17:43:52.176044] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-31T17:43:52.176081] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-31T17:43:52.263501] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-31T17:43:52.524980] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:53.031759] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-31T17:43:53.057624] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-31T17:43:53.834532] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-31T17:43:53.857610] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-31T17:43:54.418120] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-31T17:43:54.657638] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-31T17:43:54.888078] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-31T17:43:55.203489] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-31T17:43:55.457713] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-31T17:43:55.993476] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T17:43:56.257697] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-31T17:43:57.057693] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-31T17:43:57.857678] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-31T17:43:58.095962] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-31T17:43:58.108404] [INFO ] [REMOTE ] BTU: Full fetch complete (77310 records). [2025-10-31T17:43:58.108558] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-31T17:43:58.434530] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-31T17:43:58.526724] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-31T17:43:58.526936] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-31T17:43:58.527777] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-31T17:43:58.527854] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-31T17:43:58.529521] [DEBUG] [LOCAL ] BTU: Trimmed 77310 records to 54096 (keeping 200 days of data) [2025-10-31T17:43:58.667386] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-31T17:43:58.775206] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-31T17:43:58.900249] [DEBUG] [LOCAL ] BTU: Primary data saved (54096 records). [2025-10-31T17:43:58.900388] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-31T17:43:58.900464] [INFO ] [MAIN ] Update Progress: 356/2365 symbols completed. BTU took 32.4s. Estimated remaining: 4h 7m 48s. Rate: 8.1 symbols/min [2025-10-31T17:43:59.065170] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:43:59.105499] [DEBUG] [LOCAL ] BUR: Loaded 45854 existing records from primary storage. [2025-10-31T17:43:59.105825] [INFO ] [MAIN ] BUR: Loaded 45854 existing records. [2025-10-31T17:43:59.282294] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:43:59.282858] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-31T17:43:59.282914] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-31T17:43:59.283194] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-31T17:43:59.283250] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-31T17:43:59.464671] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-31T17:43:59.640248] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:43:59.655354] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-31T17:44:00.257680] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-31T17:44:00.860776] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-31T17:44:00.883779] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-31T17:44:01.057639] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-31T17:44:01.857677] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-31T17:44:01.930791] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-31T17:44:02.657669] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-31T17:44:03.096165] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-31T17:44:03.457706] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-31T17:44:03.800905] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T17:44:04.090825] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-31T17:44:04.257695] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-31T17:44:05.057717] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-31T17:44:05.403853] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T17:44:05.857629] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-31T17:44:06.006598] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-31T17:44:06.657680] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-31T17:44:07.175690] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-31T17:44:07.457683] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-31T17:44:07.562722] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T17:44:07.568792] [INFO ] [REMOTE ] BTZ: Full fetch complete (33217 records). [2025-10-31T17:44:07.568978] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-31T17:44:07.993332] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-31T17:44:07.993415] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-31T17:44:07.993887] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-31T17:44:07.993951] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-31T17:44:07.994849] [DEBUG] [LOCAL ] BTZ: Trimmed 33217 records to 22174 (keeping 200 days of data) [2025-10-31T17:44:08.124457] [DEBUG] [LOCAL ] BTZ: Primary data saved (22174 records). [2025-10-31T17:44:08.124581] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-31T17:44:08.124668] [INFO ] [MAIN ] Update Progress: 357/2365 symbols completed. BTZ took 24.0s. Estimated remaining: 4h 7m 50s. Rate: 8.1 symbols/min [2025-10-31T17:44:08.257701] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-31T17:44:08.616541] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:44:08.793880] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T17:44:09.057730] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-31T17:44:09.857691] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-31T17:44:10.665797] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-31T17:44:10.693678] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-31T17:44:11.265358] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T17:44:11.302005] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T17:44:11.457639] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-31T17:44:12.005242] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-31T17:44:12.257702] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-31T17:44:13.057722] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-31T17:44:13.338774] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T17:44:13.857674] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-31T17:44:14.285481] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T17:44:14.485463] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T17:44:14.657631] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-31T17:44:15.457739] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-31T17:44:15.785756] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:44:16.046480] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T17:44:16.257717] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-31T17:44:17.057694] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-31T17:44:17.808168] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T17:44:17.857609] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-31T17:44:18.410613] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T17:44:18.657725] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-31T17:44:18.972291] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T17:44:19.457762] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-31T17:44:20.142240] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-31T17:44:20.257629] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-31T17:44:20.381969] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-31T17:44:20.394275] [INFO ] [REMOTE ] BUD: Full fetch complete (76491 records). [2025-10-31T17:44:20.394451] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-31T17:44:20.789442] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-31T17:44:20.789525] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-31T17:44:20.790343] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-31T17:44:20.790410] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-31T17:44:20.791860] [DEBUG] [LOCAL ] BUD: Trimmed 76491 records to 53356 (keeping 200 days of data) [2025-10-31T17:44:21.010266] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T17:44:21.014802] [INFO ] [REMOTE ] BUI: Full fetch complete (16401 records). [2025-10-31T17:44:21.015395] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-31T17:44:21.063829] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-31T17:44:21.484856] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-31T17:44:21.487602] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-31T17:44:21.489310] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-31T17:44:21.489672] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-31T17:44:21.492605] [DEBUG] [LOCAL ] BUI: Trimmed 16401 records to 11667 (keeping 200 days of data) [2025-10-31T17:44:21.561575] [DEBUG] [LOCAL ] BUD: Primary data saved (53356 records). [2025-10-31T17:44:21.568627] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-31T17:44:21.570100] [INFO ] [MAIN ] Update Progress: 358/2365 symbols completed. BUD took 33.1s. Estimated remaining: 4h 8m 17s. Rate: 8.1 symbols/min [2025-10-31T17:44:21.573132] [DEBUG] [LOCAL ] BUI: Primary data saved (11667 records). [2025-10-31T17:44:21.573194] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-31T17:44:21.573255] [INFO ] [MAIN ] Update Progress: 359/2365 symbols completed. BUI took 29.8s. Estimated remaining: 4h 7m 28s. Rate: 8.1 symbols/min [2025-10-31T17:44:22.327192] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T17:44:22.339927] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-31T17:44:23.954476] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-31T17:44:23.965310] [INFO ] [REMOTE ] BUR: Full fetch complete (64948 records). [2025-10-31T17:44:23.965452] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-31T17:44:24.337582] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-31T17:44:24.337698] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-31T17:44:24.338443] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-31T17:44:24.338527] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-31T17:44:24.339894] [DEBUG] [LOCAL ] BUR: Trimmed 64948 records to 46244 (keeping 200 days of data) [2025-10-31T17:44:24.630989] [DEBUG] [LOCAL ] BUR: Primary data saved (46244 records). [2025-10-31T17:44:24.631181] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-31T17:44:24.631283] [INFO ] [MAIN ] Update Progress: 360/2365 symbols completed. BUR took 25.7s. Estimated remaining: 4h 6m 56s. Rate: 8.1 symbols/min [2025-10-31T17:44:25.516585] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:44:25.583638] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:44:25.584596] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:44:25.608177] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:44:25.649778] [DEBUG] [LOCAL ] BUXX: Loaded 15198 existing records from primary storage. [2025-10-31T17:44:25.650220] [INFO ] [MAIN ] BUXX: Loaded 15198 existing records. [2025-10-31T17:44:25.780769] [DEBUG] [LOCAL ] BV: Loaded 38595 existing records from primary storage. [2025-10-31T17:44:25.832559] [INFO ] [MAIN ] BV: Loaded 38595 existing records. [2025-10-31T17:44:25.839426] [DEBUG] [LOCAL ] BURL: Loaded 45323 existing records from primary storage. [2025-10-31T17:44:25.857176] [DEBUG] [LOCAL ] BVN: Loaded 44896 existing records from primary storage. [2025-10-31T17:44:25.856292] [INFO ] [MAIN ] BURL: Loaded 45323 existing records. [2025-10-31T17:44:25.905264] [INFO ] [MAIN ] BVN: Loaded 44896 existing records. [2025-10-31T17:44:26.247258] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:44:26.335245] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-31T17:44:26.501488] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:44:26.482044] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-31T17:44:26.493731] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:44:26.507129] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-31T17:44:26.506993] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-31T17:44:26.532431] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-31T17:44:26.527216] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-31T17:44:26.538752] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-31T17:44:26.547740] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-31T17:44:26.552281] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-31T17:44:26.552364] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-31T17:44:26.576047] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:44:26.576257] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-31T17:44:26.621956] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-31T17:44:26.621865] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-31T17:44:26.632814] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-31T17:44:26.687931] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-31T17:44:26.727506] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-31T17:44:27.893559] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:44:27.944496] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-31T17:44:27.979958] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:44:28.019870] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-31T17:44:28.079760] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:44:28.119487] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:44:28.120118] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-31T17:44:28.121065] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-31T17:44:28.743250] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-31T17:44:28.746162] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-31T17:44:29.068907] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T17:44:29.075161] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-31T17:44:29.308119] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T17:44:29.316089] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-31T17:44:29.338243] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T17:44:29.341105] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-31T17:44:29.749402] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-31T17:44:29.757590] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-31T17:44:29.871067] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T17:44:29.874623] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-31T17:44:30.088696] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:44:30.311066] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T17:44:30.467935] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-31T17:44:30.657712] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-31T17:44:30.793414] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T17:44:31.407317] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-31T17:44:31.457624] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-31T17:44:32.257684] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-31T17:44:32.752783] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:44:32.920273] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-31T17:44:33.057696] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-31T17:44:33.857680] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-31T17:44:34.320081] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T17:44:34.597373] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T17:44:34.657616] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-31T17:44:35.233538] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-31T17:44:35.457760] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-31T17:44:36.257695] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-31T17:44:36.676316] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:44:37.057674] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-31T17:44:37.632129] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T17:44:37.857745] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-31T17:44:38.279768] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T17:44:38.657682] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-31T17:44:38.918182] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-31T17:44:39.457684] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-31T17:44:40.026577] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T17:44:40.257669] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-31T17:44:40.634672] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T17:44:40.969597] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T17:44:41.057671] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-31T17:44:41.857669] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-31T17:44:42.265616] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T17:44:42.657736] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-31T17:44:43.050161] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T17:44:43.457684] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-31T17:44:43.975442] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-31T17:44:44.257639] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-31T17:44:44.541345] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T17:44:44.972818] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T17:44:44.977528] [INFO ] [REMOTE ] BUXX: Full fetch complete (20871 records). [2025-10-31T17:44:44.977809] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-31T17:44:45.062879] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-31T17:44:45.396845] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-31T17:44:45.396926] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-31T17:44:45.397319] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-31T17:44:45.397360] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-31T17:44:45.398010] [DEBUG] [LOCAL ] BUXX: Trimmed 20871 records to 15309 (keeping 200 days of data) [2025-10-31T17:44:45.492250] [DEBUG] [LOCAL ] BUXX: Primary data saved (15309 records). [2025-10-31T17:44:45.492391] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-31T17:44:45.492470] [INFO ] [MAIN ] Update Progress: 361/2365 symbols completed. BUXX took 20.9s. Estimated remaining: 4h 8m 4s. Rate: 8.1 symbols/min [2025-10-31T17:44:45.679630] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:44:45.718324] [DEBUG] [LOCAL ] BW: Loaded 40744 existing records from primary storage. [2025-10-31T17:44:45.718637] [INFO ] [MAIN ] BW: Loaded 40744 existing records. [2025-10-31T17:44:45.862796] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-31T17:44:45.902526] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:44:45.902884] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-31T17:44:45.902934] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-31T17:44:45.903244] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-31T17:44:45.903300] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-31T17:44:46.279115] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:44:46.308181] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T17:44:46.657687] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-31T17:44:46.725949] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-31T17:44:47.457686] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-31T17:44:48.074213] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T17:44:48.085540] [INFO ] [REMOTE ] BVN: Full fetch complete (63946 records). [2025-10-31T17:44:48.085733] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-31T17:44:48.259507] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-31T17:44:48.491801] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-31T17:44:48.491875] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-31T17:44:48.492563] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-31T17:44:48.492604] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-31T17:44:48.493884] [DEBUG] [LOCAL ] BVN: Trimmed 63946 records to 45248 (keeping 200 days of data) [2025-10-31T17:44:48.713865] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-31T17:44:48.784506] [DEBUG] [LOCAL ] BVN: Primary data saved (45248 records). [2025-10-31T17:44:48.784629] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-31T17:44:48.784745] [INFO ] [MAIN ] Update Progress: 362/2365 symbols completed. BVN took 24.1s. Estimated remaining: 4h 7m 33s. Rate: 8.1 symbols/min [2025-10-31T17:44:48.954627] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:44:49.001054] [DEBUG] [LOCAL ] BWA: Loaded 52386 existing records from primary storage. [2025-10-31T17:44:49.001458] [INFO ] [MAIN ] BWA: Loaded 52386 existing records. [2025-10-31T17:44:49.065026] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-31T17:44:49.184288] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:44:49.184492] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-31T17:44:49.184539] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-31T17:44:49.184873] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-31T17:44:49.184932] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-31T17:44:49.553520] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:44:49.583565] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T17:44:49.857695] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-31T17:44:50.420130] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T17:44:50.657685] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-31T17:44:50.875186] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T17:44:51.457712] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-31T17:44:51.831952] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T17:44:52.257667] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-31T17:44:52.506446] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T17:44:53.057673] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-31T17:44:53.739251] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T17:44:53.857673] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-31T17:44:54.161616] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T17:44:54.657681] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-31T17:44:55.016907] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T17:44:55.457663] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-31T17:44:55.978302] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:44:56.257669] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-31T17:44:56.824053] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T17:44:57.057715] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-31T17:44:57.648920] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T17:44:57.659501] [INFO ] [REMOTE ] BURL: Full fetch complete (65670 records). [2025-10-31T17:44:57.659765] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-31T17:44:57.862781] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-31T17:44:58.078329] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-31T17:44:58.078432] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-31T17:44:58.079317] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-31T17:44:58.079388] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-31T17:44:58.081308] [DEBUG] [LOCAL ] BURL: Trimmed 65670 records to 45657 (keeping 200 days of data) [2025-10-31T17:44:58.404019] [DEBUG] [LOCAL ] BURL: Primary data saved (45657 records). [2025-10-31T17:44:58.404368] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-31T17:44:58.404687] [INFO ] [MAIN ] Update Progress: 363/2365 symbols completed. BURL took 33.8s. Estimated remaining: 4h 7m 38s. Rate: 8.1 symbols/min [2025-10-31T17:44:58.574902] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-31T17:44:58.662535] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-31T17:44:58.665388] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:44:58.679325] [DEBUG] [LOCAL ] BWG: Loaded 12394 existing records from primary storage. [2025-10-31T17:44:58.679635] [INFO ] [MAIN ] BWG: Loaded 12394 existing records. [2025-10-31T17:44:58.869349] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:44:58.869705] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-31T17:44:58.869768] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-31T17:44:58.870009] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-31T17:44:58.870052] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-31T17:44:59.339419] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:44:59.345082] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-31T17:44:59.457687] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-31T17:44:59.510166] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-31T17:45:00.180287] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T17:45:00.257722] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-31T17:45:00.792072] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T17:45:01.057632] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-31T17:45:01.857697] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-31T17:45:02.449944] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T17:45:02.459233] [INFO ] [REMOTE ] BV: Full fetch complete (55363 records). [2025-10-31T17:45:02.459361] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-31T17:45:02.665037] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-31T17:45:02.837769] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-31T17:45:02.837854] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-31T17:45:02.838570] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-31T17:45:02.838629] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-31T17:45:02.839815] [DEBUG] [LOCAL ] BV: Trimmed 55363 records to 38890 (keeping 200 days of data) [2025-10-31T17:45:03.066368] [DEBUG] [LOCAL ] BV: Primary data saved (38890 records). [2025-10-31T17:45:03.066492] [INFO ] [MAIN ] BV: Full history saved. [2025-10-31T17:45:03.066567] [INFO ] [MAIN ] Update Progress: 364/2365 symbols completed. BV took 38.4s. Estimated remaining: 4h 7m 16s. Rate: 8.1 symbols/min [2025-10-31T17:45:03.237493] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:45:03.237820] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-10-31T17:45:03.238017] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-10-31T17:45:03.238164] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-31T17:45:03.238238] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-31T17:45:03.238317] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-31T17:45:03.238368] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-31T17:45:03.446792] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-31T17:45:03.470695] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-31T17:45:03.687820] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:45:04.090615] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T17:45:04.257624] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-31T17:45:04.295839] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-31T17:45:05.057668] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-31T17:45:05.376337] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:45:05.599141] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T17:45:05.857665] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-31T17:45:06.657697] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-31T17:45:06.984848] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-31T17:45:07.457671] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-31T17:45:08.033839] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-31T17:45:08.089117] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T17:45:08.257692] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-31T17:45:09.057674] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-31T17:45:09.485535] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T17:45:09.587502] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T17:45:09.857717] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-31T17:45:10.620301] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T17:45:10.657607] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-31T17:45:11.457704] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-31T17:45:12.024093] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T17:45:12.045790] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T17:45:12.257678] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-31T17:45:13.057680] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-31T17:45:13.612267] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T17:45:13.729124] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T17:45:13.857667] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-31T17:45:14.657669] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-31T17:45:15.457927] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-31T17:45:15.457811] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-31T17:45:15.920592] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T17:45:16.257697] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-31T17:45:16.717734] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T17:45:17.057680] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-31T17:45:17.719410] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T17:45:17.730245] [INFO ] [REMOTE ] BW: Full fetch complete (59360 records). [2025-10-31T17:45:17.730389] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-31T17:45:17.868574] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-31T17:45:18.109408] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-31T17:45:18.109485] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-31T17:45:18.110161] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-31T17:45:18.110223] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-31T17:45:18.111391] [DEBUG] [LOCAL ] BW: Trimmed 59360 records to 41078 (keeping 200 days of data) [2025-10-31T17:45:18.334688] [DEBUG] [LOCAL ] BW: Primary data saved (41078 records). [2025-10-31T17:45:18.334850] [INFO ] [MAIN ] BW: Full history saved. [2025-10-31T17:45:18.335686] [INFO ] [MAIN ] Update Progress: 365/2365 symbols completed. BW took 32.8s. Estimated remaining: 4h 7m 51s. Rate: 8.1 symbols/min [2025-10-31T17:45:18.508690] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:45:18.546671] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-31T17:45:18.561579] [DEBUG] [LOCAL ] BWMX: Loaded 8131 existing records from primary storage. [2025-10-31T17:45:18.561879] [INFO ] [MAIN ] BWMX: Loaded 8131 existing records. [2025-10-31T17:45:18.665481] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-31T17:45:18.739464] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T17:45:18.784760] [INFO ] [REMOTE ] BWG: Full fetch complete (17378 records). [2025-10-31T17:45:18.785010] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-31T17:45:18.784592] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:45:18.785335] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-31T17:45:18.785478] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-31T17:45:18.823217] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-31T17:45:18.857673] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-31T17:45:19.480580] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-31T17:45:19.461217] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-31T17:45:19.495632] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-31T17:45:19.496075] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-31T17:45:19.497010] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-31T17:45:19.539731] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:45:19.540563] [DEBUG] [LOCAL ] BWG: Trimmed 17378 records to 12491 (keeping 200 days of data) [2025-10-31T17:45:19.612880] [DEBUG] [LOCAL ] BWG: Primary data saved (12491 records). [2025-10-31T17:45:19.613034] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-31T17:45:19.613133] [INFO ] [MAIN ] Update Progress: 366/2365 symbols completed. BWG took 21.2s. Estimated remaining: 4h 7m 10s. Rate: 8.1 symbols/min [2025-10-31T17:45:19.785239] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:45:19.791513] [DEBUG] [LOCAL ] BWNB: Loaded 4023 existing records from primary storage. [2025-10-31T17:45:19.791745] [INFO ] [MAIN ] BWNB: Loaded 4023 existing records. [2025-10-31T17:45:19.966522] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:45:19.966742] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-31T17:45:19.966795] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-31T17:45:19.966946] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-31T17:45:19.967003] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-31T17:45:20.262540] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-31T17:45:20.331062] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:45:20.399917] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-31T17:45:20.413069] [INFO ] [REMOTE ] BWA: Full fetch complete (75856 records). [2025-10-31T17:45:20.413262] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-31T17:45:20.559343] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T17:45:20.841235] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-31T17:45:20.845724] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-31T17:45:20.847134] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-31T17:45:20.847447] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-31T17:45:20.847369] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-31T17:45:20.850702] [DEBUG] [LOCAL ] BWA: Trimmed 75856 records to 52776 (keeping 200 days of data) [2025-10-31T17:45:21.065808] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-31T17:45:21.164765] [DEBUG] [LOCAL ] BWA: Primary data saved (52776 records). [2025-10-31T17:45:21.164901] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-31T17:45:21.164977] [INFO ] [MAIN ] Update Progress: 367/2365 symbols completed. BWA took 32.4s. Estimated remaining: 4h 6m 31s. Rate: 8.1 symbols/min [2025-10-31T17:45:21.333062] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:45:21.340077] [DEBUG] [LOCAL ] BWSN: Loaded 5056 existing records from primary storage. [2025-10-31T17:45:21.340286] [INFO ] [MAIN ] BWSN: Loaded 5056 existing records. [2025-10-31T17:45:21.526460] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-31T17:45:21.530381] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:45:21.532016] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-31T17:45:21.532125] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-31T17:45:21.532283] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-31T17:45:21.532324] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-31T17:45:21.862809] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-31T17:45:21.943425] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:45:22.657679] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-31T17:45:23.020406] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T17:45:23.166412] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:45:23.457671] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-31T17:45:23.838425] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-31T17:45:24.257685] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-31T17:45:24.703396] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-31T17:45:25.057633] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-31T17:45:25.459066] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-31T17:45:25.857710] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-31T17:45:26.232361] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-31T17:45:26.657740] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-31T17:45:26.947793] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-31T17:45:27.457725] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-31T17:45:27.887394] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-31T17:45:28.257624] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-31T17:45:28.648433] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-31T17:45:29.057699] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-31T17:45:29.434359] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-31T17:45:29.857714] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-31T17:45:30.373403] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T17:45:30.657694] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-31T17:45:31.144338] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T17:45:31.457683] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-31T17:45:31.995514] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T17:45:32.257673] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-31T17:45:33.057736] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-31T17:45:33.294669] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T17:45:33.581336] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T17:45:33.857770] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-31T17:45:34.381985] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T17:45:34.657722] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-31T17:45:35.128767] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-31T17:45:35.457728] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-31T17:45:35.999959] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T17:45:36.257682] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-31T17:45:36.554142] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-31T17:45:37.057631] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-31T17:45:37.520448] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-31T17:45:37.857669] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-31T17:45:38.319331] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-31T17:45:38.657679] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-31T17:45:39.252874] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T17:45:39.457685] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-31T17:45:40.257681] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-31T17:45:40.506413] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T17:45:40.775789] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-31T17:45:41.057686] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-31T17:45:41.528301] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T17:45:41.857669] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-31T17:45:42.657616] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-31T17:45:42.790752] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-31T17:45:42.984986] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-31T17:45:43.457630] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-31T17:45:44.257687] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-31T17:45:44.499085] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T17:45:44.755800] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T17:45:45.057683] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-31T17:45:45.801679] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-31T17:45:45.803926] [INFO ] [REMOTE ] BWMX: Full fetch complete (10165 records). [2025-10-31T17:45:45.803997] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-31T17:45:45.862943] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-31T17:45:46.155288] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-31T17:45:46.155365] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-31T17:45:46.155600] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-31T17:45:46.155638] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-31T17:45:46.156101] [DEBUG] [LOCAL ] BWMX: Trimmed 10165 records to 8178 (keeping 200 days of data) [2025-10-31T17:45:46.203308] [DEBUG] [LOCAL ] BWMX: Primary data saved (8178 records). [2025-10-31T17:45:46.203425] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-31T17:45:46.203504] [INFO ] [MAIN ] Update Progress: 368/2365 symbols completed. BWMX took 27.9s. Estimated remaining: 4h 7m 59s. Rate: 8.1 symbols/min [2025-10-31T17:45:46.366358] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:45:46.413098] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-10-31T17:45:46.413370] [INFO ] [MAIN ] BWXT: Loaded 47442 existing records. [2025-10-31T17:45:46.585611] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:45:46.585836] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-31T17:45:46.585902] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-31T17:45:46.586145] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-31T17:45:46.586183] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-31T17:45:46.662823] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-31T17:45:46.951977] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:45:46.970815] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T17:45:47.318558] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-31T17:45:47.320287] [INFO ] [REMOTE ] BWSN: Full fetch complete (6456 records). [2025-10-31T17:45:47.320361] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-31T17:45:47.458247] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-31T17:45:47.721397] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-31T17:45:47.721475] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-31T17:45:47.721670] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-31T17:45:47.721731] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-31T17:45:47.722134] [DEBUG] [LOCAL ] BWSN: Trimmed 6456 records to 5066 (keeping 200 days of data) [2025-10-31T17:45:47.755854] [DEBUG] [LOCAL ] BWSN: Primary data saved (5066 records). [2025-10-31T17:45:47.756003] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-31T17:45:47.756133] [INFO ] [MAIN ] Update Progress: 369/2365 symbols completed. BWSN took 26.6s. Estimated remaining: 4h 7m 20s. Rate: 8.1 symbols/min [2025-10-31T17:45:47.956875] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:45:48.006899] [DEBUG] [LOCAL ] BX: Loaded 53871 existing records from primary storage. [2025-10-31T17:45:48.007259] [INFO ] [MAIN ] BX: Loaded 53871 existing records. [2025-10-31T17:45:48.178469] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:45:48.178700] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-31T17:45:48.178756] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-31T17:45:48.179130] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-31T17:45:48.179170] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-31T17:45:48.267089] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-31T17:45:48.526740] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:45:48.896146] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T17:45:49.057633] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-31T17:45:49.309298] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T17:45:49.857669] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-31T17:45:50.261929] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T17:45:50.657695] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-31T17:45:51.394608] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-31T17:45:51.457614] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-31T17:45:51.940623] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T17:45:51.948170] [INFO ] [REMOTE ] BWLP: Full fetch complete (47786 records). [2025-10-31T17:45:51.948310] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-31T17:45:52.262796] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-31T17:45:52.325491] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-31T17:45:52.325561] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-31T17:45:52.326202] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-31T17:45:52.326265] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-31T17:45:52.327630] [DEBUG] [LOCAL ] BWLP: Trimmed 47786 records to 32174 (keeping 200 days of data) [2025-10-31T17:45:52.517132] [DEBUG] [LOCAL ] BWLP: Primary data saved (32174 records). [2025-10-31T17:45:52.517264] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-31T17:45:52.517376] [INFO ] [MAIN ] Update Progress: 370/2365 symbols completed. BWLP took 49.5s. Estimated remaining: 4h 6m 58s. Rate: 8.1 symbols/min [2025-10-31T17:45:52.688073] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:45:52.688879] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-31T17:45:52.702951] [DEBUG] [LOCAL ] BXC: Loaded 13143 existing records from primary storage. [2025-10-31T17:45:52.703133] [INFO ] [MAIN ] BXC: Loaded 13143 existing records. [2025-10-31T17:45:52.876941] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:45:52.877117] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-31T17:45:52.877162] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-31T17:45:52.877342] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-31T17:45:52.877379] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-31T17:45:53.067761] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-31T17:45:53.237418] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:45:53.264767] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-31T17:45:53.591863] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-31T17:45:53.592920] [INFO ] [REMOTE ] BWNB: Full fetch complete (5587 records). [2025-10-31T17:45:53.592987] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-31T17:45:53.865250] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-31T17:45:53.954635] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-31T17:45:53.954745] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-31T17:45:53.954917] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-31T17:45:53.954957] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-31T17:45:53.955336] [DEBUG] [LOCAL ] BWNB: Trimmed 5587 records to 4037 (keeping 200 days of data) [2025-10-31T17:45:53.982563] [DEBUG] [LOCAL ] BWNB: Primary data saved (4037 records). [2025-10-31T17:45:53.982699] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-31T17:45:53.982790] [INFO ] [MAIN ] Update Progress: 371/2365 symbols completed. BWNB took 34.4s. Estimated remaining: 4h 6m 18s. Rate: 8.1 symbols/min [2025-10-31T17:45:54.154488] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:45:54.194628] [DEBUG] [LOCAL ] BXMT: Loaded 47507 existing records from primary storage. [2025-10-31T17:45:54.194942] [INFO ] [MAIN ] BXMT: Loaded 47507 existing records. [2025-10-31T17:45:54.368090] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:45:54.368317] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-31T17:45:54.368362] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-31T17:45:54.368831] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-31T17:45:54.368900] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-31T17:45:54.662782] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-31T17:45:54.730067] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:45:55.416073] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-31T17:45:55.457632] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-31T17:45:55.862856] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T17:45:56.257678] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-31T17:45:57.040701] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T17:45:57.057617] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-31T17:45:57.621476] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T17:45:57.857671] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-31T17:45:58.441178] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T17:45:58.506227] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-31T17:45:58.657695] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-31T17:45:59.457688] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-31T17:45:59.861363] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T17:45:59.956971] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T17:46:00.257810] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-31T17:46:00.825564] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T17:46:01.057692] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-31T17:46:01.857702] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-31T17:46:02.583035] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T17:46:02.657639] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-31T17:46:03.368164] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T17:46:03.457674] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-31T17:46:04.163002] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-31T17:46:04.257688] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-31T17:46:04.713204] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T17:46:05.057634] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-31T17:46:05.600873] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T17:46:05.857705] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-31T17:46:06.563887] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-31T17:46:06.657722] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-31T17:46:07.157570] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T17:46:07.457633] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-31T17:46:08.095281] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T17:46:08.257684] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-31T17:46:08.663346] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T17:46:09.057721] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-31T17:46:09.074191] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-31T17:46:09.857670] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-31T17:46:10.507137] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T17:46:10.657707] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-31T17:46:10.671138] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-31T17:46:11.457717] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-31T17:46:12.257689] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-31T17:46:12.297960] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-31T17:46:12.619950] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T17:46:13.057685] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-31T17:46:13.685139] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-31T17:46:13.723619] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T17:46:13.857629] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-31T17:46:14.497499] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-31T17:46:14.657685] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-31T17:46:15.457687] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-31T17:46:15.982741] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T17:46:16.004029] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-31T17:46:16.257676] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-31T17:46:16.818172] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-31T17:46:17.057675] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-31T17:46:17.816901] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-31T17:46:17.819737] [INFO ] [REMOTE ] BXC: Full fetch complete (18217 records). [2025-10-31T17:46:17.819814] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-31T17:46:17.820222] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:46:17.820300] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:46:17.820341] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:46:17.820377] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-31T17:46:17.820428] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-31T17:46:17.820463] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-10-31T17:46:17.820865] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-10-31T17:46:17.820950] [INFO ] [MAIN ] Update Progress: 372/2365 symbols completed. BXC took 25.3s. Estimated remaining: 4h 7m 39s. Rate: 8.0 symbols/min [2025-10-31T17:46:17.862771] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-31T17:46:18.004839] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:46:18.023588] [DEBUG] [LOCAL ] BXMX: Loaded 18812 existing records from primary storage. [2025-10-31T17:46:18.023859] [INFO ] [MAIN ] BXMX: Loaded 18812 existing records. [2025-10-31T17:46:18.203199] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:46:18.203423] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-31T17:46:18.203475] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-31T17:46:18.203733] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-31T17:46:18.203792] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-31T17:46:18.555322] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:46:18.657681] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-31T17:46:19.133679] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-31T17:46:19.145976] [INFO ] [REMOTE ] BX: Full fetch complete (77611 records). [2025-10-31T17:46:19.146108] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-31T17:46:19.459500] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-31T17:46:19.546096] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-31T17:46:19.546195] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-31T17:46:19.547088] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-31T17:46:19.547161] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-31T17:46:19.578182] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-31T17:46:19.576752] [DEBUG] [LOCAL ] BX: Trimmed 77611 records to 54261 (keeping 200 days of data) [2025-10-31T17:46:19.921311] [DEBUG] [LOCAL ] BX: Primary data saved (54261 records). [2025-10-31T17:46:19.921437] [INFO ] [MAIN ] BX: Full history saved. [2025-10-31T17:46:19.921512] [INFO ] [MAIN ] Update Progress: 373/2365 symbols completed. BX took 32.2s. Estimated remaining: 4h 7m 3s. Rate: 8.1 symbols/min [2025-10-31T17:46:20.117548] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:46:20.160522] [DEBUG] [LOCAL ] BXP: Loaded 50105 existing records from primary storage. [2025-10-31T17:46:20.160861] [INFO ] [MAIN ] BXP: Loaded 50105 existing records. [2025-10-31T17:46:20.262747] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-31T17:46:20.345348] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:46:20.345632] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-31T17:46:20.345722] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-31T17:46:20.345921] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-31T17:46:20.345962] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-31T17:46:20.466776] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T17:46:20.712344] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:46:21.057724] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-31T17:46:21.524843] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T17:46:21.857720] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-31T17:46:22.160206] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-31T17:46:22.657705] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-31T17:46:23.457670] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-31T17:46:23.799485] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-31T17:46:23.813365] [INFO ] [REMOTE ] BWXT: Full fetch complete (68197 records). [2025-10-31T17:46:23.813593] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-31T17:46:24.090673] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-31T17:46:24.267568] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-31T17:46:24.269545] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T17:46:24.333963] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-31T17:46:24.334062] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-31T17:46:24.334898] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-31T17:46:24.334961] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-31T17:46:24.336351] [DEBUG] [LOCAL ] BWXT: Trimmed 68197 records to 47790 (keeping 200 days of data) [2025-10-31T17:46:24.625427] [DEBUG] [LOCAL ] BWXT: Primary data saved (47790 records). [2025-10-31T17:46:24.625569] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-31T17:46:24.626910] [INFO ] [MAIN ] Update Progress: 374/2365 symbols completed. BWXT took 38.4s. Estimated remaining: 4h 6m 41s. Rate: 8.1 symbols/min [2025-10-31T17:46:24.800576] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:46:24.845609] [DEBUG] [LOCAL ] BXSL: Loaded 48556 existing records from primary storage. [2025-10-31T17:46:24.845941] [INFO ] [MAIN ] BXSL: Loaded 48556 existing records. [2025-10-31T17:46:25.020273] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:46:25.020520] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-31T17:46:25.020581] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-31T17:46:25.020942] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-31T17:46:25.021011] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-31T17:46:25.063002] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-31T17:46:25.385956] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:46:25.574576] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T17:46:25.842917] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-31T17:46:25.857598] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-31T17:46:26.602347] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-31T17:46:26.657668] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-31T17:46:27.457667] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-31T17:46:27.893840] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T17:46:28.257720] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-31T17:46:28.892863] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-31T17:46:29.057688] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-31T17:46:29.578964] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:46:29.692132] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-31T17:46:29.857675] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-31T17:46:30.657705] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-31T17:46:31.070109] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T17:46:31.457635] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-31T17:46:31.533182] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T17:46:32.257668] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-31T17:46:32.618582] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T17:46:33.057671] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-31T17:46:33.779987] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T17:46:33.793434] [INFO ] [REMOTE ] BXMT: Full fetch complete (69835 records). [2025-10-31T17:46:33.793591] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-31T17:46:33.865138] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-31T17:46:34.197220] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-31T17:46:34.197325] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-31T17:46:34.198143] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-31T17:46:34.198225] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-31T17:46:34.199704] [DEBUG] [LOCAL ] BXMT: Trimmed 69835 records to 47854 (keeping 200 days of data) [2025-10-31T17:46:34.331722] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T17:46:34.524034] [DEBUG] [LOCAL ] BXMT: Primary data saved (47854 records). [2025-10-31T17:46:34.524194] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-31T17:46:34.524316] [INFO ] [MAIN ] Update Progress: 375/2365 symbols completed. BXMT took 40.5s. Estimated remaining: 4h 6m 47s. Rate: 8.1 symbols/min [2025-10-31T17:46:34.662811] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-31T17:46:34.732616] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:46:34.754849] [DEBUG] [LOCAL ] BY: Loaded 21558 existing records from primary storage. [2025-10-31T17:46:34.755139] [INFO ] [MAIN ] BY: Loaded 21558 existing records. [2025-10-31T17:46:34.962938] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:46:34.963284] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-31T17:46:34.963383] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-31T17:46:34.963843] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-31T17:46:34.963906] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-31T17:46:35.391956] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:46:35.431684] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T17:46:35.438028] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-31T17:46:35.457609] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-31T17:46:36.069081] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-31T17:46:36.257686] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-31T17:46:37.054145] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-31T17:46:37.058266] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-31T17:46:37.857667] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-31T17:46:38.392339] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T17:46:38.657626] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-31T17:46:38.678755] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:46:39.457691] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-31T17:46:39.979488] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T17:46:40.031981] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T17:46:40.257668] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-31T17:46:40.953227] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-31T17:46:40.957962] [INFO ] [REMOTE ] BXMX: Full fetch complete (28529 records). [2025-10-31T17:46:40.958082] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-31T17:46:41.057951] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-31T17:46:41.351009] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-31T17:46:41.351107] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-31T17:46:41.351564] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-31T17:46:41.351606] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-31T17:46:41.352321] [DEBUG] [LOCAL ] BXMX: Trimmed 28529 records to 18988 (keeping 200 days of data) [2025-10-31T17:46:41.476893] [DEBUG] [LOCAL ] BXMX: Primary data saved (18988 records). [2025-10-31T17:46:41.477023] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-31T17:46:41.477101] [INFO ] [MAIN ] Update Progress: 376/2365 symbols completed. BXMX took 23.7s. Estimated remaining: 4h 6m 37s. Rate: 8.1 symbols/min [2025-10-31T17:46:41.680077] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:46:41.722956] [DEBUG] [LOCAL ] BYD: Loaded 45299 existing records from primary storage. [2025-10-31T17:46:41.723240] [INFO ] [MAIN ] BYD: Loaded 45299 existing records. [2025-10-31T17:46:41.869514] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-31T17:46:41.923169] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:46:41.925094] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-31T17:46:41.926274] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-31T17:46:41.925694] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-31T17:46:41.931295] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-31T17:46:41.931358] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-31T17:46:42.302546] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:46:42.657685] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-31T17:46:43.058181] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T17:46:43.457693] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-31T17:46:43.856718] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T17:46:44.257678] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-31T17:46:44.763150] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T17:46:45.062615] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-31T17:46:45.064535] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T17:46:45.857667] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-31T17:46:46.246872] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T17:46:46.657677] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-31T17:46:46.866234] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T17:46:47.457729] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-31T17:46:47.745941] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T17:46:48.153637] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T17:46:48.257689] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-31T17:46:49.057682] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-31T17:46:49.503445] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T17:46:49.857623] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-31T17:46:50.657624] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-31T17:46:50.694996] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T17:46:50.706468] [INFO ] [REMOTE ] BXP: Full fetch complete (72272 records). [2025-10-31T17:46:50.706705] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-31T17:46:51.103200] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-31T17:46:51.103285] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-31T17:46:51.104061] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-31T17:46:51.104123] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-31T17:46:51.105522] [DEBUG] [LOCAL ] BXP: Trimmed 72272 records to 50494 (keeping 200 days of data) [2025-10-31T17:46:51.349971] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T17:46:51.449420] [DEBUG] [LOCAL ] BXP: Primary data saved (50494 records). [2025-10-31T17:46:51.449539] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-31T17:46:51.449617] [INFO ] [MAIN ] Update Progress: 377/2365 symbols completed. BXP took 31.5s. Estimated remaining: 4h 6m 42s. Rate: 8.1 symbols/min [2025-10-31T17:46:51.463407] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-31T17:46:51.657286] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:46:51.657483] [DEBUG] [LOCAL ] BYM: No existing data file found in primary storage. [2025-10-31T17:46:51.657521] [WARN ] [MAIN ] BYM: No existing data found, performing full refresh instead. [2025-10-31T17:46:51.657635] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-31T17:46:51.657713] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-31T17:46:51.657762] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-31T17:46:51.657796] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-31T17:46:52.025299] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:46:52.061437] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T17:46:52.257628] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-31T17:46:52.280744] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-31T17:46:53.057673] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-31T17:46:53.609219] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T17:46:53.857687] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-31T17:46:53.966607] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T17:46:54.657665] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-31T17:46:55.074136] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T17:46:55.457692] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-31T17:46:55.974917] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T17:46:56.257623] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-31T17:46:56.285710] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T17:46:57.057732] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-31T17:46:57.660423] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T17:46:57.674437] [INFO ] [REMOTE ] BXSL: Full fetch complete (70319 records). [2025-10-31T17:46:57.674629] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-31T17:46:57.865593] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-31T17:46:58.098768] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-31T17:46:58.098877] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-31T17:46:58.099820] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-31T17:46:58.099940] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-31T17:46:58.101699] [DEBUG] [LOCAL ] BXSL: Trimmed 70319 records to 48935 (keeping 200 days of data) [2025-10-31T17:46:58.229775] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T17:46:58.439672] [DEBUG] [LOCAL ] BXSL: Primary data saved (48935 records). [2025-10-31T17:46:58.439811] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-31T17:46:58.440730] [INFO ] [MAIN ] Update Progress: 378/2365 symbols completed. BXSL took 33.8s. Estimated remaining: 4h 6m 33s. Rate: 8.1 symbols/min [2025-10-31T17:46:58.648617] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:46:58.657671] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-31T17:46:58.686555] [DEBUG] [LOCAL ] BZH: Loaded 31698 existing records from primary storage. [2025-10-31T17:46:58.686879] [INFO ] [MAIN ] BZH: Loaded 31698 existing records. [2025-10-31T17:46:58.841053] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-31T17:46:58.926564] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:46:58.926810] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-31T17:46:58.926879] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-31T17:46:58.927137] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-31T17:46:58.927183] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-31T17:46:59.304581] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:46:59.457671] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-31T17:46:59.731882] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T17:47:00.257750] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-31T17:47:00.440396] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T17:47:00.814627] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-31T17:47:01.057638] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-31T17:47:01.751470] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-31T17:47:01.857689] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-31T17:47:02.657718] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-31T17:47:03.119722] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T17:47:03.457696] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-31T17:47:03.780314] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T17:47:04.257688] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-31T17:47:04.313765] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T17:47:05.057679] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-31T17:47:05.617087] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T17:47:05.723085] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T17:47:05.857688] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-31T17:47:06.657634] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-31T17:47:06.761912] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-31T17:47:06.766891] [INFO ] [REMOTE ] BY: Full fetch complete (29866 records). [2025-10-31T17:47:06.766997] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-31T17:47:07.143530] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-31T17:47:07.143608] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-31T17:47:07.144097] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-31T17:47:07.144154] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-31T17:47:07.144841] [DEBUG] [LOCAL ] BY: Trimmed 29866 records to 21720 (keeping 200 days of data) [2025-10-31T17:47:07.272186] [DEBUG] [LOCAL ] BY: Primary data saved (21720 records). [2025-10-31T17:47:07.272312] [INFO ] [MAIN ] BY: Full history saved. [2025-10-31T17:47:07.272389] [INFO ] [MAIN ] Update Progress: 379/2365 symbols completed. BY took 32.7s. Estimated remaining: 4h 6m 32s. Rate: 8.1 symbols/min [2025-10-31T17:47:07.440983] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:47:07.468317] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-31T17:47:07.491234] [DEBUG] [LOCAL ] C: Loaded 54131 existing records from primary storage. [2025-10-31T17:47:07.491546] [INFO ] [MAIN ] C: Loaded 54131 existing records. [2025-10-31T17:47:07.673755] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:47:07.673975] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-31T17:47:07.674023] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-31T17:47:07.674319] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-31T17:47:07.674362] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-31T17:47:08.042199] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:47:08.195959] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-31T17:47:08.206689] [INFO ] [REMOTE ] BYD: Full fetch complete (65664 records). [2025-10-31T17:47:08.206826] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-31T17:47:08.262905] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-31T17:47:08.604228] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-31T17:47:08.604327] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-31T17:47:08.605285] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-31T17:47:08.605376] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-31T17:47:08.625240] [DEBUG] [LOCAL ] BYD: Trimmed 65664 records to 45604 (keeping 200 days of data) [2025-10-31T17:47:08.625125] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:47:08.906168] [DEBUG] [LOCAL ] BYD: Primary data saved (45604 records). [2025-10-31T17:47:08.906309] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-31T17:47:08.906975] [INFO ] [MAIN ] Update Progress: 380/2365 symbols completed. BYD took 27.4s. Estimated remaining: 4h 5m 55s. Rate: 8.1 symbols/min [2025-10-31T17:47:09.043971] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T17:47:09.062339] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-31T17:47:09.099922] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:47:09.100849] [DEBUG] [LOCAL ] CAAP: No existing data file found in primary storage. [2025-10-31T17:47:09.100894] [WARN ] [MAIN ] CAAP: No existing data found, performing full refresh instead. [2025-10-31T17:47:09.101000] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-31T17:47:09.101041] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-31T17:47:09.101081] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-10-31T17:47:09.101112] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-31T17:47:09.464635] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:47:09.857716] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-31T17:47:10.633214] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T17:47:10.657607] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-31T17:47:10.828994] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-31T17:47:11.227703] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T17:47:11.457683] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-31T17:47:12.049080] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-31T17:47:12.257686] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-31T17:47:12.958528] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T17:47:13.057692] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-31T17:47:13.633481] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-31T17:47:13.857691] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-31T17:47:14.657738] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-31T17:47:15.176155] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-31T17:47:15.457639] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-31T17:47:15.618938] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-31T17:47:15.988075] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-31T17:47:16.257716] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-31T17:47:17.057633] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-31T17:47:17.603487] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-31T17:47:17.606620] [INFO ] [REMOTE ] BYM: Full fetch complete (17393 records). [2025-10-31T17:47:17.606747] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-31T17:47:17.864754] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-31T17:47:17.975927] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-31T17:47:17.976010] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-31T17:47:17.976381] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-31T17:47:17.976422] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-31T17:47:17.977007] [DEBUG] [LOCAL ] BYM: Trimmed 17393 records to 11399 (keeping 200 days of data) [2025-10-31T17:47:18.045756] [DEBUG] [LOCAL ] BYM: Primary data saved (11399 records). [2025-10-31T17:47:18.045984] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-31T17:47:18.046170] [INFO ] [MAIN ] Update Progress: 381/2365 symbols completed. BYM took 26.6s. Estimated remaining: 4h 5m 56s. Rate: 8.1 symbols/min [2025-10-31T17:47:18.219169] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-31T17:47:18.261634] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:47:18.278992] [DEBUG] [LOCAL ] CABO: Loaded 16528 existing records from primary storage. [2025-10-31T17:47:18.279229] [INFO ] [MAIN ] CABO: Loaded 16528 existing records. [2025-10-31T17:47:18.454775] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:47:18.455006] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-31T17:47:18.455053] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-31T17:47:18.455246] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-31T17:47:18.455302] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-31T17:47:18.663051] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-31T17:47:18.806118] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:47:18.994779] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T17:47:19.457625] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-31T17:47:19.513222] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-31T17:47:20.257621] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-31T17:47:20.437265] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-31T17:47:21.057618] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-31T17:47:21.216452] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-31T17:47:21.857732] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-31T17:47:22.641011] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T17:47:22.657602] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-31T17:47:22.859865] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-31T17:47:23.394231] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T17:47:23.457686] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-31T17:47:24.257720] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-31T17:47:24.939303] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T17:47:25.057622] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-31T17:47:25.119005] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-31T17:47:25.650531] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-31T17:47:25.857663] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-31T17:47:26.548365] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-31T17:47:26.657669] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-31T17:47:27.457687] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-31T17:47:28.160909] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-31T17:47:28.257694] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-31T17:47:28.339408] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T17:47:28.891170] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-31T17:47:29.057732] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-31T17:47:29.857670] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-31T17:47:30.112916] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T17:47:30.490997] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-31T17:47:30.657677] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-31T17:47:31.457626] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-31T17:47:31.547611] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T17:47:32.257697] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-31T17:47:33.057628] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-31T17:47:33.224850] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-31T17:47:33.225820] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T17:47:33.800903] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-31T17:47:33.857616] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-31T17:47:34.657676] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-31T17:47:34.734525] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-31T17:47:35.457629] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-31T17:47:35.548544] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-31T17:47:35.554470] [INFO ] [REMOTE ] CAAP: Full fetch complete (28380 records). [2025-10-31T17:47:35.554584] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-31T17:47:35.924490] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-31T17:47:35.924565] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-31T17:47:35.924998] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-31T17:47:35.925059] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-31T17:47:35.925739] [DEBUG] [LOCAL ] CAAP: Trimmed 28380 records to 20166 (keeping 200 days of data) [2025-10-31T17:47:36.039779] [DEBUG] [LOCAL ] CAAP: Primary data saved (20166 records). [2025-10-31T17:47:36.039902] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-31T17:47:36.039969] [INFO ] [MAIN ] Update Progress: 382/2365 symbols completed. CAAP took 27.1s. Estimated remaining: 4h 6m 43s. Rate: 8.0 symbols/min [2025-10-31T17:47:36.211367] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:47:36.211608] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-10-31T17:47:36.211691] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-10-31T17:47:36.211804] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-31T17:47:36.211847] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-31T17:47:36.211889] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-10-31T17:47:36.211923] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-31T17:47:36.264624] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-31T17:47:36.436360] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-31T17:47:36.607151] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:47:37.057733] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-31T17:47:37.775668] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-31T17:47:37.860660] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-31T17:47:37.862616] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T17:47:38.657675] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-31T17:47:38.910896] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T17:47:39.216323] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-31T17:47:39.457689] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-31T17:47:40.127906] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T17:47:40.257631] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-31T17:47:41.062443] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-31T17:47:41.064004] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T17:47:41.066976] [INFO ] [REMOTE ] CABO: Full fetch complete (23074 records). [2025-10-31T17:47:41.067044] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-31T17:47:41.421959] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-31T17:47:41.422035] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-31T17:47:41.422438] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-31T17:47:41.422498] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-31T17:47:41.423164] [DEBUG] [LOCAL ] CABO: Trimmed 23074 records to 16608 (keeping 200 days of data) [2025-10-31T17:47:41.520157] [DEBUG] [LOCAL ] CABO: Primary data saved (16608 records). [2025-10-31T17:47:41.520292] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-31T17:47:41.520371] [INFO ] [MAIN ] Update Progress: 383/2365 symbols completed. CABO took 23.5s. Estimated remaining: 4h 6m 26s. Rate: 8.0 symbols/min [2025-10-31T17:47:41.686885] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:47:41.735744] [DEBUG] [LOCAL ] CADE: Loaded 50144 existing records from primary storage. [2025-10-31T17:47:41.736049] [INFO ] [MAIN ] CADE: Loaded 50144 existing records. [2025-10-31T17:47:41.862754] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-31T17:47:41.924774] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:47:41.924956] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-31T17:47:41.925003] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-31T17:47:41.925279] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-31T17:47:41.925334] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-31T17:47:42.314397] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:47:42.336988] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T17:47:42.344859] [INFO ] [REMOTE ] BZH: Full fetch complete (47025 records). [2025-10-31T17:47:42.345184] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-31T17:47:42.662821] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-31T17:47:42.749327] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-31T17:47:42.749438] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-31T17:47:42.750188] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-31T17:47:42.750256] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-31T17:47:42.751805] [DEBUG] [LOCAL ] BZH: Trimmed 47025 records to 31912 (keeping 200 days of data) [2025-10-31T17:47:42.953338] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T17:47:42.981064] [DEBUG] [LOCAL ] BZH: Primary data saved (31912 records). [2025-10-31T17:47:42.981279] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-31T17:47:42.981385] [INFO ] [MAIN ] Update Progress: 384/2365 symbols completed. BZH took 44.5s. Estimated remaining: 4h 5m 47s. Rate: 8.1 symbols/min [2025-10-31T17:47:43.161176] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:47:43.204432] [DEBUG] [LOCAL ] CAE: Loaded 38916 existing records from primary storage. [2025-10-31T17:47:43.204834] [INFO ] [MAIN ] CAE: Loaded 38916 existing records. [2025-10-31T17:47:43.400243] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:47:43.400622] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-31T17:47:43.400710] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-31T17:47:43.400986] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-31T17:47:43.401043] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-31T17:47:43.468507] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-31T17:47:43.781857] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:47:43.910862] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T17:47:44.257617] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-31T17:47:45.057623] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-31T17:47:45.209540] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-31T17:47:45.373943] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T17:47:45.857696] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-31T17:47:46.013007] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-31T17:47:46.507992] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T17:47:46.521388] [INFO ] [REMOTE ] C: Full fetch complete (77919 records). [2025-10-31T17:47:46.521606] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-31T17:47:46.665720] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-31T17:47:46.937685] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-31T17:47:46.937798] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-31T17:47:46.938809] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-31T17:47:46.938878] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-31T17:47:46.940417] [DEBUG] [LOCAL ] C: Trimmed 77919 records to 54521 (keeping 200 days of data) [2025-10-31T17:47:47.270187] [DEBUG] [LOCAL ] C: Primary data saved (54521 records). [2025-10-31T17:47:47.270331] [INFO ] [MAIN ] C: Full history saved. [2025-10-31T17:47:47.270410] [INFO ] [MAIN ] Update Progress: 385/2365 symbols completed. C took 40.0s. Estimated remaining: 4h 5m 24s. Rate: 8.1 symbols/min [2025-10-31T17:47:47.439114] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:47:47.444961] [DEBUG] [LOCAL ] CAF: Loaded 3378 existing records from primary storage. [2025-10-31T17:47:47.445137] [INFO ] [MAIN ] CAF: Loaded 3378 existing records. [2025-10-31T17:47:47.465421] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-31T17:47:47.621967] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:47:47.622165] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-31T17:47:47.622211] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-31T17:47:47.622342] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-31T17:47:47.622378] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-31T17:47:47.974740] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:47:48.004150] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T17:47:48.257729] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-31T17:47:48.707552] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T17:47:48.743841] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-31T17:47:49.057677] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-31T17:47:49.435979] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-31T17:47:49.857681] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-31T17:47:50.657619] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-31T17:47:50.842549] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T17:47:51.457673] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-31T17:47:51.835201] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-31T17:47:52.257685] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-31T17:47:52.552799] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T17:47:52.600874] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-31T17:47:53.057707] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-31T17:47:53.450557] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-31T17:47:53.857621] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-31T17:47:54.657677] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-31T17:47:55.015744] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-31T17:47:55.100006] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-31T17:47:55.457640] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-31T17:47:56.257675] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-31T17:47:56.582145] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-31T17:47:56.624799] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T17:47:57.057638] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-31T17:47:57.857679] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-31T17:47:58.042437] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-31T17:47:58.190718] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-31T17:47:58.657716] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-31T17:47:59.457696] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-31T17:47:59.885133] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T17:48:00.257728] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-31T17:48:00.516832] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T17:48:00.736096] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T17:48:01.057729] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-31T17:48:01.857693] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-31T17:48:02.025306] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T17:48:02.657695] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-31T17:48:03.168920] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T17:48:03.457706] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-31T17:48:03.809960] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T17:48:04.257705] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-31T17:48:04.590503] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-31T17:48:04.619978] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T17:48:05.057755] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-31T17:48:05.807689] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T17:48:05.857626] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-31T17:48:06.628882] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T17:48:06.657680] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-31T17:48:07.457619] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-31T17:48:07.495841] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T17:48:08.257714] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-31T17:48:08.896136] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T17:48:08.989774] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-31T17:48:09.057686] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-31T17:48:09.857689] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-31T17:48:10.383732] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T17:48:10.385584] [INFO ] [REMOTE ] CAF: Full fetch complete (5552 records). [2025-10-31T17:48:10.385704] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-31T17:48:10.662904] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-31T17:48:10.800405] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-31T17:48:10.800591] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-31T17:48:10.800944] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-31T17:48:10.801027] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-31T17:48:10.801881] [DEBUG] [LOCAL ] CAF: Trimmed 5552 records to 3392 (keeping 200 days of data) [2025-10-31T17:48:10.855439] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-31T17:48:10.869538] [INFO ] [REMOTE ] CADE: Full fetch complete (70943 records). [2025-10-31T17:48:10.869413] [DEBUG] [LOCAL ] CAF: Primary data saved (3392 records). [2025-10-31T17:48:10.869895] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-31T17:48:10.869811] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-31T17:48:10.870198] [INFO ] [MAIN ] Update Progress: 386/2365 symbols completed. CAF took 23.6s. Estimated remaining: 4h 6m 39s. Rate: 8.0 symbols/min [2025-10-31T17:48:11.302163] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:48:11.463535] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-31T17:48:11.468124] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-31T17:48:11.468223] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-31T17:48:11.469093] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-31T17:48:11.482786] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-31T17:48:11.484570] [DEBUG] [LOCAL ] CADE: Trimmed 70943 records to 50533 (keeping 200 days of data) [2025-10-31T17:48:11.594380] [DEBUG] [LOCAL ] CAG: Loaded 54056 existing records from primary storage. [2025-10-31T17:48:11.597061] [INFO ] [MAIN ] CAG: Loaded 54056 existing records. [2025-10-31T17:48:11.870461] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:48:11.879685] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-31T17:48:11.879775] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-31T17:48:11.921958] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-31T17:48:11.923193] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-31T17:48:12.129484] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-31T17:48:12.231851] [INFO ] [REMOTE ] CACI: Full fetch complete (38097 records). [2025-10-31T17:48:12.267772] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-31T17:48:12.484105] [DEBUG] [LOCAL ] CADE: Primary data saved (50533 records). [2025-10-31T17:48:12.499017] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-31T17:48:12.499364] [INFO ] [MAIN ] Update Progress: 387/2365 symbols completed. CADE took 31.0s. Estimated remaining: 4h 6m 2s. Rate: 8.0 symbols/min [2025-10-31T17:48:12.498834] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:48:12.510477] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-31T17:48:12.874256] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:48:12.981563] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-31T17:48:12.981761] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-31T17:48:12.982344] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-31T17:48:12.984524] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-31T17:48:12.994453] [DEBUG] [LOCAL ] CACI: Trimmed 38097 records to 22036 (keeping 200 days of data) [2025-10-31T17:48:13.011954] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T17:48:13.071805] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-31T17:48:13.182288] [DEBUG] [LOCAL ] CAH: Loaded 51735 existing records from primary storage. [2025-10-31T17:48:13.190385] [DEBUG] [LOCAL ] CACI: Primary data saved (22036 records). [2025-10-31T17:48:13.190522] [INFO ] [MAIN ] CAH: Loaded 51735 existing records. [2025-10-31T17:48:13.190659] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-31T17:48:13.190763] [INFO ] [MAIN ] Update Progress: 388/2365 symbols completed. CACI took 37.2s. Estimated remaining: 4h 5m 20s. Rate: 8.1 symbols/min [2025-10-31T17:48:13.552427] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:48:13.558585] [DEBUG] [LOCAL ] CAL: No existing data file found in primary storage. [2025-10-31T17:48:13.558701] [WARN ] [MAIN ] CAL: No existing data found, performing full refresh instead. [2025-10-31T17:48:13.558455] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:48:13.558927] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-31T17:48:13.559072] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-31T17:48:13.559275] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-31T17:48:13.559203] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-31T17:48:13.559453] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-10-31T17:48:13.559561] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-31T17:48:13.572297] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-31T17:48:13.642578] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-31T17:48:14.271032] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:48:14.293892] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-31T17:48:14.298417] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:48:14.337630] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T17:48:14.366877] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-31T17:48:14.657745] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-31T17:48:15.457745] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-31T17:48:15.767213] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T17:48:15.795315] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T17:48:16.257685] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-31T17:48:16.783397] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-31T17:48:17.057767] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-31T17:48:17.357390] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T17:48:17.857707] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-31T17:48:18.311360] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T17:48:18.320303] [INFO ] [REMOTE ] CAE: Full fetch complete (56653 records). [2025-10-31T17:48:18.320408] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-31T17:48:18.662675] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-31T17:48:18.699342] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-31T17:48:18.699432] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-31T17:48:18.700268] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-31T17:48:18.700332] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-31T17:48:18.701608] [DEBUG] [LOCAL ] CAE: Trimmed 56653 records to 39199 (keeping 200 days of data) [2025-10-31T17:48:18.923053] [DEBUG] [LOCAL ] CAE: Primary data saved (39199 records). [2025-10-31T17:48:18.923197] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-31T17:48:18.924115] [INFO ] [MAIN ] Update Progress: 389/2365 symbols completed. CAE took 35.9s. Estimated remaining: 4h 5m 4s. Rate: 8.1 symbols/min [2025-10-31T17:48:19.109447] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:48:19.140683] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T17:48:19.180777] [DEBUG] [LOCAL ] CALX: Loaded 37233 existing records from primary storage. [2025-10-31T17:48:19.181056] [INFO ] [MAIN ] CALX: Loaded 37233 existing records. [2025-10-31T17:48:19.356499] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:48:19.356776] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-31T17:48:19.356833] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-31T17:48:19.357088] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-31T17:48:19.357143] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-31T17:48:19.457693] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-31T17:48:19.744944] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:48:20.228091] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-31T17:48:20.257616] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-31T17:48:20.755816] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T17:48:21.057710] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-31T17:48:21.795221] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-31T17:48:21.857664] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-31T17:48:22.318511] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T17:48:22.657701] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-31T17:48:23.191191] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:48:23.457733] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-31T17:48:23.970823] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T17:48:24.257688] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-31T17:48:24.875123] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-31T17:48:25.057724] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-31T17:48:25.305436] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-31T17:48:25.857685] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-31T17:48:26.119719] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T17:48:26.657709] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-31T17:48:27.349450] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T17:48:27.457628] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-31T17:48:27.653043] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T17:48:28.257670] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-31T17:48:28.772141] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T17:48:29.057709] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-31T17:48:29.492257] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T17:48:29.857677] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-31T17:48:30.389670] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T17:48:30.657703] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-31T17:48:31.443132] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-31T17:48:31.457621] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-31T17:48:31.946031] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T17:48:32.088669] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T17:48:32.102030] [INFO ] [REMOTE ] CAG: Full fetch complete (77828 records). [2025-10-31T17:48:32.102217] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-31T17:48:32.264382] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-31T17:48:32.537749] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-31T17:48:32.537892] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-31T17:48:32.539102] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-31T17:48:32.539172] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-31T17:48:32.541272] [DEBUG] [LOCAL ] CAG: Trimmed 77828 records to 54446 (keeping 200 days of data) [2025-10-31T17:48:32.907765] [DEBUG] [LOCAL ] CAG: Primary data saved (54446 records). [2025-10-31T17:48:32.907996] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-31T17:48:32.908108] [INFO ] [MAIN ] Update Progress: 390/2365 symbols completed. CAG took 22.0s. Estimated remaining: 4h 5m 29s. Rate: 8.0 symbols/min [2025-10-31T17:48:33.062862] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-31T17:48:33.099287] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:48:33.133468] [DEBUG] [LOCAL ] CANG: Loaded 27266 existing records from primary storage. [2025-10-31T17:48:33.133865] [INFO ] [MAIN ] CANG: Loaded 27266 existing records. [2025-10-31T17:48:33.321876] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:48:33.322209] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-31T17:48:33.322265] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-31T17:48:33.322581] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-31T17:48:33.322679] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-31T17:48:33.722540] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:48:33.761360] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T17:48:33.857693] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-31T17:48:34.183573] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T17:48:34.657740] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-31T17:48:35.207732] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T17:48:35.457684] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-31T17:48:35.694763] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T17:48:36.257686] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-31T17:48:36.542879] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T17:48:37.057705] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-31T17:48:37.583359] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T17:48:37.857726] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-31T17:48:38.137683] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T17:48:38.616915] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T17:48:38.657664] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-31T17:48:39.457697] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-31T17:48:39.948541] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T17:48:40.257693] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-31T17:48:40.842550] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-31T17:48:41.057639] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-31T17:48:41.456380] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T17:48:41.603394] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-31T17:48:41.615556] [INFO ] [REMOTE ] CAH: Full fetch complete (74902 records). [2025-10-31T17:48:41.615760] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-31T17:48:41.862875] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-31T17:48:42.040042] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-31T17:48:42.040136] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-31T17:48:42.041100] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-31T17:48:42.041175] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-31T17:48:42.042683] [DEBUG] [LOCAL ] CAH: Trimmed 74902 records to 52124 (keeping 200 days of data) [2025-10-31T17:48:42.360919] [DEBUG] [LOCAL ] CAH: Primary data saved (52124 records). [2025-10-31T17:48:42.361048] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-31T17:48:42.361123] [INFO ] [MAIN ] Update Progress: 391/2365 symbols completed. CAH took 29.9s. Estimated remaining: 4h 5m 32s. Rate: 8.0 symbols/min [2025-10-31T17:48:42.528058] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:48:42.534891] [DEBUG] [LOCAL ] CAPL: Loaded 5310 existing records from primary storage. [2025-10-31T17:48:42.535068] [INFO ] [MAIN ] CAPL: Loaded 5310 existing records. [2025-10-31T17:48:42.669708] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-31T17:48:42.708248] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:48:42.708596] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-31T17:48:42.708668] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-31T17:48:42.708826] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-31T17:48:42.708865] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-31T17:48:43.059933] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:48:43.082591] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T17:48:43.457632] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-31T17:48:43.636491] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T17:48:44.106587] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-31T17:48:44.257672] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-31T17:48:45.057637] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-31T17:48:45.202495] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T17:48:45.460043] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T17:48:45.857675] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-31T17:48:46.379526] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-31T17:48:46.657672] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-31T17:48:47.184122] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T17:48:47.457668] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-31T17:48:48.257669] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-31T17:48:48.885945] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-31T17:48:49.057673] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-31T17:48:49.383153] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-31T17:48:49.857681] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-31T17:48:50.269029] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-31T17:48:50.352395] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-31T17:48:50.362694] [INFO ] [REMOTE ] CAL: Full fetch complete (62040 records). [2025-10-31T17:48:50.362871] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-31T17:48:50.662854] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-31T17:48:50.781600] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-31T17:48:50.781716] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-31T17:48:50.782450] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-31T17:48:50.782494] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-31T17:48:50.783834] [DEBUG] [LOCAL ] CAL: Trimmed 62040 records to 43118 (keeping 200 days of data) [2025-10-31T17:48:51.047311] [DEBUG] [LOCAL ] CAL: Primary data saved (43118 records). [2025-10-31T17:48:51.047431] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-31T17:48:51.047501] [INFO ] [MAIN ] Update Progress: 392/2365 symbols completed. CAL took 37.9s. Estimated remaining: 4h 5m 31s. Rate: 8.0 symbols/min [2025-10-31T17:48:51.216144] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:48:51.265121] [DEBUG] [LOCAL ] CARR: Loaded 53991 existing records from primary storage. [2025-10-31T17:48:51.265449] [INFO ] [MAIN ] CARR: Loaded 53991 existing records. [2025-10-31T17:48:51.444104] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:48:51.444312] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-31T17:48:51.444358] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-31T17:48:51.444701] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-31T17:48:51.444759] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-31T17:48:51.464838] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-31T17:48:51.824612] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:48:51.991979] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T17:48:52.257625] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-31T17:48:52.382488] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T17:48:53.057611] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-31T17:48:53.283114] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T17:48:53.419776] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-31T17:48:53.857682] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-31T17:48:54.277418] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-31T17:48:54.657677] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-31T17:48:55.457712] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-31T17:48:55.869946] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-31T17:48:56.014322] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T17:48:56.257679] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-31T17:48:57.057707] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-31T17:48:57.296313] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-31T17:48:57.857677] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-31T17:48:58.201064] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:48:58.209012] [INFO ] [REMOTE ] CALX: Full fetch complete (54371 records). [2025-10-31T17:48:58.209159] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-31T17:48:58.588568] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-31T17:48:58.588717] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-31T17:48:58.589687] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-31T17:48:58.589775] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-31T17:48:58.608511] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T17:48:58.614771] [DEBUG] [LOCAL ] CALX: Trimmed 54371 records to 37586 (keeping 200 days of data) [2025-10-31T17:48:58.665942] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-31T17:48:58.835201] [DEBUG] [LOCAL ] CALX: Primary data saved (37586 records). [2025-10-31T17:48:58.835342] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-31T17:48:58.835441] [INFO ] [MAIN ] Update Progress: 393/2365 symbols completed. CALX took 39.9s. Estimated remaining: 4h 5m 25s. Rate: 8.0 symbols/min [2025-10-31T17:48:59.005396] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:48:59.041980] [DEBUG] [LOCAL ] CARS: Loaded 39754 existing records from primary storage. [2025-10-31T17:48:59.042278] [INFO ] [MAIN ] CARS: Loaded 39754 existing records. [2025-10-31T17:48:59.217085] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:48:59.217308] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-31T17:48:59.217354] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-31T17:48:59.217566] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-31T17:48:59.217604] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-31T17:48:59.464525] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-31T17:48:59.587116] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:48:59.751053] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T17:48:59.889476] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T17:49:00.257710] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-31T17:49:01.057705] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-31T17:49:01.625450] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T17:49:01.857628] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-31T17:49:01.934014] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-31T17:49:02.657698] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-31T17:49:02.883786] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T17:49:03.457629] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-31T17:49:03.650005] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-31T17:49:04.002789] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-31T17:49:04.004493] [INFO ] [REMOTE ] CAPL: Full fetch complete (8666 records). [2025-10-31T17:49:04.004560] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-31T17:49:04.004940] [FATAL] [VALIDATOR ] CAPL: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:49:04.005017] [FATAL] [MAIN ] CAPL: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:49:04.005058] [WARN ] [MAIN ] CAPL: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:49:04.005095] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-31T17:49:04.005149] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-31T17:49:04.005182] [INFO ] [LOCAL ] CAPL: Starting deletion of derivative data. [2025-10-31T17:49:04.005400] [DEBUG] [LOCAL ] CAPL: Deleted derivative data file. [2025-10-31T17:49:04.005483] [INFO ] [MAIN ] Update Progress: 394/2365 symbols completed. CAPL took 21.6s. Estimated remaining: 4h 5m 6s. Rate: 8.0 symbols/min [2025-10-31T17:49:04.173729] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:49:04.221403] [DEBUG] [LOCAL ] CAT: Loaded 53290 existing records from primary storage. [2025-10-31T17:49:04.221769] [INFO ] [MAIN ] CAT: Loaded 53290 existing records. [2025-10-31T17:49:04.262898] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-31T17:49:04.400546] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:49:04.400779] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-31T17:49:04.400829] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-31T17:49:04.401145] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-31T17:49:04.401200] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-31T17:49:04.749314] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:49:05.057636] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-31T17:49:05.220155] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T17:49:05.857625] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-31T17:49:06.197967] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:49:06.204368] [INFO ] [REMOTE ] CANG: Full fetch complete (39063 records). [2025-10-31T17:49:06.204447] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-31T17:49:06.576748] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-31T17:49:06.576856] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-31T17:49:06.577394] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-31T17:49:06.577438] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-31T17:49:06.578447] [DEBUG] [LOCAL ] CANG: Trimmed 39063 records to 27517 (keeping 200 days of data) [2025-10-31T17:49:06.658842] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-31T17:49:06.735708] [DEBUG] [LOCAL ] CANG: Primary data saved (27517 records). [2025-10-31T17:49:06.735839] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-31T17:49:06.735950] [INFO ] [MAIN ] Update Progress: 395/2365 symbols completed. CANG took 33.8s. Estimated remaining: 4h 4m 35s. Rate: 8.1 symbols/min [2025-10-31T17:49:06.912767] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:49:06.944402] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T17:49:06.958499] [DEBUG] [LOCAL ] CATO: Loaded 6674 existing records from primary storage. [2025-10-31T17:49:06.958760] [INFO ] [MAIN ] CATO: Loaded 6674 existing records. [2025-10-31T17:49:07.154930] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:49:07.155143] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-31T17:49:07.155191] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-31T17:49:07.155332] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-31T17:49:07.155368] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-31T17:49:07.467435] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-31T17:49:07.508058] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:49:08.257628] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-31T17:49:08.322085] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-31T17:49:08.698946] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T17:49:09.057703] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-31T17:49:09.596430] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T17:49:09.857696] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-31T17:49:10.638736] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T17:49:10.657705] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-31T17:49:10.730076] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-31T17:49:11.158402] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T17:49:11.457742] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-31T17:49:12.257685] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-31T17:49:12.547844] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T17:49:12.783268] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T17:49:13.057719] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-31T17:49:13.588711] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T17:49:13.857684] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-31T17:49:14.657688] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-31T17:49:15.051418] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T17:49:15.457717] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-31T17:49:16.257709] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-31T17:49:16.395950] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-31T17:49:16.429525] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-31T17:49:17.057715] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-31T17:49:17.558425] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T17:49:17.857709] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-31T17:49:18.657632] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-31T17:49:18.825837] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-31T17:49:18.859292] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T17:49:19.049695] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T17:49:19.457707] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-31T17:49:19.840884] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-31T17:49:20.257707] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-31T17:49:21.057669] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-31T17:49:21.857702] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-31T17:49:21.907127] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-31T17:49:21.977381] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-31T17:49:22.657679] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-31T17:49:23.457700] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-31T17:49:24.103180] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T17:49:24.101306] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-31T17:49:24.115517] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-31T17:49:24.257677] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-31T17:49:25.057716] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-31T17:49:25.856631] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-31T17:49:25.861094] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-31T17:49:26.657625] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-31T17:49:26.740157] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-31T17:49:27.131496] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T17:49:27.141229] [INFO ] [REMOTE ] CARS: Full fetch complete (56870 records). [2025-10-31T17:49:27.141342] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-31T17:49:27.263133] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-31T17:49:27.462986] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-31T17:49:27.548460] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-31T17:49:27.548621] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-31T17:49:27.549880] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-31T17:49:27.549952] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-31T17:49:27.551968] [DEBUG] [LOCAL ] CARS: Trimmed 56870 records to 40020 (keeping 200 days of data) [2025-10-31T17:49:27.814383] [DEBUG] [LOCAL ] CARS: Primary data saved (40020 records). [2025-10-31T17:49:27.814576] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-31T17:49:27.815691] [INFO ] [MAIN ] Update Progress: 396/2365 symbols completed. CARS took 29.0s. Estimated remaining: 4h 5m 35s. Rate: 8.0 symbols/min [2025-10-31T17:49:28.048926] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:49:28.112204] [DEBUG] [LOCAL ] CAVA: Loaded 53922 existing records from primary storage. [2025-10-31T17:49:28.112721] [INFO ] [MAIN ] CAVA: Loaded 53922 existing records. [2025-10-31T17:49:28.262905] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-31T17:49:28.311857] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:49:28.312069] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-31T17:49:28.312126] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-31T17:49:28.312455] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-31T17:49:28.312511] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-31T17:49:28.659971] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:49:28.830003] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T17:49:28.839023] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-31T17:49:29.057688] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-31T17:49:29.857687] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-31T17:49:30.657623] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-31T17:49:30.784605] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-31T17:49:31.144788] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T17:49:31.269998] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T17:49:31.271947] [INFO ] [REMOTE ] CATO: Full fetch complete (10584 records). [2025-10-31T17:49:31.272018] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-31T17:49:31.460681] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-31T17:49:31.625143] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-31T17:49:31.625243] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-31T17:49:31.625719] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-31T17:49:31.625781] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-31T17:49:31.626352] [DEBUG] [LOCAL ] CATO: Trimmed 10584 records to 6705 (keeping 200 days of data) [2025-10-31T17:49:31.662861] [DEBUG] [LOCAL ] CATO: Primary data saved (6705 records). [2025-10-31T17:49:31.662988] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-31T17:49:31.663135] [INFO ] [MAIN ] Update Progress: 397/2365 symbols completed. CATO took 24.9s. Estimated remaining: 4h 5m 10s. Rate: 8.0 symbols/min [2025-10-31T17:49:32.257746] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-31T17:49:33.059773] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-31T17:49:33.065199] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-31T17:49:33.857633] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-31T17:49:34.069749] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-31T17:49:34.088612] [INFO ] [REMOTE ] CARR: Full fetch complete (77770 records). [2025-10-31T17:49:34.088893] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-31T17:49:34.535720] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-31T17:49:34.535810] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-31T17:49:34.536732] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-31T17:49:34.536808] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-31T17:49:34.538521] [DEBUG] [LOCAL ] CARR: Trimmed 77770 records to 54381 (keeping 200 days of data) [2025-10-31T17:49:34.844161] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-31T17:49:34.860543] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-31T17:49:34.962967] [DEBUG] [LOCAL ] CARR: Primary data saved (54381 records). [2025-10-31T17:49:34.963110] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-31T17:49:34.964130] [INFO ] [MAIN ] Update Progress: 398/2365 symbols completed. CARR took 43.9s. Estimated remaining: 4h 4m 41s. Rate: 8.0 symbols/min [2025-10-31T17:49:35.420275] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-31T17:49:35.457626] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-31T17:49:36.571115] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-31T17:49:36.582449] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-31T17:49:36.958766] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T17:49:37.057612] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-31T17:49:38.114106] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-31T17:49:38.127580] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-31T17:49:38.752253] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T17:49:38.764945] [INFO ] [REMOTE ] CAT: Full fetch complete (76871 records). [2025-10-31T17:49:38.765196] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-31T17:49:39.200310] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-31T17:49:39.214065] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-31T17:49:39.214289] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-31T17:49:39.215517] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-31T17:49:39.215604] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-31T17:49:39.215951] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-31T17:49:39.217741] [DEBUG] [LOCAL ] CAT: Trimmed 76871 records to 53679 (keeping 200 days of data) [2025-10-31T17:49:39.547008] [DEBUG] [LOCAL ] CAT: Primary data saved (53679 records). [2025-10-31T17:49:39.547175] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-31T17:49:39.547267] [INFO ] [MAIN ] Update Progress: 399/2365 symbols completed. CAT took 35.5s. Estimated remaining: 4h 4m 20s. Rate: 8.0 symbols/min [2025-10-31T17:49:40.764843] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-31T17:49:40.775844] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-31T17:49:42.647380] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-31T17:49:42.659079] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-31T17:49:44.207360] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-31T17:49:44.219973] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-31T17:49:46.742450] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-31T17:49:46.754165] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-31T17:49:48.664265] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-31T17:49:48.677412] [INFO ] [REMOTE ] CAVA: Full fetch complete (77494 records). [2025-10-31T17:49:48.677596] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-31T17:49:49.069439] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-31T17:49:49.069523] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-31T17:49:49.070375] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-31T17:49:49.070445] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-31T17:49:49.071980] [DEBUG] [LOCAL ] CAVA: Trimmed 77494 records to 54312 (keeping 200 days of data) [2025-10-31T17:49:49.385242] [DEBUG] [LOCAL ] CAVA: Primary data saved (54312 records). [2025-10-31T17:49:49.385370] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-31T17:49:49.386687] [INFO ] [MAIN ] Update Progress: 400/2365 symbols completed. CAVA took 21.6s. Estimated remaining: 4h 4m 24s. Rate: 8.0 symbols/min [2025-10-31T17:49:50.037782] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:49:49.974468] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:49:50.083147] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:49:50.114249] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:49:50.127935] [DEBUG] [LOCAL ] CBAN: Loaded 10021 existing records from primary storage. [2025-10-31T17:49:50.123611] [DEBUG] [LOCAL ] CBNA: Loaded 2767 existing records from primary storage. [2025-10-31T17:49:50.128497] [INFO ] [MAIN ] CBNA: Loaded 2767 existing records. [2025-10-31T17:49:50.128293] [INFO ] [MAIN ] CBAN: Loaded 10021 existing records. [2025-10-31T17:49:50.350250] [DEBUG] [LOCAL ] CBL: Loaded 15628 existing records from primary storage. [2025-10-31T17:49:50.373389] [INFO ] [MAIN ] CBL: Loaded 15628 existing records. [2025-10-31T17:49:50.573286] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:49:50.550531] [DEBUG] [LOCAL ] CB: Loaded 50283 existing records from primary storage. [2025-10-31T17:49:50.609721] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-31T17:49:50.609988] [INFO ] [MAIN ] CB: Loaded 50283 existing records. [2025-10-31T17:49:50.626449] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:49:50.620357] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-31T17:49:50.681307] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-31T17:49:50.720191] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-31T17:49:50.720298] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-31T17:49:50.720598] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-31T17:49:50.742006] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-31T17:49:50.762768] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-31T17:49:50.985872] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:49:51.069082] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-31T17:49:51.100881] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-31T17:49:51.139386] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:49:51.153562] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-31T17:49:51.188411] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-31T17:49:51.172822] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-31T17:49:51.216256] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-31T17:49:51.227432] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-31T17:49:51.259086] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-31T17:49:51.971846] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:49:52.060540] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-31T17:49:52.250072] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:49:52.285519] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-31T17:49:52.464895] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:49:52.469995] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-31T17:49:52.469579] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:49:52.471112] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-31T17:49:52.734710] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-31T17:49:52.736247] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-31T17:49:52.786482] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T17:49:52.789464] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-31T17:49:53.051268] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T17:49:53.052552] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-31T17:49:53.339486] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-31T17:49:53.340690] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-31T17:49:53.366782] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-31T17:49:53.371395] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-31T17:49:53.515676] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-31T17:49:53.518707] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-31T17:49:53.660815] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-31T17:49:53.662167] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-31T17:49:53.896602] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T17:49:53.908712] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-31T17:49:54.007374] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T17:49:54.011900] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-31T17:49:54.028258] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-31T17:49:54.029765] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-31T17:49:54.049523] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-31T17:49:54.053877] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-31T17:49:54.379680] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-31T17:49:54.651979] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T17:49:54.657597] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-31T17:49:54.791778] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T17:49:55.006707] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T17:49:55.147375] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T17:49:55.457719] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-31T17:49:56.257734] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-31T17:49:56.274866] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-31T17:49:56.566332] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-31T17:49:57.057669] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-31T17:49:57.668870] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-31T17:49:57.857634] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-31T17:49:58.657738] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-31T17:49:59.002738] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-31T17:49:59.159831] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:49:59.457739] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-31T17:50:00.085823] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-31T17:50:00.257623] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-31T17:50:00.550604] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-31T17:50:01.057721] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-31T17:50:01.757515] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T17:50:01.857678] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-31T17:50:02.645166] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-31T17:50:02.657634] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-31T17:50:03.189536] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T17:50:03.457684] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-31T17:50:03.985751] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T17:50:03.986816] [INFO ] [REMOTE ] CBNA: Full fetch complete (4141 records). [2025-10-31T17:50:03.986913] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-31T17:50:03.987376] [FATAL] [VALIDATOR ] CBNA: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:50:03.987463] [FATAL] [MAIN ] CBNA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:50:03.987508] [WARN ] [MAIN ] CBNA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:50:03.987548] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-31T17:50:03.987604] [DEBUG] [LOCAL ] CBNA: No primary data file found to delete. [2025-10-31T17:50:03.987679] [INFO ] [LOCAL ] CBNA: Starting deletion of derivative data. [2025-10-31T17:50:03.987962] [DEBUG] [LOCAL ] CBNA: Deleted derivative data file. [2025-10-31T17:50:03.988072] [INFO ] [MAIN ] Update Progress: 401/2365 symbols completed. CBNA took 14.6s. Estimated remaining: 4h 4m 52s. Rate: 8.0 symbols/min [2025-10-31T17:50:04.167308] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:04.167578] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-31T17:50:04.167630] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-31T17:50:04.167761] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-31T17:50:04.167803] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-31T17:50:04.167844] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-31T17:50:04.167904] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-31T17:50:04.263321] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-31T17:50:04.516100] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:05.057677] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-31T17:50:05.105447] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T17:50:05.200637] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:50:05.201017] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-31T17:50:05.201107] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:50:05.201161] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-31T17:50:05.201222] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:50:05.201295] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-31T17:50:05.201380] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-31T17:50:05.201426] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-31T17:50:05.201468] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-31T17:50:05.201513] [INFO ] [MAIN ] Update Progress: 402/2365 symbols completed. CBO took 1.2s. Estimated remaining: 4h 4m 13s. Rate: 8.0 symbols/min [2025-10-31T17:50:05.414830] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:05.475096] [DEBUG] [LOCAL ] CBRE: Loaded 50598 existing records from primary storage. [2025-10-31T17:50:05.475411] [INFO ] [MAIN ] CBRE: Loaded 50598 existing records. [2025-10-31T17:50:05.692201] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:50:05.692425] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-31T17:50:05.692473] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-31T17:50:05.692730] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-31T17:50:05.692788] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-31T17:50:05.873480] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-31T17:50:06.119743] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:06.657709] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-31T17:50:06.891306] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T17:50:07.110932] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-31T17:50:07.457629] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-31T17:50:08.116966] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-31T17:50:08.119685] [INFO ] [REMOTE ] CBAN: Full fetch complete (16372 records). [2025-10-31T17:50:08.119757] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-31T17:50:08.264833] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-31T17:50:08.473301] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-31T17:50:08.473379] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-31T17:50:08.473752] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-31T17:50:08.473814] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-31T17:50:08.474304] [DEBUG] [LOCAL ] CBAN: Trimmed 16372 records to 10075 (keeping 200 days of data) [2025-10-31T17:50:08.533739] [DEBUG] [LOCAL ] CBAN: Primary data saved (10075 records). [2025-10-31T17:50:08.533866] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-31T17:50:08.533941] [INFO ] [MAIN ] Update Progress: 403/2365 symbols completed. CBAN took 19.1s. Estimated remaining: 4h 3m 46s. Rate: 8.0 symbols/min [2025-10-31T17:50:08.698409] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:08.734575] [DEBUG] [LOCAL ] CBT: Loaded 30675 existing records from primary storage. [2025-10-31T17:50:08.734905] [INFO ] [MAIN ] CBT: Loaded 30675 existing records. [2025-10-31T17:50:08.912189] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:50:08.912445] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-31T17:50:08.912496] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-31T17:50:08.912911] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-31T17:50:08.912969] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-31T17:50:09.067982] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-31T17:50:09.264486] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:09.721751] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T17:50:09.783372] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-31T17:50:09.857604] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-31T17:50:10.657690] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-31T17:50:10.896275] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T17:50:10.901111] [INFO ] [REMOTE ] CBL: Full fetch complete (24275 records). [2025-10-31T17:50:10.901246] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-31T17:50:11.305390] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-31T17:50:11.305472] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-31T17:50:11.305923] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-31T17:50:11.305987] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-31T17:50:11.306693] [DEBUG] [LOCAL ] CBL: Trimmed 24275 records to 15678 (keeping 200 days of data) [2025-10-31T17:50:11.402385] [DEBUG] [LOCAL ] CBL: Primary data saved (15678 records). [2025-10-31T17:50:11.402521] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-31T17:50:11.402602] [INFO ] [MAIN ] Update Progress: 404/2365 symbols completed. CBL took 22.0s. Estimated remaining: 4h 3m 16s. Rate: 8.1 symbols/min [2025-10-31T17:50:11.466516] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-31T17:50:11.575241] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:11.597094] [DEBUG] [LOCAL ] CBU: Loaded 22387 existing records from primary storage. [2025-10-31T17:50:11.597343] [INFO ] [MAIN ] CBU: Loaded 22387 existing records. [2025-10-31T17:50:11.784053] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:50:11.784287] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-31T17:50:11.784334] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-31T17:50:11.784598] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-31T17:50:11.784684] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-31T17:50:12.142715] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:12.169106] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-31T17:50:12.257623] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-31T17:50:13.057626] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-31T17:50:13.298525] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T17:50:13.488475] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-31T17:50:13.857682] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-31T17:50:14.280601] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:50:14.657673] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-31T17:50:15.149789] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T17:50:15.457665] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-31T17:50:16.257688] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-31T17:50:16.846235] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-31T17:50:17.057691] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-31T17:50:17.387079] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:50:17.417917] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-31T17:50:17.857665] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-31T17:50:18.289423] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T17:50:18.657690] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-31T17:50:19.016791] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T17:50:19.439319] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-31T17:50:19.457606] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-31T17:50:20.257700] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-31T17:50:20.348167] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T17:50:21.057702] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-31T17:50:21.168047] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-31T17:50:21.857707] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-31T17:50:22.322921] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T17:50:22.666180] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-31T17:50:22.672961] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-31T17:50:23.457671] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-31T17:50:23.548578] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:50:24.257741] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-31T17:50:24.584893] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-31T17:50:25.057735] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-31T17:50:25.797929] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-31T17:50:25.857618] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-31T17:50:26.182637] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T17:50:26.657752] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-31T17:50:27.114452] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T17:50:27.312802] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-31T17:50:27.457680] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-31T17:50:28.257693] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-31T17:50:28.505030] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T17:50:29.057721] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-31T17:50:29.549476] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T17:50:29.857692] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-31T17:50:30.281910] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T17:50:30.544106] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T17:50:30.657683] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-31T17:50:31.457690] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-31T17:50:32.101201] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-31T17:50:32.257701] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-31T17:50:32.382135] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-31T17:50:32.393566] [INFO ] [REMOTE ] CBRE: Full fetch complete (73319 records). [2025-10-31T17:50:32.393781] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-31T17:50:32.394585] [FATAL] [VALIDATOR ] CBRE: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:50:32.394701] [FATAL] [MAIN ] CBRE: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:50:32.394750] [WARN ] [MAIN ] CBRE: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:50:32.394789] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-31T17:50:32.394844] [DEBUG] [LOCAL ] CBRE: No primary data file found to delete. [2025-10-31T17:50:32.394885] [INFO ] [LOCAL ] CBRE: Starting deletion of derivative data. [2025-10-31T17:50:32.395057] [DEBUG] [LOCAL ] CBRE: Deleted derivative data file. [2025-10-31T17:50:32.396048] [INFO ] [MAIN ] Update Progress: 405/2365 symbols completed. CBRE took 27.2s. Estimated remaining: 4h 4m 14s. Rate: 8.0 symbols/min [2025-10-31T17:50:32.564048] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:32.564228] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-31T17:50:32.564265] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-31T17:50:32.564371] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-31T17:50:32.564410] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-31T17:50:32.564450] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-31T17:50:32.564480] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-31T17:50:32.910428] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:33.057613] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-31T17:50:33.135904] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T17:50:33.212481] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:50:33.212816] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-31T17:50:33.212885] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:50:33.212947] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-31T17:50:33.212992] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:50:33.213028] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-31T17:50:33.213080] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-31T17:50:33.213113] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-31T17:50:33.213149] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-31T17:50:33.213192] [INFO ] [MAIN ] Update Progress: 406/2365 symbols completed. CBX took 0.8s. Estimated remaining: 4h 3m 35s. Rate: 8.0 symbols/min [2025-10-31T17:50:33.380183] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:33.417017] [DEBUG] [LOCAL ] CBZ: Loaded 34683 existing records from primary storage. [2025-10-31T17:50:33.417306] [INFO ] [MAIN ] CBZ: Loaded 34683 existing records. [2025-10-31T17:50:33.589006] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:50:33.589221] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-31T17:50:33.589267] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-31T17:50:33.589446] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-31T17:50:33.589484] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-31T17:50:33.857684] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-31T17:50:33.934882] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:34.657625] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-31T17:50:34.903808] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-31T17:50:35.457630] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-31T17:50:35.623813] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T17:50:35.937676] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-31T17:50:35.950464] [INFO ] [REMOTE ] CB: Full fetch complete (72814 records). [2025-10-31T17:50:35.950729] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-31T17:50:36.262905] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-31T17:50:36.403018] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-31T17:50:36.403132] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-31T17:50:36.404082] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-31T17:50:36.404151] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-31T17:50:36.406048] [DEBUG] [LOCAL ] CB: Trimmed 72814 records to 50639 (keeping 200 days of data) [2025-10-31T17:50:36.754852] [DEBUG] [LOCAL ] CB: Primary data saved (50639 records). [2025-10-31T17:50:36.755052] [INFO ] [MAIN ] CB: Full history saved. [2025-10-31T17:50:36.755162] [INFO ] [MAIN ] Update Progress: 407/2365 symbols completed. CB took 47.4s. Estimated remaining: 4h 3m 8s. Rate: 8.1 symbols/min [2025-10-31T17:50:36.938822] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:36.939093] [DEBUG] [LOCAL ] CC: No existing data file found in primary storage. [2025-10-31T17:50:36.939134] [WARN ] [MAIN ] CC: No existing data found, performing full refresh instead. [2025-10-31T17:50:36.939261] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-31T17:50:36.939304] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-31T17:50:36.939347] [DEBUG] [LOCAL ] CC: No primary data file found to delete. [2025-10-31T17:50:36.939382] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-31T17:50:37.062752] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-31T17:50:37.344626] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:37.345854] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T17:50:37.857726] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-31T17:50:38.055969] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T17:50:38.657693] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-31T17:50:39.401927] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-31T17:50:39.428108] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T17:50:39.457611] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-31T17:50:40.230784] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-31T17:50:40.257690] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-31T17:50:41.057619] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-31T17:50:41.125932] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-31T17:50:41.857624] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-31T17:50:41.958705] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T17:50:42.657687] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-31T17:50:43.129181] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T17:50:43.457691] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-31T17:50:43.513450] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-31T17:50:43.522353] [INFO ] [REMOTE ] CBU: Full fetch complete (32611 records). [2025-10-31T17:50:43.522449] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-31T17:50:43.891101] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-31T17:50:43.891182] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-31T17:50:43.891683] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-31T17:50:43.891743] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-31T17:50:43.892450] [DEBUG] [LOCAL ] CBU: Trimmed 32611 records to 22520 (keeping 200 days of data) [2025-10-31T17:50:44.022771] [DEBUG] [LOCAL ] CBU: Primary data saved (22520 records). [2025-10-31T17:50:44.022887] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-31T17:50:44.022967] [INFO ] [MAIN ] Update Progress: 408/2365 symbols completed. CBU took 32.6s. Estimated remaining: 4h 3m 0s. Rate: 8.1 symbols/min [2025-10-31T17:50:44.192789] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:44.240538] [DEBUG] [LOCAL ] CCI: Loaded 53488 existing records from primary storage. [2025-10-31T17:50:44.240864] [INFO ] [MAIN ] CCI: Loaded 53488 existing records. [2025-10-31T17:50:44.262814] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-31T17:50:44.427963] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:50:44.428192] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-31T17:50:44.428246] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-31T17:50:44.428444] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-31T17:50:44.428500] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-31T17:50:44.791436] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:44.812828] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T17:50:44.820882] [INFO ] [REMOTE ] CBT: Full fetch complete (45792 records). [2025-10-31T17:50:44.820999] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-31T17:50:45.062853] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-31T17:50:45.224259] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-31T17:50:45.224356] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-31T17:50:45.225164] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-31T17:50:45.225256] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-31T17:50:45.226298] [DEBUG] [LOCAL ] CBT: Trimmed 45792 records to 30966 (keeping 200 days of data) [2025-10-31T17:50:45.421036] [DEBUG] [LOCAL ] CBT: Primary data saved (30966 records). [2025-10-31T17:50:45.421220] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-31T17:50:45.422684] [INFO ] [MAIN ] Update Progress: 409/2365 symbols completed. CBT took 36.9s. Estimated remaining: 4h 2m 24s. Rate: 8.1 symbols/min [2025-10-31T17:50:45.620728] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:50:45.628635] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-31T17:50:45.628738] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-31T17:50:45.630186] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T17:50:45.630317] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-31T17:50:45.630456] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-31T17:50:45.638558] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-31T17:50:45.638617] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-31T17:50:45.868025] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-31T17:50:45.991805] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:50:46.375824] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T17:50:46.657619] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-31T17:50:46.733003] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-31T17:50:47.457697] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-31T17:50:48.067070] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T17:50:48.257677] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-31T17:50:48.618889] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-31T17:50:48.875705] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T17:50:49.057660] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-31T17:50:49.857691] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-31T17:50:50.102099] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-31T17:50:50.374255] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T17:50:50.657676] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-31T17:50:50.898626] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-31T17:50:51.457695] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-31T17:50:51.744313] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-31T17:50:52.257726] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-31T17:50:53.057749] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-31T17:50:53.695623] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T17:50:53.857698] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-31T17:50:54.180233] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:50:54.657624] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-31T17:50:55.250591] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-31T17:50:55.457628] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-31T17:50:55.610781] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-31T17:50:56.257667] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-31T17:50:56.789740] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T17:50:57.057624] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-31T17:50:57.232519] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T17:50:57.857669] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-31T17:50:58.169530] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-31T17:50:58.444435] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T17:50:58.657685] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-31T17:50:59.457668] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-31T17:50:59.686778] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T17:51:00.257679] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-31T17:51:01.004400] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T17:51:01.057704] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-31T17:51:01.465309] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-31T17:51:01.766438] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-31T17:51:01.857727] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-31T17:51:02.657683] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-31T17:51:03.083525] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T17:51:03.457822] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-31T17:51:03.922445] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T17:51:03.932219] [INFO ] [REMOTE ] CBZ: Full fetch complete (47257 records). [2025-10-31T17:51:03.932348] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-31T17:51:04.266566] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-31T17:51:04.373094] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-31T17:51:04.373171] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-31T17:51:04.373998] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-31T17:51:04.374062] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-31T17:51:04.375302] [DEBUG] [LOCAL ] CBZ: Trimmed 47257 records to 34990 (keeping 200 days of data) [2025-10-31T17:51:04.590811] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-31T17:51:04.602077] [DEBUG] [LOCAL ] CBZ: Primary data saved (34990 records). [2025-10-31T17:51:04.604833] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-31T17:51:04.606127] [INFO ] [MAIN ] Update Progress: 410/2365 symbols completed. CBZ took 31.4s. Estimated remaining: 4h 3m 12s. Rate: 8.0 symbols/min [2025-10-31T17:51:04.788819] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:51:04.789172] [DEBUG] [LOCAL ] CCIF: No existing data file found in primary storage. [2025-10-31T17:51:04.789282] [WARN ] [MAIN ] CCIF: No existing data found, performing full refresh instead. [2025-10-31T17:51:04.789467] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-31T17:51:04.789534] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-31T17:51:04.789624] [DEBUG] [LOCAL ] CCIF: No primary data file found to delete. [2025-10-31T17:51:04.789923] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-31T17:51:05.059469] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-31T17:51:05.160586] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:51:05.191729] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-31T17:51:05.857712] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-31T17:51:06.263387] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-31T17:51:06.657624] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-31T17:51:06.760624] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-31T17:51:06.772715] [INFO ] [REMOTE ] CC: Full fetch complete (76239 records). [2025-10-31T17:51:06.772841] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-31T17:51:07.167159] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-31T17:51:07.167234] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-31T17:51:07.168038] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-31T17:51:07.168100] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-31T17:51:07.169476] [DEBUG] [LOCAL ] CC: Trimmed 76239 records to 53720 (keeping 200 days of data) [2025-10-31T17:51:07.462351] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-31T17:51:07.486519] [DEBUG] [LOCAL ] CC: Primary data saved (53720 records). [2025-10-31T17:51:07.486609] [INFO ] [MAIN ] CC: Full history saved. [2025-10-31T17:51:07.486709] [INFO ] [MAIN ] Update Progress: 411/2365 symbols completed. CC took 30.7s. Estimated remaining: 4h 2m 43s. Rate: 8.1 symbols/min [2025-10-31T17:51:07.656092] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:51:07.656234] [DEBUG] [LOCAL ] CCJ: No existing data file found in primary storage. [2025-10-31T17:51:07.656273] [WARN ] [MAIN ] CCJ: No existing data found, performing full refresh instead. [2025-10-31T17:51:07.656381] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-31T17:51:07.656422] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-31T17:51:07.656464] [DEBUG] [LOCAL ] CCJ: No primary data file found to delete. [2025-10-31T17:51:07.656502] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-31T17:51:08.018313] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:51:08.047325] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-31T17:51:08.213609] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T17:51:08.257630] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-31T17:51:08.521717] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-31T17:51:09.057732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-31T17:51:09.488077] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-31T17:51:09.489297] [INFO ] [REMOTE ] CCIA: Full fetch complete (2200 records). [2025-10-31T17:51:09.489366] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-31T17:51:09.664941] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-31T17:51:09.665150] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:51:09.665226] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:51:09.665274] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-31T17:51:09.665331] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-31T17:51:09.665364] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-31T17:51:09.665402] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-31T17:51:09.665455] [INFO ] [MAIN ] Update Progress: 412/2365 symbols completed. CCIA took 24.2s. Estimated remaining: 4h 2m 11s. Rate: 8.1 symbols/min [2025-10-31T17:51:09.838795] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:51:09.863793] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-31T17:51:09.885109] [DEBUG] [LOCAL ] CCK: Loaded 46787 existing records from primary storage. [2025-10-31T17:51:09.885430] [INFO ] [MAIN ] CCK: Loaded 46787 existing records. [2025-10-31T17:51:10.063469] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:51:10.063810] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-31T17:51:10.063862] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-31T17:51:10.064222] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-31T17:51:10.064279] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-31T17:51:10.424237] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:51:10.657697] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-31T17:51:11.457696] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-31T17:51:11.617625] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-31T17:51:12.063496] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T17:51:12.257701] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-31T17:51:12.723061] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T17:51:13.057718] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-31T17:51:13.557841] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T17:51:13.707432] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T17:51:13.857696] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-31T17:51:14.509299] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T17:51:14.657675] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-31T17:51:15.305598] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T17:51:15.457696] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-31T17:51:16.257700] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-31T17:51:16.921832] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T17:51:16.941834] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T17:51:17.057621] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-31T17:51:17.857736] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-31T17:51:18.526527] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T17:51:18.585039] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T17:51:18.657612] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-31T17:51:19.457680] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-31T17:51:20.006567] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-31T17:51:20.257629] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-31T17:51:20.299770] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T17:51:21.057683] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-31T17:51:21.616577] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T17:51:21.857637] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-31T17:51:22.233783] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T17:51:22.558148] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T17:51:22.657732] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-31T17:51:23.358455] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T17:51:23.457615] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-31T17:51:24.257673] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-31T17:51:24.389992] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T17:51:24.393616] [INFO ] [REMOTE ] CCIF: Full fetch complete (21843 records). [2025-10-31T17:51:24.393727] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-31T17:51:24.802199] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-31T17:51:24.802379] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-31T17:51:24.802838] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-31T17:51:24.802900] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-31T17:51:24.803474] [DEBUG] [LOCAL ] CCIF: Trimmed 21843 records to 15303 (keeping 200 days of data) [2025-10-31T17:51:24.902589] [DEBUG] [LOCAL ] CCIF: Primary data saved (15303 records). [2025-10-31T17:51:24.902762] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-31T17:51:24.902841] [INFO ] [MAIN ] Update Progress: 413/2365 symbols completed. CCIF took 20.3s. Estimated remaining: 4h 2m 40s. Rate: 8.0 symbols/min [2025-10-31T17:51:25.070596] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-31T17:51:25.073391] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:51:25.112992] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-31T17:51:25.126771] [INFO ] [REMOTE ] CCI: Full fetch complete (77097 records). [2025-10-31T17:51:25.126922] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-31T17:51:25.478284] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-31T17:51:25.488356] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-10-31T17:51:25.695265] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-31T17:51:25.700479] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-31T17:51:25.706606] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-31T17:51:25.729430] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-31T17:51:25.765070] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:51:25.765391] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-31T17:51:25.765620] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-31T17:51:25.765990] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-31T17:51:25.765934] [DEBUG] [LOCAL ] CCI: Trimmed 77097 records to 53876 (keeping 200 days of data) [2025-10-31T17:51:25.766070] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-31T17:51:25.904871] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-31T17:51:26.367449] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:51:26.483880] [DEBUG] [LOCAL ] CCI: Primary data saved (53876 records). [2025-10-31T17:51:26.484084] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-31T17:51:26.484200] [INFO ] [MAIN ] Update Progress: 414/2365 symbols completed. CCI took 42.5s. Estimated remaining: 4h 2m 5s. Rate: 8.1 symbols/min [2025-10-31T17:51:26.667429] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-31T17:51:26.692217] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:51:26.697114] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-31T17:51:26.758158] [DEBUG] [LOCAL ] CCO: Loaded 49070 existing records from primary storage. [2025-10-31T17:51:26.758542] [INFO ] [MAIN ] CCO: Loaded 49070 existing records. [2025-10-31T17:51:26.936037] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:51:26.936261] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-31T17:51:26.936309] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-31T17:51:26.936742] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-31T17:51:26.936797] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-31T17:51:27.292720] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:51:27.457617] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-31T17:51:27.673338] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-31T17:51:28.257690] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-31T17:51:28.513910] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-31T17:51:28.656010] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T17:51:29.057719] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-31T17:51:29.509941] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T17:51:29.857672] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-31T17:51:30.485159] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-31T17:51:30.657690] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-31T17:51:31.019561] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T17:51:31.457635] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-31T17:51:32.257722] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-31T17:51:32.589669] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-31T17:51:32.637793] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T17:51:33.057665] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-31T17:51:33.200117] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T17:51:33.857673] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-31T17:51:34.261297] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T17:51:34.657730] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-31T17:51:35.457698] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-31T17:51:35.715383] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-31T17:51:36.238631] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-31T17:51:36.257608] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-31T17:51:36.673792] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T17:51:37.057634] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-31T17:51:37.857665] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-31T17:51:38.033228] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-31T17:51:38.229505] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T17:51:38.657735] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-31T17:51:39.076941] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:51:39.457691] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-31T17:51:40.257698] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-31T17:51:40.391600] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-31T17:51:40.852980] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T17:51:40.865479] [INFO ] [REMOTE ] CCK: Full fetch complete (68132 records). [2025-10-31T17:51:40.865761] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-31T17:51:41.062977] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-31T17:51:41.297784] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-31T17:51:41.297974] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-31T17:51:41.298768] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-31T17:51:41.298876] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-31T17:51:41.300260] [DEBUG] [LOCAL ] CCK: Trimmed 68132 records to 47149 (keeping 200 days of data) [2025-10-31T17:51:41.546688] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T17:51:41.619528] [DEBUG] [LOCAL ] CCK: Primary data saved (47149 records). [2025-10-31T17:51:41.619675] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-31T17:51:41.620262] [INFO ] [MAIN ] Update Progress: 415/2365 symbols completed. CCK took 32.0s. Estimated remaining: 4h 2m 34s. Rate: 8.0 symbols/min [2025-10-31T17:51:41.793444] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:51:41.835144] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-31T17:51:41.855016] [INFO ] [REMOTE ] CCJ: Full fetch complete (77843 records). [2025-10-31T17:51:41.855187] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-31T17:51:41.867085] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-31T17:51:41.970277] [DEBUG] [LOCAL ] CCS: Loaded 29960 existing records from primary storage. [2025-10-31T17:51:41.971155] [INFO ] [MAIN ] CCS: Loaded 29960 existing records. [2025-10-31T17:51:42.343841] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:51:42.365068] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-31T17:51:42.399422] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-31T17:51:42.416144] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-31T17:51:42.456295] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-31T17:51:42.460006] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-31T17:51:42.502706] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-31T17:51:42.535926] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-31T17:51:42.552191] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-31T17:51:42.602401] [DEBUG] [LOCAL ] CCJ: Trimmed 77843 records to 54471 (keeping 200 days of data) [2025-10-31T17:51:42.711148] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-31T17:51:43.061447] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:51:43.158284] [DEBUG] [LOCAL ] CCJ: Primary data saved (54471 records). [2025-10-31T17:51:43.158439] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-31T17:51:43.158516] [INFO ] [MAIN ] Update Progress: 416/2365 symbols completed. CCJ took 35.7s. Estimated remaining: 4h 1m 58s. Rate: 8.1 symbols/min [2025-10-31T17:51:43.328264] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:51:43.350254] [DEBUG] [LOCAL ] CCU: Loaded 20999 existing records from primary storage. [2025-10-31T17:51:43.350516] [INFO ] [MAIN ] CCU: Loaded 20999 existing records. [2025-10-31T17:51:43.462898] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-31T17:51:43.545123] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:51:43.545342] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-31T17:51:43.545391] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-31T17:51:43.545560] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-31T17:51:43.545599] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-31T17:51:43.925542] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:51:43.970142] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-31T17:51:44.007845] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T17:51:44.257686] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-31T17:51:44.627479] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T17:51:45.062733] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-31T17:51:45.071239] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T17:51:45.857639] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-31T17:51:46.263979] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T17:51:46.453305] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-31T17:51:46.657686] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-31T17:51:47.457702] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-31T17:51:48.257698] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-31T17:51:48.427797] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T17:51:48.666412] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-31T17:51:49.057712] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-31T17:51:49.618886] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T17:51:49.857701] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-31T17:51:50.657693] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-31T17:51:50.721108] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-31T17:51:50.765142] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-31T17:51:51.457629] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-31T17:51:51.557818] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T17:51:52.257686] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-31T17:51:52.522500] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T17:51:53.057703] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-31T17:51:53.219348] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-31T17:51:53.857698] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-31T17:51:54.158952] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T17:51:54.657703] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-31T17:51:55.457613] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-31T17:51:55.574518] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T17:51:55.773275] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-31T17:51:56.257681] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-31T17:51:56.804072] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-31T17:51:56.815632] [INFO ] [REMOTE ] CCO: Full fetch complete (67647 records). [2025-10-31T17:51:56.815829] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-31T17:51:57.063974] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-31T17:51:57.218696] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-31T17:51:57.218784] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-31T17:51:57.219539] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-31T17:51:57.219579] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-31T17:51:57.220847] [DEBUG] [LOCAL ] CCO: Trimmed 67647 records to 49436 (keeping 200 days of data) [2025-10-31T17:51:57.487552] [DEBUG] [LOCAL ] CCO: Primary data saved (49436 records). [2025-10-31T17:51:57.487707] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-31T17:51:57.487793] [INFO ] [MAIN ] Update Progress: 417/2365 symbols completed. CCO took 31.0s. Estimated remaining: 4h 2m 23s. Rate: 8.0 symbols/min [2025-10-31T17:51:57.654826] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:51:57.655002] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-31T17:51:57.655037] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-31T17:51:57.655179] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-31T17:51:57.655220] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-31T17:51:57.655280] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-31T17:51:57.655326] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-31T17:51:57.869370] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-31T17:51:58.015551] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:51:58.048080] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-31T17:51:58.073979] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-31T17:51:58.657679] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-31T17:51:58.795583] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-31T17:51:59.457724] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-31T17:51:59.489362] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T17:51:59.786733] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-31T17:52:00.257674] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-31T17:52:00.470951] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-31T17:52:01.057682] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-31T17:52:01.857694] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-31T17:52:02.029622] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.17 seconds). [2025-10-31T17:52:02.059927] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-31T17:52:02.657730] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-31T17:52:03.457737] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-31T17:52:04.251510] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-31T17:52:04.257791] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-31T17:52:04.304883] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-31T17:52:04.942958] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T17:52:05.057717] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-31T17:52:05.857699] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-31T17:52:05.908224] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-31T17:52:06.449185] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T17:52:06.461935] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-31T17:52:06.462077] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-31T17:52:06.662625] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-31T17:52:06.896403] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-31T17:52:06.896484] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-31T17:52:06.897367] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-31T17:52:06.897433] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-31T17:52:06.898886] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 54580 (keeping 200 days of data) [2025-10-31T17:52:07.075186] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-31T17:52:07.227115] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-10-31T17:52:07.227245] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-31T17:52:07.227993] [INFO ] [MAIN ] Update Progress: 418/2365 symbols completed. CCL took 42.3s. Estimated remaining: 4h 2m 26s. Rate: 8.0 symbols/min [2025-10-31T17:52:07.393081] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:52:07.452506] [DEBUG] [LOCAL ] CDE: Loaded 54034 existing records from primary storage. [2025-10-31T17:52:07.452842] [INFO ] [MAIN ] CDE: Loaded 54034 existing records. [2025-10-31T17:52:07.463558] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-31T17:52:07.629018] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:52:07.629278] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-31T17:52:07.629333] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-31T17:52:07.629624] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-31T17:52:07.629714] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-31T17:52:07.987105] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:52:08.257637] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-31T17:52:08.435228] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.18 seconds). [2025-10-31T17:52:08.589279] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-31T17:52:09.057696] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-31T17:52:09.832299] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T17:52:09.857618] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-31T17:52:10.545146] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-31T17:52:10.657719] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-31T17:52:10.933332] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:52:10.933633] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-31T17:52:10.933741] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:52:10.933814] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-31T17:52:10.933849] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:52:10.933909] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-31T17:52:10.933963] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-31T17:52:10.933997] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-31T17:52:10.934036] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-31T17:52:10.934080] [INFO ] [MAIN ] Update Progress: 419/2365 symbols completed. CCZ took 13.4s. Estimated remaining: 4h 2m 1s. Rate: 8.0 symbols/min [2025-10-31T17:52:11.098049] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:52:11.109132] [DEBUG] [LOCAL ] CDLR: Loaded 10285 existing records from primary storage. [2025-10-31T17:52:11.109298] [INFO ] [MAIN ] CDLR: Loaded 10285 existing records. [2025-10-31T17:52:11.299892] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:52:11.300116] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-31T17:52:11.300161] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-31T17:52:11.300306] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-31T17:52:11.300342] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-31T17:52:11.460395] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-31T17:52:11.659720] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:52:12.257692] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-31T17:52:12.410419] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-31T17:52:12.415307] [INFO ] [REMOTE ] CCU: Full fetch complete (32081 records). [2025-10-31T17:52:12.415405] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-31T17:52:12.800134] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-31T17:52:12.800231] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-31T17:52:12.800767] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-31T17:52:12.800831] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-31T17:52:12.801695] [DEBUG] [LOCAL ] CCU: Trimmed 32081 records to 21108 (keeping 200 days of data) [2025-10-31T17:52:12.941685] [DEBUG] [LOCAL ] CCU: Primary data saved (21108 records). [2025-10-31T17:52:12.941821] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-31T17:52:12.941931] [INFO ] [MAIN ] Update Progress: 420/2365 symbols completed. CCU took 29.8s. Estimated remaining: 4h 1m 28s. Rate: 8.1 symbols/min [2025-10-31T17:52:13.062871] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-31T17:52:13.114479] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:52:13.152489] [DEBUG] [LOCAL ] CDP: Loaded 42455 existing records from primary storage. [2025-10-31T17:52:13.152825] [INFO ] [MAIN ] CDP: Loaded 42455 existing records. [2025-10-31T17:52:13.325484] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:52:13.325736] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-31T17:52:13.325788] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-31T17:52:13.326142] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-31T17:52:13.326198] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-31T17:52:13.685844] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:52:13.687312] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T17:52:13.785424] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-31T17:52:13.857620] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-31T17:52:14.657711] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-31T17:52:14.959822] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-31T17:52:15.178584] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T17:52:15.457686] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-31T17:52:16.257674] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-31T17:52:16.933002] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T17:52:17.057697] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-31T17:52:17.296069] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T17:52:17.857716] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-31T17:52:18.422376] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T17:52:18.657734] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-31T17:52:18.763256] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T17:52:19.457680] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-31T17:52:19.793497] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:52:19.803556] [INFO ] [REMOTE ] CCS: Full fetch complete (44757 records). [2025-10-31T17:52:19.803790] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-31T17:52:20.174610] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-31T17:52:20.174719] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-31T17:52:20.175286] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-31T17:52:20.175347] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-31T17:52:20.176354] [DEBUG] [LOCAL ] CCS: Trimmed 44757 records to 30157 (keeping 200 days of data) [2025-10-31T17:52:20.265660] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-31T17:52:20.359061] [DEBUG] [LOCAL ] CCS: Primary data saved (30157 records). [2025-10-31T17:52:20.359191] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-31T17:52:20.360070] [INFO ] [MAIN ] Update Progress: 421/2365 symbols completed. CCS took 38.7s. Estimated remaining: 4h 1m 21s. Rate: 8.1 symbols/min [2025-10-31T17:52:20.524590] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:52:20.548300] [DEBUG] [LOCAL ] CDRE: Loaded 24525 existing records from primary storage. [2025-10-31T17:52:20.548536] [INFO ] [MAIN ] CDRE: Loaded 24525 existing records. [2025-10-31T17:52:20.720528] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:52:20.720795] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-31T17:52:20.720849] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-31T17:52:20.721027] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-31T17:52:20.721064] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-31T17:52:21.089789] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:52:21.089882] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-31T17:52:21.125272] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-31T17:52:21.375671] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-31T17:52:21.731639] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-31T17:52:21.857726] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-31T17:52:22.295842] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-31T17:52:22.657704] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-31T17:52:23.201605] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-31T17:52:23.457682] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-31T17:52:24.095552] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-31T17:52:24.257669] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-31T17:52:25.057676] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-31T17:52:25.305973] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T17:52:25.857639] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-31T17:52:26.566515] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T17:52:26.657622] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-31T17:52:26.676621] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:52:27.192572] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T17:52:27.457635] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-31T17:52:28.257684] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-31T17:52:28.632335] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T17:52:29.057699] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-31T17:52:29.686763] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T17:52:29.857668] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-31T17:52:30.177993] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T17:52:30.657683] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-31T17:52:31.161941] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T17:52:31.195261] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T17:52:31.457639] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-31T17:52:32.257697] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-31T17:52:32.850804] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T17:52:33.057632] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-31T17:52:33.133155] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-31T17:52:33.768489] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T17:52:33.857682] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-31T17:52:34.577898] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-31T17:52:34.657630] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-31T17:52:35.457697] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-31T17:52:35.478526] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-31T17:52:36.257679] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-31T17:52:36.530118] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T17:52:36.884779] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T17:52:37.057624] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-31T17:52:37.857675] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-31T17:52:37.912066] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-31T17:52:38.657724] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-31T17:52:39.457725] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-31T17:52:39.826446] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-31T17:52:40.172511] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-31T17:52:40.197398] [INFO ] [REMOTE ] CDE: Full fetch complete (77804 records). [2025-10-31T17:52:40.198163] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-31T17:52:40.198611] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T17:52:40.262799] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-31T17:52:40.609480] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-31T17:52:40.609565] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-31T17:52:40.610429] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-31T17:52:40.610493] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-31T17:52:40.611950] [DEBUG] [LOCAL ] CDE: Trimmed 77804 records to 54424 (keeping 200 days of data) [2025-10-31T17:52:40.917556] [DEBUG] [LOCAL ] CDE: Primary data saved (54424 records). [2025-10-31T17:52:40.917689] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-31T17:52:40.918770] [INFO ] [MAIN ] Update Progress: 422/2365 symbols completed. CDE took 33.7s. Estimated remaining: 4h 2m 14s. Rate: 8.0 symbols/min [2025-10-31T17:52:41.063312] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-31T17:52:41.091490] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:52:41.150781] [DEBUG] [LOCAL ] CE: Loaded 51505 existing records from primary storage. [2025-10-31T17:52:41.161365] [INFO ] [MAIN ] CE: Loaded 51505 existing records. [2025-10-31T17:52:41.208204] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-31T17:52:41.373880] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:52:41.374124] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-31T17:52:41.374174] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-31T17:52:41.374559] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-31T17:52:41.374615] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-31T17:52:41.787951] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:52:41.857634] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-31T17:52:42.039235] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T17:52:42.657688] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-31T17:52:43.198051] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T17:52:43.406422] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T17:52:43.457670] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-31T17:52:44.257669] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-31T17:52:44.684612] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T17:52:44.694398] [INFO ] [REMOTE ] CDP: Full fetch complete (62294 records). [2025-10-31T17:52:44.694503] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-31T17:52:45.066310] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-31T17:52:45.092900] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-31T17:52:45.093014] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-31T17:52:45.093776] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-31T17:52:45.093934] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-31T17:52:45.110028] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T17:52:45.115795] [DEBUG] [LOCAL ] CDP: Trimmed 62294 records to 42808 (keeping 200 days of data) [2025-10-31T17:52:45.116968] [INFO ] [REMOTE ] CDRE: Full fetch complete (34845 records). [2025-10-31T17:52:45.117349] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-31T17:52:45.699088] [DEBUG] [LOCAL ] CDP: Primary data saved (42808 records). [2025-10-31T17:52:45.709516] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-31T17:52:45.714751] [INFO ] [MAIN ] Update Progress: 423/2365 symbols completed. CDP took 32.8s. Estimated remaining: 4h 1m 54s. Rate: 8.0 symbols/min [2025-10-31T17:52:45.859583] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-31T17:52:45.883456] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-31T17:52:45.883535] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-31T17:52:45.884173] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-31T17:52:45.890118] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-31T17:52:45.939229] [DEBUG] [LOCAL ] CDRE: Trimmed 34845 records to 24656 (keeping 200 days of data) [2025-10-31T17:52:45.958529] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:52:46.051812] [DEBUG] [LOCAL ] CEE: Loaded 4835 existing records from primary storage. [2025-10-31T17:52:46.053761] [INFO ] [MAIN ] CEE: Loaded 4835 existing records. [2025-10-31T17:52:46.306038] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:52:46.323963] [DEBUG] [LOCAL ] CDRE: Primary data saved (24656 records). [2025-10-31T17:52:46.324163] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-31T17:52:46.324255] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-31T17:52:46.324320] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-31T17:52:46.324481] [INFO ] [MAIN ] Update Progress: 424/2365 symbols completed. CDRE took 26.0s. Estimated remaining: 4h 1m 15s. Rate: 8.0 symbols/min [2025-10-31T17:52:46.370422] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-31T17:52:46.392708] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-31T17:52:46.618982] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:52:46.857451] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-31T17:52:46.943045] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-31T17:52:46.958079] [DEBUG] [LOCAL ] CEPU: Loaded 27692 existing records from primary storage. [2025-10-31T17:52:46.979770] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:52:46.981596] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T17:52:46.982001] [INFO ] [MAIN ] CEPU: Loaded 27692 existing records. [2025-10-31T17:52:47.019184] [INFO ] [REMOTE ] CDLR: Full fetch complete (14592 records). [2025-10-31T17:52:47.044610] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-31T17:52:47.359370] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:52:47.431145] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-31T17:52:47.442413] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-31T17:52:47.465686] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-31T17:52:47.469227] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-31T17:52:47.470151] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-31T17:52:47.684717] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-31T17:52:47.685144] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-31T17:52:47.691022] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-31T17:52:47.696198] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-31T17:52:47.744570] [DEBUG] [LOCAL ] CDLR: Trimmed 14592 records to 10375 (keeping 200 days of data) [2025-10-31T17:52:47.924666] [DEBUG] [LOCAL ] CDLR: Primary data saved (10375 records). [2025-10-31T17:52:47.930519] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-31T17:52:47.935907] [INFO ] [MAIN ] Update Progress: 425/2365 symbols completed. CDLR took 37.0s. Estimated remaining: 4h 0m 41s. Rate: 8.1 symbols/min [2025-10-31T17:52:48.094954] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:52:48.116437] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-31T17:52:48.187911] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:52:48.188100] [DEBUG] [LOCAL ] CF: No existing data file found in primary storage. [2025-10-31T17:52:48.188173] [WARN ] [MAIN ] CF: No existing data found, performing full refresh instead. [2025-10-31T17:52:48.188435] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-31T17:52:48.188527] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-31T17:52:48.188775] [DEBUG] [LOCAL ] CF: No primary data file found to delete. [2025-10-31T17:52:48.188850] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-31T17:52:48.262530] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-31T17:52:48.556100] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-31T17:52:48.575782] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:52:48.807027] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T17:52:49.057709] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-31T17:52:49.857723] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-31T17:52:50.070833] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T17:52:50.657725] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-31T17:52:51.253887] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T17:52:51.457711] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-31T17:52:51.993890] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T17:52:52.257731] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-31T17:52:52.557423] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T17:52:52.987440] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-31T17:52:53.057664] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-31T17:52:53.791903] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-31T17:52:53.857629] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-31T17:52:54.657688] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-31T17:52:54.676581] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-31T17:52:55.307459] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T17:52:55.457749] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-31T17:52:56.257720] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-31T17:52:56.728633] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T17:52:56.747169] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-31T17:52:57.057718] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-31T17:52:57.857717] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-31T17:52:58.657622] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-31T17:52:58.696169] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-31T17:52:59.194460] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-31T17:52:59.198778] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T17:52:59.457620] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-31T17:52:59.835025] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-31T17:53:00.257692] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-31T17:53:01.057669] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-31T17:53:01.365034] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T17:53:01.857697] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-31T17:53:02.183912] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:53:02.657692] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-31T17:53:03.037082] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-31T17:53:03.185718] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T17:53:03.457664] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-31T17:53:04.234528] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-31T17:53:04.257617] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-31T17:53:05.057620] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-31T17:53:05.520434] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-31T17:53:05.857630] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-31T17:53:06.276849] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T17:53:06.580605] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T17:53:06.657740] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-31T17:53:07.459351] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-31T17:53:07.463309] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T17:53:08.257745] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-31T17:53:08.654706] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T17:53:08.738913] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T17:53:09.057695] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-31T17:53:09.857696] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-31T17:53:09.933786] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-31T17:53:10.311264] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-31T17:53:10.657690] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-31T17:53:11.457734] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-31T17:53:12.117976] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-31T17:53:12.257710] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-31T17:53:12.924264] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T17:53:13.057753] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-31T17:53:13.462201] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-31T17:53:13.463436] [INFO ] [REMOTE ] CEE: Full fetch complete (9872 records). [2025-10-31T17:53:13.463510] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-31T17:53:13.872022] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-31T17:53:13.873990] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T17:53:13.865474] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-31T17:53:13.872399] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-31T17:53:13.883276] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-31T17:53:13.883989] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-31T17:53:13.884187] [INFO ] [REMOTE ] CEPU: Full fetch complete (40008 records). [2025-10-31T17:53:13.884737] [DEBUG] [LOCAL ] CEE: Trimmed 9872 records to 4846 (keeping 200 days of data) [2025-10-31T17:53:13.884823] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-31T17:53:14.028917] [DEBUG] [LOCAL ] CEE: Primary data saved (4846 records). [2025-10-31T17:53:14.035084] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-31T17:53:14.045534] [INFO ] [MAIN ] Update Progress: 426/2365 symbols completed. CEE took 28.3s. Estimated remaining: 4h 1m 58s. Rate: 8.0 symbols/min [2025-10-31T17:53:14.437346] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:14.467937] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-10-31T17:53:14.483287] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-10-31T17:53:14.502677] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-31T17:53:14.514250] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-31T17:53:14.516425] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-10-31T17:53:14.516476] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-31T17:53:14.558768] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-31T17:53:14.595383] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-31T17:53:14.616628] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-31T17:53:14.616997] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-31T17:53:14.660640] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-31T17:53:14.666115] [DEBUG] [LOCAL ] CEPU: Trimmed 40008 records to 28001 (keeping 200 days of data) [2025-10-31T17:53:14.989396] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:15.036387] [DEBUG] [LOCAL ] CEPU: Primary data saved (28001 records). [2025-10-31T17:53:15.036510] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-31T17:53:15.036588] [INFO ] [MAIN ] Update Progress: 427/2365 symbols completed. CEPU took 28.7s. Estimated remaining: 4h 1m 21s. Rate: 8.0 symbols/min [2025-10-31T17:53:15.218939] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:15.219201] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-31T17:53:15.219342] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-31T17:53:15.219586] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-31T17:53:15.219700] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-31T17:53:15.219853] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-31T17:53:15.219997] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-31T17:53:15.459181] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-31T17:53:15.508921] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-31T17:53:15.663859] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:16.117251] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T17:53:16.257694] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-31T17:53:16.846089] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T17:53:17.057719] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-31T17:53:17.811452] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T17:53:17.822815] [INFO ] [REMOTE ] CE: Full fetch complete (74733 records). [2025-10-31T17:53:17.822945] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-31T17:53:17.864807] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-31T17:53:18.208384] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-31T17:53:18.208518] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-31T17:53:18.209685] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-31T17:53:18.209772] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-31T17:53:18.211567] [DEBUG] [LOCAL ] CE: Trimmed 74733 records to 51889 (keeping 200 days of data) [2025-10-31T17:53:18.453572] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T17:53:18.575404] [DEBUG] [LOCAL ] CE: Primary data saved (51889 records). [2025-10-31T17:53:18.575630] [INFO ] [MAIN ] CE: Full history saved. [2025-10-31T17:53:18.576803] [INFO ] [MAIN ] Update Progress: 428/2365 symbols completed. CE took 37.7s. Estimated remaining: 4h 0m 56s. Rate: 8.0 symbols/min [2025-10-31T17:53:18.662837] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-31T17:53:18.748953] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:18.749250] [DEBUG] [LOCAL ] CFR: No existing data file found in primary storage. [2025-10-31T17:53:18.749323] [WARN ] [MAIN ] CFR: No existing data found, performing full refresh instead. [2025-10-31T17:53:18.749496] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-31T17:53:18.749566] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-31T17:53:18.749689] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-31T17:53:18.749815] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-31T17:53:18.840060] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:53:18.847704] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-31T17:53:18.851701] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:53:18.867930] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-31T17:53:18.873329] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:53:18.953853] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-31T17:53:19.060768] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-31T17:53:19.052792] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-31T17:53:19.083824] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-31T17:53:19.089577] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-31T17:53:19.100038] [INFO ] [REMOTE ] CF: Full fetch complete (75533 records). [2025-10-31T17:53:19.094775] [INFO ] [MAIN ] Update Progress: 429/2365 symbols completed. CFND took 4.1s. Estimated remaining: 4h 0m 17s. Rate: 8.1 symbols/min [2025-10-31T17:53:19.110504] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-31T17:53:19.229981] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:19.459430] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-31T17:53:19.554884] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:19.780744] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-31T17:53:19.781069] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-31T17:53:19.782128] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-31T17:53:19.782210] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-31T17:53:19.783761] [DEBUG] [LOCAL ] CF: Trimmed 75533 records to 52762 (keeping 200 days of data) [2025-10-31T17:53:19.907710] [DEBUG] [LOCAL ] CGAU: Loaded 44272 existing records from primary storage. [2025-10-31T17:53:19.924786] [INFO ] [MAIN ] CGAU: Loaded 44272 existing records. [2025-10-31T17:53:20.223875] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:53:20.229197] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-31T17:53:20.229271] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-31T17:53:20.229567] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-31T17:53:20.260152] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-31T17:53:20.260379] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-31T17:53:20.391874] [DEBUG] [LOCAL ] CF: Primary data saved (52762 records). [2025-10-31T17:53:20.431678] [INFO ] [MAIN ] CF: Full history saved. [2025-10-31T17:53:20.442250] [INFO ] [MAIN ] Update Progress: 430/2365 symbols completed. CF took 32.5s. Estimated remaining: 3h 59m 42s. Rate: 8.1 symbols/min [2025-10-31T17:53:20.840571] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:20.860283] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:20.882569] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T17:53:20.891340] [DEBUG] [LOCAL ] CGV: Loaded 1359 existing records from primary storage. [2025-10-31T17:53:20.892028] [INFO ] [MAIN ] CGV: Loaded 1359 existing records. [2025-10-31T17:53:21.057684] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-31T17:53:21.080225] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:53:21.080618] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-31T17:53:21.080733] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-31T17:53:21.080866] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-31T17:53:21.080904] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-31T17:53:21.430585] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:21.789919] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-31T17:53:21.857701] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-31T17:53:21.969009] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T17:53:22.243981] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-31T17:53:22.657695] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-31T17:53:22.925426] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-31T17:53:23.457659] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-31T17:53:24.257697] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-31T17:53:24.784327] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T17:53:25.057725] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-31T17:53:25.374903] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T17:53:25.857634] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-31T17:53:26.214221] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T17:53:26.657717] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-31T17:53:26.892962] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T17:53:27.457692] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-31T17:53:27.573282] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T17:53:28.257681] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-31T17:53:28.467106] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T17:53:29.057676] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-31T17:53:29.334961] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T17:53:29.857669] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-31T17:53:30.057318] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T17:53:30.143887] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-31T17:53:30.657696] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-31T17:53:30.936290] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-31T17:53:31.457673] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-31T17:53:32.257637] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-31T17:53:32.537405] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T17:53:32.595182] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-31T17:53:33.057668] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-31T17:53:33.857680] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-31T17:53:33.995856] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T17:53:34.657718] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-31T17:53:35.197804] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T17:53:35.457697] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-31T17:53:35.653709] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T17:53:36.257680] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-31T17:53:36.406167] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T17:53:36.538209] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-31T17:53:37.057735] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-31T17:53:37.857699] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-31T17:53:38.085558] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T17:53:38.657700] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-31T17:53:38.864232] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T17:53:39.457721] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-31T17:53:39.695609] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T17:53:39.731828] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-31T17:53:40.257680] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-31T17:53:41.057617] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-31T17:53:41.195700] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T17:53:41.857669] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-31T17:53:42.135497] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-31T17:53:42.368584] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T17:53:42.657637] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-31T17:53:43.457677] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-31T17:53:43.798374] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T17:53:43.805909] [INFO ] [REMOTE ] CFR: Full fetch complete (48689 records). [2025-10-31T17:53:43.806074] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-31T17:53:44.184915] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-31T17:53:44.184994] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-31T17:53:44.185574] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-31T17:53:44.185613] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-31T17:53:44.186609] [DEBUG] [LOCAL ] CFR: Trimmed 48689 records to 32632 (keeping 200 days of data) [2025-10-31T17:53:44.277308] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-31T17:53:44.390453] [DEBUG] [LOCAL ] CFR: Primary data saved (32632 records). [2025-10-31T17:53:44.390577] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-31T17:53:44.390668] [INFO ] [MAIN ] Update Progress: 431/2365 symbols completed. CFR took 25.8s. Estimated remaining: 4h 0m 49s. Rate: 8.0 symbols/min [2025-10-31T17:53:44.563511] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:44.592012] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T17:53:44.619485] [DEBUG] [LOCAL ] CHCT: Loaded 24144 existing records from primary storage. [2025-10-31T17:53:44.619780] [INFO ] [MAIN ] CHCT: Loaded 24144 existing records. [2025-10-31T17:53:44.794918] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:53:44.795155] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-31T17:53:44.795203] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-31T17:53:44.795378] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-31T17:53:44.795434] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-31T17:53:45.062854] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-31T17:53:45.179422] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:45.635813] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T17:53:45.857726] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-31T17:53:46.278234] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T17:53:46.657728] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-31T17:53:46.971732] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-31T17:53:47.141245] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T17:53:47.457669] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-31T17:53:47.923662] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-31T17:53:47.924596] [INFO ] [REMOTE ] CGV: Full fetch complete (2201 records). [2025-10-31T17:53:47.924705] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-31T17:53:48.262782] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-31T17:53:48.299426] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-31T17:53:48.299498] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-31T17:53:48.299591] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-31T17:53:48.299627] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-31T17:53:48.300125] [DEBUG] [LOCAL ] CGV: Trimmed 2201 records to 1367 (keeping 200 days of data) [2025-10-31T17:53:48.309209] [DEBUG] [LOCAL ] CGV: Primary data saved (1367 records). [2025-10-31T17:53:48.309358] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-31T17:53:48.309446] [INFO ] [MAIN ] Update Progress: 432/2365 symbols completed. CGV took 27.9s. Estimated remaining: 4h 0m 26s. Rate: 8.0 symbols/min [2025-10-31T17:53:48.480887] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:48.529126] [DEBUG] [LOCAL ] CHD: Loaded 52709 existing records from primary storage. [2025-10-31T17:53:48.529430] [INFO ] [MAIN ] CHD: Loaded 52709 existing records. [2025-10-31T17:53:48.701667] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:53:48.701880] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-31T17:53:48.701925] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-31T17:53:48.702130] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-31T17:53:48.702184] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-31T17:53:49.062614] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-31T17:53:49.066222] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:49.857696] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-31T17:53:50.057840] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-31T17:53:50.070106] [INFO ] [REMOTE ] CFG: Full fetch complete (77782 records). [2025-10-31T17:53:50.070236] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-31T17:53:50.502362] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-31T17:53:50.502464] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-31T17:53:50.503450] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-31T17:53:50.503568] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-31T17:53:50.505320] [DEBUG] [LOCAL ] CFG: Trimmed 77782 records to 54402 (keeping 200 days of data) [2025-10-31T17:53:50.633069] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T17:53:50.647091] [INFO ] [REMOTE ] CGAU: Full fetch complete (62678 records). [2025-10-31T17:53:50.648614] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-31T17:53:50.665881] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-31T17:53:51.296841] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-31T17:53:51.296543] [DEBUG] [LOCAL ] CFG: Primary data saved (54402 records). [2025-10-31T17:53:51.297212] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-31T17:53:51.297361] [INFO ] [MAIN ] Update Progress: 433/2365 symbols completed. CFG took 37.2s. Estimated remaining: 3h 59m 58s. Rate: 8.1 symbols/min [2025-10-31T17:53:51.297061] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-31T17:53:51.329429] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-31T17:53:51.341203] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-31T17:53:51.446761] [DEBUG] [LOCAL ] CGAU: Trimmed 62678 records to 44637 (keeping 200 days of data) [2025-10-31T17:53:51.473881] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:51.544554] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-31T17:53:51.550588] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-31T17:53:51.611800] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-31T17:53:51.635197] [DEBUG] [LOCAL ] CHE: Loaded 15701 existing records from primary storage. [2025-10-31T17:53:51.646829] [INFO ] [MAIN ] CHE: Loaded 15701 existing records. [2025-10-31T17:53:51.947458] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:53:51.952165] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-31T17:53:51.952506] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-31T17:53:51.952922] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-31T17:53:51.953538] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-31T17:53:52.111073] [DEBUG] [LOCAL ] CGAU: Primary data saved (44637 records). [2025-10-31T17:53:52.116351] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-31T17:53:52.140451] [INFO ] [MAIN ] Update Progress: 434/2365 symbols completed. CGAU took 33.0s. Estimated remaining: 3h 59m 21s. Rate: 8.1 symbols/min [2025-10-31T17:53:52.257949] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-31T17:53:52.531174] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:53:52.536588] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:52.550607] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T17:53:52.596453] [DEBUG] [LOCAL ] CHGG: Loaded 47759 existing records from primary storage. [2025-10-31T17:53:52.596752] [INFO ] [MAIN ] CHGG: Loaded 47759 existing records. [2025-10-31T17:53:52.777458] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:53:52.777711] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-31T17:53:52.777765] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-31T17:53:52.778070] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-31T17:53:52.778124] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-31T17:53:53.062728] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-31T17:53:53.134310] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:53:53.688420] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-31T17:53:53.765638] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T17:53:53.857626] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-31T17:53:54.657721] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-31T17:53:55.188772] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T17:53:55.220419] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T17:53:55.457697] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-31T17:53:56.014108] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-31T17:53:56.257665] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-31T17:53:57.057675] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-31T17:53:57.560001] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T17:53:57.832255] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T17:53:57.857667] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-31T17:53:58.658315] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-31T17:53:58.661182] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-31T17:53:59.323259] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-31T17:53:59.457633] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-31T17:54:00.257705] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-31T17:54:00.737119] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T17:54:01.057625] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-31T17:54:01.207932] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-31T17:54:01.857703] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-31T17:54:02.657634] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-31T17:54:02.857549] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-31T17:54:03.283674] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-31T17:54:03.428613] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-31T17:54:03.457614] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-31T17:54:04.257724] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-31T17:54:04.633748] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T17:54:05.057630] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-31T17:54:05.659694] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T17:54:05.857731] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-31T17:54:06.096298] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T17:54:06.657682] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-31T17:54:07.340813] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T17:54:07.457702] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-31T17:54:08.021528] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T17:54:08.205078] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-31T17:54:08.257623] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-31T17:54:09.057673] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-31T17:54:09.441097] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T17:54:09.857674] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-31T17:54:10.236139] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-31T17:54:10.628358] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-31T17:54:10.657710] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-31T17:54:11.457624] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-31T17:54:12.126922] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-31T17:54:12.139100] [INFO ] [REMOTE ] CHD: Full fetch complete (75055 records). [2025-10-31T17:54:12.139261] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-31T17:54:12.257829] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-31T17:54:12.551246] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T17:54:12.580569] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-31T17:54:12.580675] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-31T17:54:12.581866] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-31T17:54:12.581940] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-31T17:54:12.583385] [DEBUG] [LOCAL ] CHD: Trimmed 75055 records to 53098 (keeping 200 days of data) [2025-10-31T17:54:12.913281] [DEBUG] [LOCAL ] CHD: Primary data saved (53098 records). [2025-10-31T17:54:12.913539] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-31T17:54:12.913626] [INFO ] [MAIN ] Update Progress: 435/2365 symbols completed. CHD took 24.6s. Estimated remaining: 4h 0m 13s. Rate: 8.0 symbols/min [2025-10-31T17:54:13.062603] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-31T17:54:13.115073] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:54:13.146722] [DEBUG] [LOCAL ] CHH: Loaded 32268 existing records from primary storage. [2025-10-31T17:54:13.146986] [INFO ] [MAIN ] CHH: Loaded 32268 existing records. [2025-10-31T17:54:13.323186] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:54:13.323386] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-31T17:54:13.323432] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-31T17:54:13.323712] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-31T17:54:13.323768] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-31T17:54:13.679249] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:54:13.708888] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T17:54:13.818301] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T17:54:13.857636] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-31T17:54:14.657670] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-31T17:54:14.958727] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-31T17:54:15.457638] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-31T17:54:16.113564] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-31T17:54:16.231453] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T17:54:16.257669] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-31T17:54:17.057665] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-31T17:54:17.342935] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-31T17:54:17.347603] [INFO ] [REMOTE ] CHE: Full fetch complete (21063 records). [2025-10-31T17:54:17.347732] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-31T17:54:17.725050] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-31T17:54:17.725123] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-31T17:54:17.725544] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-31T17:54:17.725606] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-31T17:54:17.726191] [DEBUG] [LOCAL ] CHE: Trimmed 21063 records to 15867 (keeping 200 days of data) [2025-10-31T17:54:17.829971] [DEBUG] [LOCAL ] CHE: Primary data saved (15867 records). [2025-10-31T17:54:17.830147] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-31T17:54:17.830244] [INFO ] [MAIN ] Update Progress: 436/2365 symbols completed. CHE took 26.5s. Estimated remaining: 3h 59m 54s. Rate: 8.0 symbols/min [2025-10-31T17:54:17.862733] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-31T17:54:18.014337] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:54:18.037208] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T17:54:18.060888] [DEBUG] [LOCAL ] CHMI: Loaded 20774 existing records from primary storage. [2025-10-31T17:54:18.061122] [INFO ] [MAIN ] CHMI: Loaded 20774 existing records. [2025-10-31T17:54:18.235098] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:54:18.235310] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-31T17:54:18.235357] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-31T17:54:18.235536] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-31T17:54:18.235592] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-31T17:54:18.585397] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:54:18.657623] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-31T17:54:19.350011] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T17:54:19.447332] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T17:54:19.457594] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-31T17:54:20.265263] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-31T17:54:20.266288] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T17:54:21.057671] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-31T17:54:21.276879] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-31T17:54:21.857667] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-31T17:54:22.275428] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T17:54:22.576240] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-31T17:54:22.657606] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-31T17:54:23.457681] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-31T17:54:23.675416] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-31T17:54:23.681329] [INFO ] [REMOTE ] CHCT: Full fetch complete (34822 records). [2025-10-31T17:54:23.681420] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-31T17:54:24.047322] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-31T17:54:24.047405] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-31T17:54:24.047934] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-31T17:54:24.047995] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-31T17:54:24.048900] [DEBUG] [LOCAL ] CHCT: Trimmed 34822 records to 24328 (keeping 200 days of data) [2025-10-31T17:54:24.218192] [DEBUG] [LOCAL ] CHCT: Primary data saved (24328 records). [2025-10-31T17:54:24.218315] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-31T17:54:24.218391] [INFO ] [MAIN ] Update Progress: 437/2365 symbols completed. CHCT took 39.8s. Estimated remaining: 3h 59m 42s. Rate: 8.0 symbols/min [2025-10-31T17:54:24.257614] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-31T17:54:24.453572] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T17:54:25.057681] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-31T17:54:25.128692] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-31T17:54:25.857680] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-31T17:54:26.547504] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-31T17:54:26.657672] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-31T17:54:27.025313] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T17:54:27.457672] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-31T17:54:28.257699] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-31T17:54:28.304027] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T17:54:28.314899] [INFO ] [REMOTE ] CHGG: Full fetch complete (69716 records). [2025-10-31T17:54:28.315067] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-31T17:54:28.735930] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-31T17:54:28.736057] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-31T17:54:28.736859] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-31T17:54:28.736998] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-31T17:54:28.738902] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T17:54:28.747186] [DEBUG] [LOCAL ] CHGG: Trimmed 69716 records to 48132 (keeping 200 days of data) [2025-10-31T17:54:29.010258] [DEBUG] [LOCAL ] CHGG: Primary data saved (48132 records). [2025-10-31T17:54:29.010374] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-31T17:54:29.011330] [INFO ] [MAIN ] Update Progress: 438/2365 symbols completed. CHGG took 36.9s. Estimated remaining: 3h 59m 23s. Rate: 8.0 symbols/min [2025-10-31T17:54:29.057721] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-31T17:54:29.159632] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-31T17:54:29.857754] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-31T17:54:29.939713] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T17:54:30.657684] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-31T17:54:30.730140] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-31T17:54:31.457704] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-31T17:54:31.618391] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T17:54:32.118779] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-31T17:54:32.257621] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-31T17:54:32.957546] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T17:54:33.057676] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-31T17:54:33.857682] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-31T17:54:34.025581] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T17:54:34.666825] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-31T17:54:34.668270] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T17:54:35.457755] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-31T17:54:35.597725] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-31T17:54:36.203052] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T17:54:36.257630] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-31T17:54:37.058096] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T17:54:37.057616] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-31T17:54:37.063988] [INFO ] [REMOTE ] CHMI: Full fetch complete (31306 records). [2025-10-31T17:54:37.064070] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-31T17:54:37.421679] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-31T17:54:37.421763] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-31T17:54:37.422219] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-31T17:54:37.422258] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-31T17:54:37.422960] [DEBUG] [LOCAL ] CHMI: Trimmed 31306 records to 20941 (keeping 200 days of data) [2025-10-31T17:54:37.541765] [DEBUG] [LOCAL ] CHMI: Primary data saved (20941 records). [2025-10-31T17:54:37.541895] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-31T17:54:37.541980] [INFO ] [MAIN ] Update Progress: 439/2365 symbols completed. CHMI took 19.7s. Estimated remaining: 3h 59m 20s. Rate: 8.0 symbols/min [2025-10-31T17:54:38.403328] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-31T17:54:38.411432] [INFO ] [REMOTE ] CHH: Full fetch complete (47638 records). [2025-10-31T17:54:38.411555] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-31T17:54:38.779398] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-31T17:54:38.779475] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-31T17:54:38.780108] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-31T17:54:38.780170] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-31T17:54:38.781109] [DEBUG] [LOCAL ] CHH: Trimmed 47638 records to 32493 (keeping 200 days of data) [2025-10-31T17:54:38.981511] [DEBUG] [LOCAL ] CHH: Primary data saved (32493 records). [2025-10-31T17:54:38.981669] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-31T17:54:38.981764] [INFO ] [MAIN ] Update Progress: 440/2365 symbols completed. CHH took 26.1s. Estimated remaining: 3h 58m 47s. Rate: 8.1 symbols/min [2025-10-31T17:54:39.553269] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:54:39.598740] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:54:39.652880] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:54:39.678309] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:54:39.702784] [DEBUG] [LOCAL ] CHT: Loaded 19010 existing records from primary storage. [2025-10-31T17:54:39.703095] [INFO ] [MAIN ] CHT: Loaded 19010 existing records. [2025-10-31T17:54:39.890036] [DEBUG] [LOCAL ] CHWY: Loaded 54043 existing records from primary storage. [2025-10-31T17:54:39.946685] [DEBUG] [LOCAL ] CHPT: Loaded 46297 existing records from primary storage. [2025-10-31T17:54:39.973888] [INFO ] [MAIN ] CHWY: Loaded 54043 existing records. [2025-10-31T17:54:40.049505] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:54:40.049742] [INFO ] [MAIN ] CHPT: Loaded 46297 existing records. [2025-10-31T17:54:40.042679] [DEBUG] [LOCAL ] CI: Loaded 49798 existing records from primary storage. [2025-10-31T17:54:40.055137] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-31T17:54:40.097462] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-31T17:54:40.091561] [INFO ] [MAIN ] CI: Loaded 49798 existing records. [2025-10-31T17:54:40.195429] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-31T17:54:40.322132] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-31T17:54:40.627174] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:54:40.601298] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:54:40.636267] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-31T17:54:40.640811] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:54:40.671861] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-31T17:54:40.678217] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-31T17:54:40.678312] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-31T17:54:40.678451] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-31T17:54:40.678664] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-31T17:54:40.678780] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-31T17:54:40.678843] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-31T17:54:40.682310] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-31T17:54:40.682402] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-31T17:54:40.682579] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-31T17:54:40.682243] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-31T17:54:41.758991] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:54:41.770965] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-31T17:54:42.029838] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:54:42.032617] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:54:42.032850] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-31T17:54:42.024995] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:54:42.033969] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-31T17:54:42.034848] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-31T17:54:42.598382] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T17:54:42.601991] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-31T17:54:43.194156] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T17:54:43.200103] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-31T17:54:43.305170] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T17:54:43.315216] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-31T17:54:43.596197] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-31T17:54:43.606756] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-31T17:54:43.764418] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-31T17:54:43.817179] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T17:54:44.257676] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-31T17:54:44.536987] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T17:54:44.921942] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T17:54:45.010433] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T17:54:45.057630] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-31T17:54:45.857684] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-31T17:54:46.347181] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T17:54:46.657701] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-31T17:54:47.153610] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T17:54:47.457707] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-31T17:54:48.180262] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-31T17:54:48.257638] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-31T17:54:48.757140] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T17:54:49.057637] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-31T17:54:49.847500] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-31T17:54:49.857772] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-31T17:54:50.353526] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T17:54:50.633228] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T17:54:50.657603] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-31T17:54:51.311771] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T17:54:51.457693] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-31T17:54:52.257695] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-31T17:54:52.596473] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T17:54:52.891675] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T17:54:53.057638] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-31T17:54:53.857683] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-31T17:54:54.580478] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-31T17:54:54.657608] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-31T17:54:55.262918] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T17:54:55.457667] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-31T17:54:56.112984] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T17:54:56.155758] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-31T17:54:56.257627] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-31T17:54:57.057758] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-31T17:54:57.683735] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-31T17:54:57.857726] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-31T17:54:58.491605] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T17:54:58.657632] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-31T17:54:58.764996] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-31T17:54:59.457627] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-31T17:55:00.130455] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T17:55:00.257615] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-31T17:55:00.283161] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-31T17:55:00.287531] [INFO ] [REMOTE ] CHT: Full fetch complete (27491 records). [2025-10-31T17:55:00.287621] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-31T17:55:00.645508] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-31T17:55:00.645589] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-31T17:55:00.646209] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-31T17:55:00.646277] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-31T17:55:00.647031] [DEBUG] [LOCAL ] CHT: Trimmed 27491 records to 19116 (keeping 200 days of data) [2025-10-31T17:55:00.767156] [DEBUG] [LOCAL ] CHT: Primary data saved (19116 records). [2025-10-31T17:55:00.767309] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-31T17:55:00.767421] [INFO ] [MAIN ] Update Progress: 441/2365 symbols completed. CHT took 21.8s. Estimated remaining: 3h 59m 42s. Rate: 8.0 symbols/min [2025-10-31T17:55:00.978345] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:55:00.992342] [DEBUG] [LOCAL ] CIA: Loaded 16251 existing records from primary storage. [2025-10-31T17:55:00.992537] [INFO ] [MAIN ] CIA: Loaded 16251 existing records. [2025-10-31T17:55:01.064431] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-31T17:55:01.166362] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:55:01.166563] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-31T17:55:01.166610] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-31T17:55:01.166872] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-31T17:55:01.166927] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-31T17:55:01.515244] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:55:01.839679] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-31T17:55:01.857628] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-31T17:55:02.657638] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-31T17:55:02.740013] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-31T17:55:03.377086] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-31T17:55:03.457628] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-31T17:55:04.092391] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:55:04.257695] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-31T17:55:05.057697] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-31T17:55:05.229784] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-31T17:55:05.802322] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T17:55:05.857612] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-31T17:55:06.426394] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-31T17:55:06.442119] [INFO ] [REMOTE ] CI: Full fetch complete (72058 records). [2025-10-31T17:55:06.442297] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-31T17:55:06.669134] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-31T17:55:06.867083] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-31T17:55:06.867163] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-31T17:55:06.867977] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-31T17:55:06.868039] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-31T17:55:06.869372] [DEBUG] [LOCAL ] CI: Trimmed 72058 records to 50188 (keeping 200 days of data) [2025-10-31T17:55:07.025427] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-31T17:55:07.125706] [INFO ] [REMOTE ] CHWY: Full fetch complete (77779 records). [2025-10-31T17:55:07.129880] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-31T17:55:07.469196] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-31T17:55:07.519900] [DEBUG] [LOCAL ] CI: Primary data saved (50188 records). [2025-10-31T17:55:07.530785] [INFO ] [MAIN ] CI: Full history saved. [2025-10-31T17:55:07.541618] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T17:55:07.537826] [INFO ] [MAIN ] Update Progress: 442/2365 symbols completed. CI took 28.6s. Estimated remaining: 3h 59m 31s. Rate: 8.0 symbols/min [2025-10-31T17:55:07.756120] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-31T17:55:07.766124] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-31T17:55:07.770567] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-31T17:55:07.770696] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-31T17:55:07.833988] [DEBUG] [LOCAL ] CHWY: Trimmed 77779 records to 54433 (keeping 200 days of data) [2025-10-31T17:55:07.855427] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:55:08.081333] [DEBUG] [LOCAL ] CIB: Loaded 29671 existing records from primary storage. [2025-10-31T17:55:08.098667] [INFO ] [MAIN ] CIB: Loaded 29671 existing records. [2025-10-31T17:55:08.265387] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-31T17:55:08.370167] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:55:08.374590] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-31T17:55:08.375012] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-31T17:55:08.380134] [DEBUG] [LOCAL ] CHWY: Primary data saved (54433 records). [2025-10-31T17:55:08.380324] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-31T17:55:08.380435] [INFO ] [MAIN ] Update Progress: 443/2365 symbols completed. CHWY took 29.4s. Estimated remaining: 3h 58m 55s. Rate: 8.0 symbols/min [2025-10-31T17:55:08.380486] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-31T17:55:08.380606] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-31T17:55:08.773210] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:55:08.807191] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-31T17:55:08.839001] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-31T17:55:08.839243] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-31T17:55:08.846091] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-31T17:55:08.851272] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-31T17:55:08.851523] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-31T17:55:09.060501] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:55:09.069062] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T17:55:09.062712] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-31T17:55:09.329463] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:55:09.367334] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-31T17:55:09.857726] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-31T17:55:10.172197] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T17:55:10.534587] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-31T17:55:10.657683] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-31T17:55:11.304831] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T17:55:11.457684] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-31T17:55:12.257632] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-31T17:55:12.336987] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T17:55:13.057679] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-31T17:55:13.463602] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T17:55:13.552052] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-31T17:55:13.857699] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-31T17:55:14.657716] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-31T17:55:15.157757] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T17:55:15.412779] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-31T17:55:15.457681] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-31T17:55:16.185216] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T17:55:16.257607] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-31T17:55:16.949971] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-31T17:55:17.057694] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-31T17:55:17.338088] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-31T17:55:17.857667] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-31T17:55:18.657735] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-31T17:55:19.181385] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T17:55:19.189773] [INFO ] [REMOTE ] CHPT: Full fetch complete (69843 records). [2025-10-31T17:55:19.189895] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-31T17:55:19.462799] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-31T17:55:19.478615] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-31T17:55:19.612866] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-31T17:55:19.612952] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-31T17:55:19.613821] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-31T17:55:19.613885] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-31T17:55:19.615262] [DEBUG] [LOCAL ] CHPT: Trimmed 69843 records to 46521 (keeping 200 days of data) [2025-10-31T17:55:19.826007] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-31T17:55:19.892990] [DEBUG] [LOCAL ] CHPT: Primary data saved (46521 records). [2025-10-31T17:55:19.893137] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-31T17:55:19.893229] [INFO ] [MAIN ] Update Progress: 444/2365 symbols completed. CHPT took 40.9s. Estimated remaining: 3h 59m 5s. Rate: 8.0 symbols/min [2025-10-31T17:55:20.059418] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:55:20.109859] [DEBUG] [LOCAL ] CIEN: Loaded 52438 existing records from primary storage. [2025-10-31T17:55:20.110238] [INFO ] [MAIN ] CIEN: Loaded 52438 existing records. [2025-10-31T17:55:20.262765] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-31T17:55:20.292229] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:55:20.292494] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-31T17:55:20.292544] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-31T17:55:20.293069] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-31T17:55:20.293126] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-31T17:55:20.648618] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:55:20.653477] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-31T17:55:21.057672] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-31T17:55:21.857687] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-31T17:55:22.291498] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-31T17:55:22.657733] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-31T17:55:22.735492] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T17:55:22.899694] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-31T17:55:23.457699] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-31T17:55:24.257696] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-31T17:55:24.690422] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T17:55:25.057706] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-31T17:55:25.135933] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T17:55:25.378095] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-31T17:55:25.857731] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-31T17:55:26.657698] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-31T17:55:26.763527] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T17:55:26.935150] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-31T17:55:27.457725] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-31T17:55:27.932105] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T17:55:28.257687] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-31T17:55:29.057746] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-31T17:55:29.530780] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T17:55:29.857616] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-31T17:55:30.028684] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T17:55:30.657671] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-31T17:55:30.914577] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-31T17:55:31.067704] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T17:55:31.457674] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-31T17:55:32.257626] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-31T17:55:32.337286] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-31T17:55:32.340518] [INFO ] [REMOTE ] CIA: Full fetch complete (23060 records). [2025-10-31T17:55:32.340596] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-31T17:55:32.698529] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-31T17:55:32.698605] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-31T17:55:32.699086] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-31T17:55:32.699196] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-31T17:55:32.700132] [DEBUG] [LOCAL ] CIA: Trimmed 23060 records to 16308 (keeping 200 days of data) [2025-10-31T17:55:32.790801] [DEBUG] [LOCAL ] CIA: Primary data saved (16308 records). [2025-10-31T17:55:32.791018] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-31T17:55:32.791139] [INFO ] [MAIN ] Update Progress: 445/2365 symbols completed. CIA took 32.0s. Estimated remaining: 3h 59m 21s. Rate: 8.0 symbols/min [2025-10-31T17:55:32.963257] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:55:32.970421] [DEBUG] [LOCAL ] CIF: Loaded 3857 existing records from primary storage. [2025-10-31T17:55:32.970583] [INFO ] [MAIN ] CIF: Loaded 3857 existing records. [2025-10-31T17:55:33.062715] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-31T17:55:33.158955] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:55:33.159338] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-31T17:55:33.159424] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-31T17:55:33.159819] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-31T17:55:33.159890] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-31T17:55:33.360783] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-31T17:55:33.373305] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T17:55:33.556703] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:55:33.857735] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-31T17:55:34.657695] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-31T17:55:35.031387] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-31T17:55:35.032279] [INFO ] [REMOTE ] CICB: Full fetch complete (1909 records). [2025-10-31T17:55:35.032347] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-31T17:55:35.216206] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-31T17:55:35.216586] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:55:35.216718] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:55:35.216798] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-31T17:55:35.216866] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-31T17:55:35.216909] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-31T17:55:35.216949] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-31T17:55:35.217015] [INFO ] [MAIN ] Update Progress: 446/2365 symbols completed. CICB took 26.8s. Estimated remaining: 3h 58m 52s. Rate: 8.0 symbols/min [2025-10-31T17:55:35.396126] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-31T17:55:35.430243] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:55:35.430723] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-31T17:55:35.430795] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-31T17:55:35.431019] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-31T17:55:35.431076] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-31T17:55:35.431128] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-31T17:55:35.431162] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-31T17:55:35.462133] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-31T17:55:35.780325] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:55:36.257671] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-31T17:55:36.822670] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T17:55:37.057628] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-31T17:55:37.144603] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-31T17:55:37.857688] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-31T17:55:38.219382] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T17:55:38.271004] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-31T17:55:38.657676] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-31T17:55:39.058761] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T17:55:39.457672] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-31T17:55:40.257669] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-31T17:55:40.516052] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T17:55:41.057634] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-31T17:55:41.155500] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-31T17:55:41.857677] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-31T17:55:42.108689] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T17:55:42.657639] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-31T17:55:42.965941] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T17:55:42.972785] [INFO ] [REMOTE ] CIB: Full fetch complete (45288 records). [2025-10-31T17:55:42.972904] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-31T17:55:43.365573] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-31T17:55:43.365703] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-31T17:55:43.366359] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-31T17:55:43.366402] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-31T17:55:43.367468] [DEBUG] [LOCAL ] CIB: Trimmed 45288 records to 29840 (keeping 200 days of data) [2025-10-31T17:55:43.457635] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-31T17:55:43.537725] [DEBUG] [LOCAL ] CIB: Primary data saved (29840 records). [2025-10-31T17:55:43.537845] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-31T17:55:43.537952] [INFO ] [MAIN ] Update Progress: 447/2365 symbols completed. CIB took 36.0s. Estimated remaining: 3h 58m 48s. Rate: 8.0 symbols/min [2025-10-31T17:55:43.714524] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:55:43.730081] [DEBUG] [LOCAL ] CII: Loaded 14701 existing records from primary storage. [2025-10-31T17:55:43.730310] [INFO ] [MAIN ] CII: Loaded 14701 existing records. [2025-10-31T17:55:43.918155] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:55:43.918591] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-31T17:55:43.918744] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-31T17:55:43.919003] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-31T17:55:43.919085] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-31T17:55:44.243779] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T17:55:44.259883] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-31T17:55:44.335153] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:55:44.614346] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T17:55:44.774493] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-31T17:55:45.057632] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-31T17:55:45.762592] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T17:55:45.857682] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-31T17:55:46.362271] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T17:55:46.657693] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-31T17:55:47.457639] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-31T17:55:47.736350] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T17:55:48.257671] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-31T17:55:48.749479] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T17:55:49.057691] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-31T17:55:49.528048] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-31T17:55:49.583740] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T17:55:49.857669] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-31T17:55:50.657697] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-31T17:55:51.114135] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-31T17:55:51.308722] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-31T17:55:51.457743] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-31T17:55:51.782504] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-31T17:55:52.257664] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-31T17:55:53.057691] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-31T17:55:53.597467] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-31T17:55:53.857629] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-31T17:55:54.091734] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T17:55:54.657675] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-31T17:55:55.321392] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T17:55:55.411452] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T17:55:55.423596] [INFO ] [REMOTE ] CIEN: Full fetch complete (75834 records). [2025-10-31T17:55:55.423791] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-31T17:55:55.462775] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-31T17:55:55.820216] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-31T17:55:55.820300] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-31T17:55:55.821122] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-31T17:55:55.821187] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-31T17:55:55.822624] [DEBUG] [LOCAL ] CIEN: Trimmed 75834 records to 52817 (keeping 200 days of data) [2025-10-31T17:55:56.129945] [DEBUG] [LOCAL ] CIEN: Primary data saved (52817 records). [2025-10-31T17:55:56.130079] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-31T17:55:56.131337] [INFO ] [MAIN ] Update Progress: 448/2365 symbols completed. CIEN took 36.2s. Estimated remaining: 3h 59m 2s. Rate: 8.0 symbols/min [2025-10-31T17:55:56.269997] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-31T17:55:56.302112] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:55:56.341869] [DEBUG] [LOCAL ] CIM: Loaded 37228 existing records from primary storage. [2025-10-31T17:55:56.342153] [INFO ] [MAIN ] CIM: Loaded 37228 existing records. [2025-10-31T17:55:56.540489] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T17:55:56.543537] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:55:56.548529] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-31T17:55:56.549129] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-31T17:55:56.550016] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-31T17:55:56.550077] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-31T17:55:56.895757] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:55:57.057639] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-31T17:55:57.388045] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-31T17:55:57.857697] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-31T17:55:58.185094] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-31T17:55:58.657636] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-31T17:55:58.981068] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-31T17:55:59.283324] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-31T17:55:59.295772] [INFO ] [REMOTE ] CIG: Full fetch complete (62972 records). [2025-10-31T17:55:59.295899] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-31T17:55:59.466576] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-31T17:55:59.682216] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-31T17:55:59.682298] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-31T17:55:59.683105] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-31T17:55:59.683170] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-31T17:55:59.684463] [DEBUG] [LOCAL ] CIG: Trimmed 62972 records to 45264 (keeping 200 days of data) [2025-10-31T17:55:59.935054] [DEBUG] [LOCAL ] CIG: Primary data saved (45264 records). [2025-10-31T17:55:59.935174] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-31T17:55:59.935241] [INFO ] [MAIN ] Update Progress: 449/2365 symbols completed. CIG took 24.7s. Estimated remaining: 3h 58m 39s. Rate: 8.0 symbols/min [2025-10-31T17:56:00.102696] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:00.107552] [DEBUG] [LOCAL ] CIMN: Loaded 2652 existing records from primary storage. [2025-10-31T17:56:00.107729] [INFO ] [MAIN ] CIMN: Loaded 2652 existing records. [2025-10-31T17:56:00.262445] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-31T17:56:00.286766] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:56:00.287040] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-31T17:56:00.287094] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-31T17:56:00.287221] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-31T17:56:00.287263] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-31T17:56:00.645917] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:00.668391] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T17:56:00.860078] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-31T17:56:01.057679] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-31T17:56:01.400044] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-31T17:56:01.857687] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-31T17:56:02.493193] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T17:56:02.657739] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-31T17:56:03.074377] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-31T17:56:03.457704] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-31T17:56:04.257684] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-31T17:56:04.452383] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T17:56:04.575755] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T17:56:05.057670] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-31T17:56:05.563896] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-31T17:56:05.565247] [INFO ] [REMOTE ] CIF: Full fetch complete (6537 records). [2025-10-31T17:56:05.565324] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-31T17:56:05.862829] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-31T17:56:05.927920] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-31T17:56:05.927994] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-31T17:56:05.928210] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-31T17:56:05.928250] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-31T17:56:05.928739] [DEBUG] [LOCAL ] CIF: Trimmed 6537 records to 3878 (keeping 200 days of data) [2025-10-31T17:56:05.950813] [DEBUG] [LOCAL ] CIF: Primary data saved (3878 records). [2025-10-31T17:56:05.950935] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-31T17:56:05.951015] [INFO ] [MAIN ] Update Progress: 450/2365 symbols completed. CIF took 33.2s. Estimated remaining: 3h 58m 26s. Rate: 8.0 symbols/min [2025-10-31T17:56:06.119432] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:06.119620] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-31T17:56:06.119688] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-31T17:56:06.119807] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-31T17:56:06.119848] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-31T17:56:06.119926] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-31T17:56:06.119982] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-31T17:56:06.487427] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:06.557564] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T17:56:06.657697] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-31T17:56:07.064253] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-31T17:56:07.457636] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-31T17:56:07.746527] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-31T17:56:08.257666] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-31T17:56:09.057730] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-31T17:56:09.342904] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-31T17:56:09.562791] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T17:56:09.857712] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-31T17:56:10.179518] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-31T17:56:10.657683] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-31T17:56:11.095099] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-31T17:56:11.457704] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-31T17:56:11.733328] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-31T17:56:12.257718] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-31T17:56:12.870208] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-31T17:56:13.057705] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-31T17:56:13.434933] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-31T17:56:13.857728] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-31T17:56:14.657717] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-31T17:56:14.957620] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T17:56:15.147793] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-31T17:56:15.457636] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-31T17:56:15.754250] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-31T17:56:16.257681] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-31T17:56:16.517636] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-31T17:56:17.057676] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-31T17:56:17.839914] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T17:56:17.857611] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-31T17:56:18.657631] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-31T17:56:18.687264] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-31T17:56:18.691178] [INFO ] [REMOTE ] CII: Full fetch complete (22722 records). [2025-10-31T17:56:18.691251] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-31T17:56:18.691636] [FATAL] [VALIDATOR ] CII: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:56:18.691738] [FATAL] [MAIN ] CII: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:56:18.691780] [WARN ] [MAIN ] CII: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:56:18.691844] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-31T17:56:18.691903] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-31T17:56:18.691938] [INFO ] [LOCAL ] CII: Starting deletion of derivative data. [2025-10-31T17:56:18.692099] [DEBUG] [LOCAL ] CII: Deleted derivative data file. [2025-10-31T17:56:18.692181] [INFO ] [MAIN ] Update Progress: 451/2365 symbols completed. CII took 35.2s. Estimated remaining: 3h 58m 40s. Rate: 8.0 symbols/min [2025-10-31T17:56:18.857586] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:18.857800] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-31T17:56:18.857842] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-31T17:56:18.857972] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-31T17:56:18.858014] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-31T17:56:18.858101] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-31T17:56:18.858140] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-31T17:56:19.032809] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-31T17:56:19.213429] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:19.457636] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-31T17:56:20.257715] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-31T17:56:20.563804] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T17:56:20.644036] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-31T17:56:21.057624] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-31T17:56:21.467474] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-31T17:56:21.857705] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-31T17:56:22.657725] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-31T17:56:23.031672] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T17:56:23.036847] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-31T17:56:23.457636] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-31T17:56:24.257710] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-31T17:56:24.496961] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T17:56:24.637480] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-31T17:56:24.638940] [INFO ] [REMOTE ] CIMO: Full fetch complete (4574 records). [2025-10-31T17:56:24.639012] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-31T17:56:24.831862] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-31T17:56:24.832154] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:56:24.832230] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:56:24.832286] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-31T17:56:24.832351] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-31T17:56:24.832388] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-31T17:56:24.832429] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-31T17:56:24.832492] [INFO ] [MAIN ] Update Progress: 452/2365 symbols completed. CIMO took 18.9s. Estimated remaining: 3h 58m 27s. Rate: 8.0 symbols/min [2025-10-31T17:56:25.022167] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:25.045936] [DEBUG] [LOCAL ] CINT: Loaded 20550 existing records from primary storage. [2025-10-31T17:56:25.046301] [INFO ] [MAIN ] CINT: Loaded 20550 existing records. [2025-10-31T17:56:25.062983] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-31T17:56:25.255296] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:56:25.255636] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-31T17:56:25.255738] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-31T17:56:25.255953] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-31T17:56:25.255994] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-31T17:56:25.329264] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:56:25.351551] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-31T17:56:25.359826] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:56:25.362524] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-31T17:56:25.362676] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:56:25.373617] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-31T17:56:25.389099] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-31T17:56:25.402374] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-31T17:56:25.422707] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-31T17:56:25.437736] [INFO ] [MAIN ] Update Progress: 453/2365 symbols completed. CIMP took 6.7s. Estimated remaining: 3h 57m 51s. Rate: 8.0 symbols/min [2025-10-31T17:56:25.787470] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:25.790965] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:25.811235] [DEBUG] [LOCAL ] CIO: Loaded 21638 existing records from primary storage. [2025-10-31T17:56:25.811487] [INFO ] [MAIN ] CIO: Loaded 21638 existing records. [2025-10-31T17:56:25.862976] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-31T17:56:26.007218] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:56:26.007461] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-31T17:56:26.007508] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-31T17:56:26.007711] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-31T17:56:26.007769] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-31T17:56:26.456682] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:26.650410] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T17:56:26.657626] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-31T17:56:27.457617] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-31T17:56:27.517457] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T17:56:28.090415] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T17:56:28.257718] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-31T17:56:28.897019] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-31T17:56:29.057688] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-31T17:56:29.572526] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-31T17:56:29.857700] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-31T17:56:30.657703] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-31T17:56:31.024600] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T17:56:31.303117] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T17:56:31.457680] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-31T17:56:32.190105] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T17:56:32.257682] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-31T17:56:33.057695] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-31T17:56:33.425570] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T17:56:33.436076] [INFO ] [REMOTE ] CIM: Full fetch complete (54909 records). [2025-10-31T17:56:33.436261] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-31T17:56:33.843249] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-31T17:56:33.847419] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-31T17:56:33.848022] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-31T17:56:33.849187] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-31T17:56:33.849340] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-31T17:56:33.850591] [DEBUG] [LOCAL ] CIM: Trimmed 54909 records to 37536 (keeping 200 days of data) [2025-10-31T17:56:33.901813] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-31T17:56:34.081345] [DEBUG] [LOCAL ] CIM: Primary data saved (37536 records). [2025-10-31T17:56:34.081503] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-31T17:56:34.082464] [INFO ] [MAIN ] Update Progress: 454/2365 symbols completed. CIM took 38.0s. Estimated remaining: 3h 57m 48s. Rate: 8.0 symbols/min [2025-10-31T17:56:34.260242] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:34.289482] [DEBUG] [LOCAL ] CION: Loaded 27391 existing records from primary storage. [2025-10-31T17:56:34.289792] [INFO ] [MAIN ] CION: Loaded 27391 existing records. [2025-10-31T17:56:34.484724] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:56:34.485020] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-31T17:56:34.485070] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-31T17:56:34.485296] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-31T17:56:34.485351] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-31T17:56:34.665131] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-31T17:56:34.671672] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T17:56:34.894299] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:35.457676] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-31T17:56:35.480554] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T17:56:35.873813] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-31T17:56:36.257668] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-31T17:56:36.977182] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-31T17:56:37.057683] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-31T17:56:37.826921] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-31T17:56:37.857611] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-31T17:56:38.606957] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T17:56:38.657612] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-31T17:56:39.457633] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-31T17:56:39.573328] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T17:56:40.185829] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T17:56:40.257665] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-31T17:56:40.909186] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T17:56:41.057713] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-31T17:56:41.813469] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T17:56:41.857683] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-31T17:56:42.598894] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T17:56:42.657681] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-31T17:56:43.457614] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-31T17:56:43.481507] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-31T17:56:44.257627] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-31T17:56:44.411215] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-31T17:56:44.417668] [INFO ] [REMOTE ] CINT: Full fetch complete (28898 records). [2025-10-31T17:56:44.417765] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-31T17:56:44.773979] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-31T17:56:44.774052] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-31T17:56:44.774491] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-31T17:56:44.774529] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-31T17:56:44.775198] [DEBUG] [LOCAL ] CINT: Trimmed 28898 records to 20693 (keeping 200 days of data) [2025-10-31T17:56:44.886826] [DEBUG] [LOCAL ] CINT: Primary data saved (20693 records). [2025-10-31T17:56:44.886947] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-31T17:56:44.887024] [INFO ] [MAIN ] Update Progress: 455/2365 symbols completed. CINT took 20.1s. Estimated remaining: 3h 57m 55s. Rate: 8.0 symbols/min [2025-10-31T17:56:45.065007] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-31T17:56:45.067594] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:45.090736] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T17:56:45.141434] [DEBUG] [LOCAL ] CIVI: Loaded 53011 existing records from primary storage. [2025-10-31T17:56:45.141763] [INFO ] [MAIN ] CIVI: Loaded 53011 existing records. [2025-10-31T17:56:45.319762] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:56:45.320332] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-31T17:56:45.320381] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-31T17:56:45.320817] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-31T17:56:45.320875] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-31T17:56:45.424892] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-31T17:56:45.674622] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:45.857697] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-31T17:56:46.199926] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-31T17:56:46.657718] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-31T17:56:47.457800] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-31T17:56:47.747887] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T17:56:48.257667] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-31T17:56:48.702825] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T17:56:48.905139] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T17:56:49.057686] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-31T17:56:49.857665] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-31T17:56:50.268782] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T17:56:50.657621] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-31T17:56:50.675341] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-31T17:56:51.066188] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-31T17:56:51.067429] [INFO ] [REMOTE ] CIMN: Full fetch complete (3851 records). [2025-10-31T17:56:51.067497] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-31T17:56:51.423489] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-31T17:56:51.423566] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-31T17:56:51.423704] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-31T17:56:51.423763] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-31T17:56:51.424095] [DEBUG] [LOCAL ] CIMN: Trimmed 3851 records to 2697 (keeping 200 days of data) [2025-10-31T17:56:51.439755] [DEBUG] [LOCAL ] CIMN: Primary data saved (2697 records). [2025-10-31T17:56:51.439822] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-31T17:56:51.439891] [INFO ] [MAIN ] Update Progress: 456/2365 symbols completed. CIMN took 51.5s. Estimated remaining: 3h 57m 44s. Rate: 8.0 symbols/min [2025-10-31T17:56:51.462745] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-31T17:56:51.627444] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:51.678418] [DEBUG] [LOCAL ] CL: Loaded 54039 existing records from primary storage. [2025-10-31T17:56:51.678755] [INFO ] [MAIN ] CL: Loaded 54039 existing records. [2025-10-31T17:56:51.859501] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:56:51.859714] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-31T17:56:51.859771] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-31T17:56:51.859969] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-31T17:56:51.860025] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-31T17:56:52.245341] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:52.257669] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-31T17:56:52.905042] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-31T17:56:53.057665] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-31T17:56:53.701032] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T17:56:53.857697] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-31T17:56:54.092494] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-31T17:56:54.099801] [INFO ] [REMOTE ] CIO: Full fetch complete (30221 records). [2025-10-31T17:56:54.099905] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-31T17:56:54.478897] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-31T17:56:54.478973] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-31T17:56:54.479499] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-31T17:56:54.479540] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-31T17:56:54.480247] [DEBUG] [LOCAL ] CIO: Trimmed 30221 records to 21818 (keeping 200 days of data) [2025-10-31T17:56:54.606140] [DEBUG] [LOCAL ] CIO: Primary data saved (21818 records). [2025-10-31T17:56:54.606251] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-31T17:56:54.606323] [INFO ] [MAIN ] Update Progress: 457/2365 symbols completed. CIO took 29.1s. Estimated remaining: 3h 57m 18s. Rate: 8.0 symbols/min [2025-10-31T17:56:54.663479] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-31T17:56:54.778108] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:56:54.810419] [DEBUG] [LOCAL ] CLB: Loaded 33694 existing records from primary storage. [2025-10-31T17:56:54.810728] [INFO ] [MAIN ] CLB: Loaded 33694 existing records. [2025-10-31T17:56:54.988244] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:56:54.988428] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-31T17:56:54.988489] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-31T17:56:54.988679] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-31T17:56:54.988734] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-31T17:56:55.365005] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:56:55.394471] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-31T17:56:55.457629] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-31T17:56:55.516262] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-31T17:56:56.257634] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-31T17:56:56.835199] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T17:56:57.058483] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-31T17:56:57.061304] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T17:56:57.857716] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-31T17:56:58.419179] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T17:56:58.657679] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-31T17:56:58.861686] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T17:56:59.457619] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-31T17:56:59.623076] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T17:57:00.257704] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-31T17:57:00.876197] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T17:57:01.057635] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-31T17:57:01.857691] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-31T17:57:01.976138] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-31T17:57:02.416868] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T17:57:02.578498] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-31T17:57:02.657683] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-31T17:57:03.457705] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-31T17:57:04.134416] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-31T17:57:04.257680] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-31T17:57:04.497999] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T17:57:04.504362] [INFO ] [REMOTE ] CION: Full fetch complete (40439 records). [2025-10-31T17:57:04.504447] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-31T17:57:04.870886] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-31T17:57:04.870966] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-31T17:57:04.871518] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-31T17:57:04.871562] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-31T17:57:04.872388] [DEBUG] [LOCAL ] CION: Trimmed 40439 records to 27585 (keeping 200 days of data) [2025-10-31T17:57:05.058842] [DEBUG] [LOCAL ] CION: Primary data saved (27585 records). [2025-10-31T17:57:05.059173] [INFO ] [MAIN ] CION: Full history saved. [2025-10-31T17:57:05.059056] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-31T17:57:05.060229] [INFO ] [MAIN ] Update Progress: 458/2365 symbols completed. CION took 31.0s. Estimated remaining: 3h 57m 23s. Rate: 8.0 symbols/min [2025-10-31T17:57:05.229342] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:57:05.242069] [DEBUG] [LOCAL ] CLCO: Loaded 12904 existing records from primary storage. [2025-10-31T17:57:05.242297] [INFO ] [MAIN ] CLCO: Loaded 12904 existing records. [2025-10-31T17:57:05.418723] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:57:05.418923] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-31T17:57:05.418979] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-31T17:57:05.419152] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-31T17:57:05.419190] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-31T17:57:05.774602] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:57:05.809541] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T17:57:05.857617] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-31T17:57:05.905783] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-31T17:57:06.657623] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-31T17:57:06.764011] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T17:57:07.457695] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-31T17:57:08.020181] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T17:57:08.257629] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-31T17:57:08.345630] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T17:57:09.057695] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-31T17:57:09.810677] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T17:57:09.857634] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-31T17:57:10.123787] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-31T17:57:10.657716] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-31T17:57:11.205776] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T17:57:11.457690] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-31T17:57:12.054056] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T17:57:12.066437] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-31T17:57:12.066579] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-31T17:57:12.260438] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-31T17:57:12.446188] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-31T17:57:12.557963] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-31T17:57:12.558048] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-31T17:57:12.558917] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-31T17:57:12.558981] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-31T17:57:12.560457] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 54429 (keeping 200 days of data) [2025-10-31T17:57:12.897306] [DEBUG] [LOCAL ] CL: Primary data saved (54429 records). [2025-10-31T17:57:12.897437] [INFO ] [MAIN ] CL: Full history saved. [2025-10-31T17:57:12.897517] [INFO ] [MAIN ] Update Progress: 459/2365 symbols completed. CL took 21.5s. Estimated remaining: 3h 57m 17s. Rate: 8.0 symbols/min [2025-10-31T17:57:13.063718] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:57:13.062168] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-31T17:57:13.087740] [DEBUG] [LOCAL ] CLDT: Loaded 24767 existing records from primary storage. [2025-10-31T17:57:13.088016] [INFO ] [MAIN ] CLDT: Loaded 24767 existing records. [2025-10-31T17:57:13.263521] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:57:13.263806] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-31T17:57:13.263855] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-31T17:57:13.264094] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-31T17:57:13.264150] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-31T17:57:13.612622] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:57:13.730469] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T17:57:13.857690] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-31T17:57:14.495186] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T17:57:14.525770] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-31T17:57:14.657725] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-31T17:57:15.457617] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-31T17:57:15.473017] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T17:57:16.262814] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-31T17:57:16.269085] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T17:57:17.057705] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-31T17:57:17.609757] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T17:57:17.857678] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-31T17:57:18.085404] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T17:57:18.660745] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-31T17:57:18.664330] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T17:57:19.319355] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-31T17:57:19.457675] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-31T17:57:20.257674] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-31T17:57:20.418911] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T17:57:21.057730] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-31T17:57:21.672409] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-31T17:57:21.857704] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-31T17:57:22.042815] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-31T17:57:22.054866] [INFO ] [REMOTE ] CIVI: Full fetch complete (76074 records). [2025-10-31T17:57:22.054994] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-31T17:57:22.380025] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-31T17:57:22.462872] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-31T17:57:22.463002] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-31T17:57:22.464291] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-31T17:57:22.464378] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-31T17:57:22.466248] [DEBUG] [LOCAL ] CIVI: Trimmed 76074 records to 53381 (keeping 200 days of data) [2025-10-31T17:57:22.681732] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-31T17:57:22.794047] [DEBUG] [LOCAL ] CIVI: Primary data saved (53381 records). [2025-10-31T17:57:22.794190] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-31T17:57:22.795177] [INFO ] [MAIN ] Update Progress: 460/2365 symbols completed. CIVI took 37.9s. Estimated remaining: 3h 57m 20s. Rate: 8.0 symbols/min [2025-10-31T17:57:22.965933] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:57:23.022760] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-31T17:57:23.023064] [INFO ] [MAIN ] CLF: Loaded 54131 existing records. [2025-10-31T17:57:23.202571] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:57:23.202797] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-31T17:57:23.202846] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-31T17:57:23.203143] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-31T17:57:23.203199] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-31T17:57:23.462846] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-31T17:57:23.606049] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:57:23.628326] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-31T17:57:24.004521] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-31T17:57:24.257681] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-31T17:57:25.057702] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-31T17:57:25.608508] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T17:57:25.857624] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-31T17:57:25.950150] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-31T17:57:26.657671] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-31T17:57:27.003192] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T17:57:27.457685] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-31T17:57:28.122903] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-31T17:57:28.257686] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-31T17:57:28.327059] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T17:57:28.331816] [INFO ] [REMOTE ] CLCO: Full fetch complete (22426 records). [2025-10-31T17:57:28.331909] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-31T17:57:28.685555] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-31T17:57:28.685628] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-31T17:57:28.686033] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-31T17:57:28.686080] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-31T17:57:28.686595] [DEBUG] [LOCAL ] CLCO: Trimmed 22426 records to 12980 (keeping 200 days of data) [2025-10-31T17:57:28.755179] [DEBUG] [LOCAL ] CLCO: Primary data saved (12980 records). [2025-10-31T17:57:28.755301] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-31T17:57:28.755376] [INFO ] [MAIN ] Update Progress: 461/2365 symbols completed. CLCO took 23.7s. Estimated remaining: 3h 57m 6s. Rate: 8.0 symbols/min [2025-10-31T17:57:28.921797] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:57:28.956190] [DEBUG] [LOCAL ] CLH: Loaded 27735 existing records from primary storage. [2025-10-31T17:57:28.956554] [INFO ] [MAIN ] CLH: Loaded 27735 existing records. [2025-10-31T17:57:29.062747] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-31T17:57:29.143377] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:57:29.143691] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-31T17:57:29.143829] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-31T17:57:29.144105] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-31T17:57:29.144145] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-31T17:57:29.477836] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T17:57:29.526811] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:57:29.857613] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-31T17:57:30.657620] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-31T17:57:30.691241] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-31T17:57:30.893297] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T17:57:31.457691] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-31T17:57:31.634686] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T17:57:32.257694] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-31T17:57:32.431051] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T17:57:33.057678] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-31T17:57:33.313555] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T17:57:33.829300] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-31T17:57:33.857611] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-31T17:57:34.626377] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-31T17:57:34.657607] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-31T17:57:35.333744] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-31T17:57:35.457615] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-31T17:57:36.263907] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-31T17:57:36.267258] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T17:57:37.057698] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-31T17:57:37.857692] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-31T17:57:37.929802] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-31T17:57:38.126534] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T17:57:38.135333] [INFO ] [REMOTE ] CLB: Full fetch complete (48121 records). [2025-10-31T17:57:38.135476] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-31T17:57:38.510053] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-31T17:57:38.510141] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-31T17:57:38.510964] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-31T17:57:38.511054] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-31T17:57:38.512328] [DEBUG] [LOCAL ] CLB: Trimmed 48121 records to 33945 (keeping 200 days of data) [2025-10-31T17:57:38.671260] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-31T17:57:38.720825] [DEBUG] [LOCAL ] CLB: Primary data saved (33945 records). [2025-10-31T17:57:38.720961] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-31T17:57:38.721061] [INFO ] [MAIN ] Update Progress: 462/2365 symbols completed. CLB took 44.1s. Estimated remaining: 3h 57m 9s. Rate: 8.0 symbols/min [2025-10-31T17:57:38.896178] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:57:38.917032] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T17:57:38.930587] [DEBUG] [LOCAL ] CLPR: Loaded 9590 existing records from primary storage. [2025-10-31T17:57:38.930808] [INFO ] [MAIN ] CLPR: Loaded 9590 existing records. [2025-10-31T17:57:39.117695] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:57:39.117922] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-31T17:57:39.117976] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-31T17:57:39.118128] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-31T17:57:39.118165] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-31T17:57:39.472850] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-31T17:57:39.514774] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:57:40.257625] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-31T17:57:40.357097] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-31T17:57:40.587120] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-31T17:57:40.988998] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T17:57:41.057634] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-31T17:57:41.640935] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-31T17:57:41.857686] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-31T17:57:42.594123] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-31T17:57:42.657673] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-31T17:57:43.457679] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-31T17:57:43.588591] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-31T17:57:44.210566] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T17:57:44.257605] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-31T17:57:45.057682] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-31T17:57:45.297898] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T17:57:45.304483] [INFO ] [REMOTE ] CLDT: Full fetch complete (37779 records). [2025-10-31T17:57:45.304620] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-31T17:57:45.682859] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-31T17:57:45.683011] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-31T17:57:45.683778] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-31T17:57:45.683885] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-31T17:57:45.684765] [DEBUG] [LOCAL ] CLDT: Trimmed 37779 records to 24949 (keeping 200 days of data) [2025-10-31T17:57:45.828498] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T17:57:45.840238] [DEBUG] [LOCAL ] CLDT: Primary data saved (24949 records). [2025-10-31T17:57:45.840371] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-31T17:57:45.840452] [INFO ] [MAIN ] Update Progress: 463/2365 symbols completed. CLDT took 32.9s. Estimated remaining: 3h 56m 60s. Rate: 8.0 symbols/min [2025-10-31T17:57:45.862877] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-31T17:57:46.006840] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:57:46.053825] [DEBUG] [LOCAL ] CLS: Loaded 53932 existing records from primary storage. [2025-10-31T17:57:46.054146] [INFO ] [MAIN ] CLS: Loaded 53932 existing records. [2025-10-31T17:57:46.225152] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:57:46.225370] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-31T17:57:46.225416] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-31T17:57:46.225982] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-31T17:57:46.226040] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-31T17:57:46.570488] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:57:46.657629] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-31T17:57:46.860344] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-31T17:57:47.457696] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-31T17:57:48.257623] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-31T17:57:48.321283] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-31T17:57:48.387225] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-31T17:57:49.057703] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-31T17:57:49.683465] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-31T17:57:49.857624] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-31T17:57:49.892264] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-31T17:57:50.365184] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-31T17:57:50.657672] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-31T17:57:51.263699] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-31T17:57:51.457696] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-31T17:57:52.257677] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-31T17:57:53.057714] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-31T17:57:53.092260] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T17:57:53.267345] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-31T17:57:53.857669] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-31T17:57:54.657680] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-31T17:57:54.738116] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-31T17:57:55.065101] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T17:57:55.457622] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-31T17:57:55.600082] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-31T17:57:56.257710] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-31T17:57:57.057671] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-31T17:57:57.325151] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-31T17:57:57.358876] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-31T17:57:57.366434] [INFO ] [REMOTE ] CLH: Full fetch complete (42736 records). [2025-10-31T17:57:57.366551] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-31T17:57:57.740225] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-31T17:57:57.740307] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-31T17:57:57.740961] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-31T17:57:57.741053] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-31T17:57:57.741978] [DEBUG] [LOCAL ] CLH: Trimmed 42736 records to 28077 (keeping 200 days of data) [2025-10-31T17:57:57.859537] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-31T17:57:57.909341] [DEBUG] [LOCAL ] CLH: Primary data saved (28077 records). [2025-10-31T17:57:57.909480] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-31T17:57:57.909563] [INFO ] [MAIN ] Update Progress: 464/2365 symbols completed. CLH took 29.2s. Estimated remaining: 3h 57m 11s. Rate: 8.0 symbols/min [2025-10-31T17:57:58.079191] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:57:58.127360] [DEBUG] [LOCAL ] CLVT: Loaded 52232 existing records from primary storage. [2025-10-31T17:57:58.127695] [INFO ] [MAIN ] CLVT: Loaded 52232 existing records. [2025-10-31T17:57:58.341609] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:57:58.341930] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-31T17:57:58.341985] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-31T17:57:58.342422] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-31T17:57:58.342482] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-31T17:57:58.657950] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-31T17:57:58.749592] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:57:58.782169] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-31T17:57:59.215155] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-31T17:57:59.457691] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-31T17:57:59.623970] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-31T17:58:00.257706] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-31T17:58:00.834443] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-31T17:58:01.057677] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-31T17:58:01.590821] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-31T17:58:01.603293] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-31T17:58:01.603435] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-31T17:58:01.862779] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-31T17:58:02.010279] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-31T17:58:02.010363] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-31T17:58:02.011217] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-31T17:58:02.011282] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-31T17:58:02.012752] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 54521 (keeping 200 days of data) [2025-10-31T17:58:02.332553] [DEBUG] [LOCAL ] CLF: Primary data saved (54521 records). [2025-10-31T17:58:02.332723] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-31T17:58:02.333484] [INFO ] [MAIN ] Update Progress: 465/2365 symbols completed. CLF took 39.5s. Estimated remaining: 3h 56m 51s. Rate: 8.0 symbols/min [2025-10-31T17:58:02.531367] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:58:02.538904] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T17:58:02.537835] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-31T17:58:02.552178] [INFO ] [REMOTE ] CLPR: Full fetch complete (15438 records). [2025-10-31T17:58:02.552334] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-31T17:58:02.552929] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T17:58:02.553012] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T17:58:02.553065] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T17:58:02.553136] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-31T17:58:02.553199] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-31T17:58:02.553237] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-31T17:58:02.553386] [DEBUG] [LOCAL ] CLPR: Deleted derivative data file. [2025-10-31T17:58:02.553543] [INFO ] [MAIN ] Update Progress: 466/2365 symbols completed. CLPR took 23.8s. Estimated remaining: 3h 56m 14s. Rate: 8.0 symbols/min [2025-10-31T17:58:02.659225] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-31T17:58:02.692130] [DEBUG] [LOCAL ] CLW: Loaded 21364 existing records from primary storage. [2025-10-31T17:58:02.740147] [INFO ] [MAIN ] CLW: Loaded 21364 existing records. [2025-10-31T17:58:02.743544] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:58:02.926905] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:58:02.927150] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-31T17:58:02.927207] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-31T17:58:02.927485] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-31T17:58:02.940227] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-31T17:58:03.085836] [DEBUG] [LOCAL ] CLX: Loaded 52243 existing records from primary storage. [2025-10-31T17:58:03.118419] [INFO ] [MAIN ] CLX: Loaded 52243 existing records. [2025-10-31T17:58:03.472277] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-31T17:58:03.459248] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:58:03.516703] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-31T17:58:03.516421] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:58:03.516837] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-31T17:58:03.517348] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-31T17:58:03.517407] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-31T17:58:03.878745] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:58:04.257607] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-31T17:58:04.436770] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-31T17:58:04.585219] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:58:05.061314] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-31T17:58:05.063251] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T17:58:05.857679] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-31T17:58:06.657665] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-31T17:58:06.789609] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-31T17:58:06.822075] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T17:58:07.457735] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-31T17:58:08.009971] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T17:58:08.263319] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-31T17:58:08.267715] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-31T17:58:09.057699] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-31T17:58:09.857629] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-31T17:58:10.126806] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-31T17:58:10.165256] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T17:58:10.657671] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-31T17:58:10.953697] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T17:58:11.457692] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-31T17:58:11.866216] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T17:58:12.257714] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-31T17:58:12.915681] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T17:58:13.021156] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T17:58:13.057637] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-31T17:58:13.857721] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-31T17:58:14.493548] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T17:58:14.657609] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-31T17:58:15.457696] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-31T17:58:15.843207] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-31T17:58:15.886250] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T17:58:16.257673] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-31T17:58:16.959740] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T17:58:17.057617] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-31T17:58:17.140874] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T17:58:17.857693] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-31T17:58:18.555592] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-31T17:58:18.568880] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-31T17:58:18.657729] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-31T17:58:19.457698] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-31T17:58:20.025812] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T17:58:20.121145] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T17:58:20.257621] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-31T17:58:21.025609] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T17:58:21.057610] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-31T17:58:21.857636] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-31T17:58:21.874423] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-31T17:58:22.657673] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-31T17:58:23.215665] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T17:58:23.457686] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-31T17:58:24.219622] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-31T17:58:24.257689] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-31T17:58:24.815360] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T17:58:25.057700] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-31T17:58:25.279225] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-31T17:58:25.284538] [INFO ] [REMOTE ] CLW: Full fetch complete (33367 records). [2025-10-31T17:58:25.284628] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-31T17:58:25.645036] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-31T17:58:25.645108] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-31T17:58:25.645588] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-31T17:58:25.645626] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-31T17:58:25.646331] [DEBUG] [LOCAL ] CLW: Trimmed 33367 records to 21538 (keeping 200 days of data) [2025-10-31T17:58:25.766697] [DEBUG] [LOCAL ] CLW: Primary data saved (21538 records). [2025-10-31T17:58:25.766816] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-31T17:58:25.766890] [INFO ] [MAIN ] Update Progress: 467/2365 symbols completed. CLW took 23.4s. Estimated remaining: 3h 57m 11s. Rate: 8.0 symbols/min [2025-10-31T17:58:25.862913] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-31T17:58:25.933187] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:58:25.976393] [DEBUG] [LOCAL ] CM: Loaded 48341 existing records from primary storage. [2025-10-31T17:58:25.976741] [INFO ] [MAIN ] CM: Loaded 48341 existing records. [2025-10-31T17:58:26.149276] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:58:26.149467] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-31T17:58:26.149512] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-31T17:58:26.149844] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-31T17:58:26.149900] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-31T17:58:26.503777] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:58:26.532622] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T17:58:26.657637] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-31T17:58:27.272521] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T17:58:27.457634] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-31T17:58:27.954547] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T17:58:27.966414] [INFO ] [REMOTE ] CLVT: Full fetch complete (75386 records). [2025-10-31T17:58:27.966542] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-31T17:58:28.257626] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-31T17:58:28.353316] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-31T17:58:28.353398] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-31T17:58:28.354234] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-31T17:58:28.354300] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-31T17:58:28.355822] [DEBUG] [LOCAL ] CLVT: Trimmed 75386 records to 52610 (keeping 200 days of data) [2025-10-31T17:58:28.638024] [DEBUG] [LOCAL ] CLVT: Primary data saved (52610 records). [2025-10-31T17:58:28.638146] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-31T17:58:28.639164] [INFO ] [MAIN ] Update Progress: 468/2365 symbols completed. CLVT took 30.7s. Estimated remaining: 3h 56m 44s. Rate: 8.0 symbols/min [2025-10-31T17:58:28.803671] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:58:28.853003] [DEBUG] [LOCAL ] CMA: Loaded 50479 existing records from primary storage. [2025-10-31T17:58:28.853313] [INFO ] [MAIN ] CMA: Loaded 50479 existing records. [2025-10-31T17:58:29.029472] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:58:29.029876] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-31T17:58:29.029932] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-31T17:58:29.030215] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-31T17:58:29.030273] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-31T17:58:29.062890] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-31T17:58:29.381030] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:58:29.493998] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-31T17:58:29.559331] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T17:58:29.857691] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-31T17:58:30.282953] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T17:58:30.657612] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-31T17:58:31.153626] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T17:58:31.278153] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T17:58:31.290097] [INFO ] [REMOTE ] CLX: Full fetch complete (74148 records). [2025-10-31T17:58:31.290251] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-31T17:58:31.463084] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-31T17:58:31.681128] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-31T17:58:31.681220] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-31T17:58:31.682054] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-31T17:58:31.682115] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-31T17:58:31.683419] [DEBUG] [LOCAL ] CLX: Trimmed 74148 records to 52623 (keeping 200 days of data) [2025-10-31T17:58:32.005922] [DEBUG] [LOCAL ] CLX: Primary data saved (52623 records). [2025-10-31T17:58:32.006044] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-31T17:58:32.006131] [INFO ] [MAIN ] Update Progress: 469/2365 symbols completed. CLX took 29.5s. Estimated remaining: 3h 56m 20s. Rate: 8.0 symbols/min [2025-10-31T17:58:32.170697] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:58:32.197267] [DEBUG] [LOCAL ] CMBT: Loaded 29308 existing records from primary storage. [2025-10-31T17:58:32.197522] [INFO ] [MAIN ] CMBT: Loaded 29308 existing records. [2025-10-31T17:58:32.262813] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-31T17:58:32.379098] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:58:32.379306] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-31T17:58:32.379355] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-31T17:58:32.379595] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-31T17:58:32.379688] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-31T17:58:32.735863] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:58:32.758991] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T17:58:33.057629] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-31T17:58:33.857724] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-31T17:58:33.959788] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-31T17:58:34.410413] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-31T17:58:34.423471] [INFO ] [REMOTE ] CLS: Full fetch complete (77703 records). [2025-10-31T17:58:34.423609] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-31T17:58:34.664718] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-31T17:58:34.824243] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-31T17:58:34.824398] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-31T17:58:34.825265] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-31T17:58:34.825326] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-31T17:58:34.826752] [DEBUG] [LOCAL ] CLS: Trimmed 77703 records to 54320 (keeping 200 days of data) [2025-10-31T17:58:35.143262] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T17:58:35.204047] [DEBUG] [LOCAL ] CLS: Primary data saved (54320 records). [2025-10-31T17:58:35.204181] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-31T17:58:35.204257] [INFO ] [MAIN ] Update Progress: 470/2365 symbols completed. CLS took 49.4s. Estimated remaining: 3h 55m 56s. Rate: 8.0 symbols/min [2025-10-31T17:58:35.384227] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:58:35.396632] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-31T17:58:35.438228] [DEBUG] [LOCAL ] CMC: Loaded 45827 existing records from primary storage. [2025-10-31T17:58:35.438588] [INFO ] [MAIN ] CMC: Loaded 45827 existing records. [2025-10-31T17:58:35.468181] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-31T17:58:35.624547] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:58:35.624832] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-31T17:58:35.624889] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-31T17:58:35.625197] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-31T17:58:35.625253] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-31T17:58:35.971102] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:58:36.157327] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-31T17:58:36.257693] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-31T17:58:37.004053] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T17:58:37.057667] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-31T17:58:37.857668] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-31T17:58:38.370267] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T17:58:38.657659] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-31T17:58:39.257400] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T17:58:39.296201] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T17:58:39.457686] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-31T17:58:40.257692] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-31T17:58:40.677141] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T17:58:41.057706] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-31T17:58:41.577367] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-31T17:58:41.857677] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-31T17:58:42.211609] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T17:58:42.657693] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-31T17:58:42.933503] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T17:58:43.457680] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-31T17:58:44.154957] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-31T17:58:44.257624] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-31T17:58:44.270909] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-31T17:58:45.057730] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-31T17:58:45.440943] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T17:58:45.857695] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-31T17:58:46.349226] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T17:58:46.657666] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-31T17:58:47.280931] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-31T17:58:47.302018] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-31T17:58:47.457638] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-31T17:58:48.257670] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-31T17:58:48.544366] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T17:58:49.057676] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-31T17:58:49.548721] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T17:58:49.857727] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-31T17:58:50.015377] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T17:58:50.657693] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-31T17:58:51.115284] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T17:58:51.457742] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-31T17:58:51.934601] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T17:58:52.257701] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-31T17:58:52.627565] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T17:58:53.057699] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-31T17:58:53.607025] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T17:58:53.857738] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-31T17:58:54.259244] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T17:58:54.657725] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-31T17:58:55.430890] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T17:58:55.442906] [INFO ] [REMOTE ] CMA: Full fetch complete (73448 records). [2025-10-31T17:58:55.443065] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-31T17:58:55.465392] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-31T17:58:55.875037] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-31T17:58:55.875136] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-31T17:58:55.876141] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-31T17:58:55.876275] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-31T17:58:55.877800] [DEBUG] [LOCAL ] CMA: Trimmed 73448 records to 50836 (keeping 200 days of data) [2025-10-31T17:58:56.126735] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T17:58:56.229291] [DEBUG] [LOCAL ] CMA: Primary data saved (50836 records). [2025-10-31T17:58:56.229469] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-31T17:58:56.229576] [INFO ] [MAIN ] Update Progress: 471/2365 symbols completed. CMA took 27.6s. Estimated remaining: 3h 56m 43s. Rate: 8.0 symbols/min [2025-10-31T17:58:56.262698] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-31T17:58:56.398378] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:58:56.405136] [DEBUG] [LOCAL ] CMCM: Loaded 4801 existing records from primary storage. [2025-10-31T17:58:56.405331] [INFO ] [MAIN ] CMCM: Loaded 4801 existing records. [2025-10-31T17:58:56.579431] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:58:56.579764] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-31T17:58:56.579818] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-31T17:58:56.579967] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-31T17:58:56.580021] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-31T17:58:56.952959] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:58:56.976562] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-31T17:58:57.057607] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-31T17:58:57.789819] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-31T17:58:57.857623] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-31T17:58:58.184150] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T17:58:58.657639] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-31T17:58:59.417140] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-31T17:58:59.428576] [INFO ] [REMOTE ] CMBT: Full fetch complete (35727 records). [2025-10-31T17:58:59.428713] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-31T17:58:59.462767] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-31T17:58:59.802666] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-31T17:58:59.802848] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-31T17:58:59.803444] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-31T17:58:59.803519] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-31T17:58:59.804682] [DEBUG] [LOCAL ] CMBT: Trimmed 35727 records to 29696 (keeping 200 days of data) [2025-10-31T17:58:59.997289] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-31T17:58:59.996878] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T17:59:00.017490] [DEBUG] [LOCAL ] CMBT: Primary data saved (29696 records). [2025-10-31T17:59:00.017703] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-31T17:59:00.017788] [INFO ] [MAIN ] Update Progress: 472/2365 symbols completed. CMBT took 28.0s. Estimated remaining: 3h 56m 20s. Rate: 8.0 symbols/min [2025-10-31T17:59:00.184554] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:00.184741] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-31T17:59:00.184788] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-31T17:59:00.184913] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-31T17:59:00.184955] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-31T17:59:00.184997] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-31T17:59:00.185031] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-31T17:59:00.262785] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-31T17:59:00.539747] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:00.778031] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T17:59:01.057686] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-31T17:59:01.505416] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-31T17:59:01.857722] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-31T17:59:02.029349] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T17:59:02.029696] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-31T17:59:02.029772] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T17:59:02.029810] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-31T17:59:02.029868] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T17:59:02.029938] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-31T17:59:02.030000] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-31T17:59:02.030035] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-31T17:59:02.030073] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-31T17:59:02.030118] [INFO ] [MAIN ] Update Progress: 473/2365 symbols completed. CMDB took 2.0s. Estimated remaining: 3h 55m 51s. Rate: 8.0 symbols/min [2025-10-31T17:59:02.197455] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:02.251960] [DEBUG] [LOCAL ] CMG: Loaded 54113 existing records from primary storage. [2025-10-31T17:59:02.252393] [INFO ] [MAIN ] CMG: Loaded 54113 existing records. [2025-10-31T17:59:02.458612] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:59:02.458857] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-31T17:59:02.458905] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-31T17:59:02.459351] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-31T17:59:02.459409] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-31T17:59:02.661720] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-31T17:59:02.901928] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:03.457705] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-31T17:59:04.257735] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-31T17:59:04.583964] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-31T17:59:04.594736] [INFO ] [REMOTE ] CM: Full fetch complete (69633 records). [2025-10-31T17:59:04.594864] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-31T17:59:04.987078] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-31T17:59:05.002122] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-31T17:59:05.014845] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-31T17:59:05.015151] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-31T17:59:05.017449] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-31T17:59:05.028897] [DEBUG] [LOCAL ] CM: Trimmed 69633 records to 48697 (keeping 200 days of data) [2025-10-31T17:59:05.083287] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-31T17:59:05.325543] [DEBUG] [LOCAL ] CM: Primary data saved (48697 records). [2025-10-31T17:59:05.325707] [INFO ] [MAIN ] CM: Full history saved. [2025-10-31T17:59:05.325796] [INFO ] [MAIN ] Update Progress: 474/2365 symbols completed. CM took 39.6s. Estimated remaining: 3h 55m 27s. Rate: 8.0 symbols/min [2025-10-31T17:59:05.493324] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:05.535458] [DEBUG] [LOCAL ] CMI: Loaded 41658 existing records from primary storage. [2025-10-31T17:59:05.535772] [INFO ] [MAIN ] CMI: Loaded 41658 existing records. [2025-10-31T17:59:05.715725] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:59:05.715981] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-31T17:59:05.716030] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-31T17:59:05.716349] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-31T17:59:05.716408] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-31T17:59:05.868742] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-31T17:59:06.082603] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:06.118436] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-31T17:59:06.227799] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T17:59:06.324972] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T17:59:06.657700] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-31T17:59:07.457707] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-31T17:59:08.258222] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-31T17:59:08.259933] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T17:59:08.568396] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-31T17:59:09.057684] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-31T17:59:09.091061] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T17:59:09.105967] [INFO ] [REMOTE ] CMC: Full fetch complete (67116 records). [2025-10-31T17:59:09.106135] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-31T17:59:09.490192] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-31T17:59:09.490288] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-31T17:59:09.491143] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-31T17:59:09.491217] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-31T17:59:09.492593] [DEBUG] [LOCAL ] CMC: Trimmed 67116 records to 46144 (keeping 200 days of data) [2025-10-31T17:59:09.767080] [DEBUG] [LOCAL ] CMC: Primary data saved (46144 records). [2025-10-31T17:59:09.767202] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-31T17:59:09.767276] [INFO ] [MAIN ] Update Progress: 475/2365 symbols completed. CMC took 34.6s. Estimated remaining: 3h 55m 7s. Rate: 8.0 symbols/min [2025-10-31T17:59:09.862810] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-31T17:59:09.948350] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:09.981732] [DEBUG] [LOCAL ] CMP: Loaded 35290 existing records from primary storage. [2025-10-31T17:59:09.982065] [INFO ] [MAIN ] CMP: Loaded 35290 existing records. [2025-10-31T17:59:10.171053] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:59:10.171814] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-31T17:59:10.172082] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-31T17:59:10.172426] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-31T17:59:10.172525] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-31T17:59:10.331568] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T17:59:10.603586] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-31T17:59:10.603287] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:10.657623] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-31T17:59:11.064884] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T17:59:11.457705] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-31T17:59:12.257697] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-31T17:59:12.653896] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-31T17:59:13.056493] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-31T17:59:13.060145] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-31T17:59:13.857736] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-31T17:59:14.401361] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T17:59:14.657730] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-31T17:59:15.457765] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-31T17:59:15.629135] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-31T17:59:16.063223] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T17:59:16.257669] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-31T17:59:16.445840] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T17:59:17.057740] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-31T17:59:17.389825] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T17:59:17.857746] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-31T17:59:18.115189] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T17:59:18.326251] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T17:59:18.657714] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-31T17:59:19.178990] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-31T17:59:19.181349] [INFO ] [REMOTE ] CMCM: Full fetch complete (7062 records). [2025-10-31T17:59:19.181437] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-31T17:59:19.462855] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-31T17:59:19.563845] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-31T17:59:19.563927] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-31T17:59:19.564181] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-31T17:59:19.564244] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-31T17:59:19.564662] [DEBUG] [LOCAL ] CMCM: Trimmed 7062 records to 4837 (keeping 200 days of data) [2025-10-31T17:59:19.591445] [DEBUG] [LOCAL ] CMCM: Primary data saved (4837 records). [2025-10-31T17:59:19.591562] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-31T17:59:19.591701] [INFO ] [MAIN ] Update Progress: 476/2365 symbols completed. CMCM took 23.4s. Estimated remaining: 3h 55m 9s. Rate: 8.0 symbols/min [2025-10-31T17:59:19.768759] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:19.768937] [DEBUG] [LOCAL ] CMPO: No existing data file found in primary storage. [2025-10-31T17:59:19.768973] [WARN ] [MAIN ] CMPO: No existing data found, performing full refresh instead. [2025-10-31T17:59:19.769087] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-31T17:59:19.769129] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-31T17:59:19.769172] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-10-31T17:59:19.769206] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-31T17:59:20.143848] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:20.257613] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-31T17:59:20.505614] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T17:59:21.057699] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-31T17:59:21.453360] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T17:59:21.857677] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-31T17:59:22.194077] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T17:59:22.657618] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-31T17:59:22.692238] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T17:59:23.457638] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-31T17:59:23.722030] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T17:59:24.257670] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-31T17:59:24.619358] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T17:59:25.057671] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-31T17:59:25.674473] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T17:59:25.857612] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-31T17:59:26.074729] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T17:59:26.657663] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-31T17:59:27.457631] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-31T17:59:27.496132] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T17:59:27.677189] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T17:59:28.257671] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-31T17:59:28.435504] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-31T17:59:29.057681] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-31T17:59:29.869889] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-31T17:59:29.876497] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-31T17:59:30.140446] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T17:59:30.657638] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-31T17:59:30.873283] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T17:59:31.457638] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-31T17:59:32.257721] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-31T17:59:32.301568] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-31T17:59:32.565006] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T17:59:33.057672] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-31T17:59:33.287362] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T17:59:33.857682] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-31T17:59:34.244771] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T17:59:34.657677] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-31T17:59:35.055752] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T17:59:35.457672] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-31T17:59:36.181718] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T17:59:36.193151] [INFO ] [REMOTE ] CMI: Full fetch complete (61155 records). [2025-10-31T17:59:36.193391] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-31T17:59:36.264575] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-31T17:59:36.659966] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-31T17:59:36.660050] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-31T17:59:36.661057] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-31T17:59:36.661134] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-31T17:59:36.662518] [DEBUG] [LOCAL ] CMI: Trimmed 61155 records to 41900 (keeping 200 days of data) [2025-10-31T17:59:36.940067] [DEBUG] [LOCAL ] CMI: Primary data saved (41900 records). [2025-10-31T17:59:36.940270] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-31T17:59:36.941165] [INFO ] [MAIN ] Update Progress: 477/2365 symbols completed. CMI took 31.6s. Estimated remaining: 3h 55m 41s. Rate: 8.0 symbols/min [2025-10-31T17:59:37.057626] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-31T17:59:37.189835] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-31T17:59:37.460771] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T17:59:37.857678] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-31T17:59:38.009091] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-31T17:59:38.657677] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-31T17:59:39.457702] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-31T17:59:39.517561] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T17:59:39.575801] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-31T17:59:40.257720] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-31T17:59:40.563424] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T17:59:41.057682] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-31T17:59:41.300799] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T17:59:41.307475] [INFO ] [REMOTE ] CMP: Full fetch complete (51221 records). [2025-10-31T17:59:41.307586] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-31T17:59:41.686570] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-31T17:59:41.686668] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-31T17:59:41.687306] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-31T17:59:41.687348] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-31T17:59:41.689953] [DEBUG] [LOCAL ] CMP: Trimmed 51221 records to 35473 (keeping 200 days of data) [2025-10-31T17:59:41.867393] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-31T17:59:41.894417] [DEBUG] [LOCAL ] CMP: Primary data saved (35473 records). [2025-10-31T17:59:41.894558] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-31T17:59:41.894661] [INFO ] [MAIN ] Update Progress: 478/2365 symbols completed. CMP took 32.1s. Estimated remaining: 3h 55m 23s. Rate: 8.0 symbols/min [2025-10-31T17:59:42.226975] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T17:59:42.234346] [INFO ] [REMOTE ] CMPO: Full fetch complete (57403 records). [2025-10-31T17:59:42.234458] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-31T17:59:42.607173] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-31T17:59:42.607252] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-31T17:59:42.607967] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-31T17:59:42.608031] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-31T17:59:42.609167] [DEBUG] [LOCAL ] CMPO: Trimmed 57403 records to 38168 (keeping 200 days of data) [2025-10-31T17:59:42.826194] [DEBUG] [LOCAL ] CMPO: Primary data saved (38168 records). [2025-10-31T17:59:42.826336] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-31T17:59:42.826407] [INFO ] [MAIN ] Update Progress: 479/2365 symbols completed. CMPO took 23.2s. Estimated remaining: 3h 54m 50s. Rate: 8.0 symbols/min [2025-10-31T17:59:43.667195] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-31T17:59:43.679056] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-31T17:59:45.538222] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-31T17:59:45.550452] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-31T17:59:45.550582] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-31T17:59:45.939611] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-31T17:59:45.939717] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-31T17:59:45.940564] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-31T17:59:45.940605] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-31T17:59:45.941996] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 54503 (keeping 200 days of data) [2025-10-31T17:59:46.254350] [DEBUG] [LOCAL ] CMG: Primary data saved (54503 records). [2025-10-31T17:59:46.254470] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-31T17:59:46.254543] [INFO ] [MAIN ] Update Progress: 480/2365 symbols completed. CMG took 44.2s. Estimated remaining: 3h 54m 26s. Rate: 8.0 symbols/min [2025-10-31T17:59:46.834925] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:46.882052] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:46.900458] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:46.989876] [DEBUG] [LOCAL ] CMSC: Loaded 4572 existing records from primary storage. [2025-10-31T17:59:46.990084] [DEBUG] [LOCAL ] CMSA: Loaded 3413 existing records from primary storage. [2025-10-31T17:59:46.987225] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T17:59:46.990325] [INFO ] [MAIN ] CMSC: Loaded 4572 existing records. [2025-10-31T17:59:46.990493] [INFO ] [MAIN ] CMSA: Loaded 3413 existing records. [2025-10-31T17:59:47.366611] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:59:47.417278] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:59:47.417576] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-31T17:59:47.418766] [DEBUG] [LOCAL ] CMRE: Loaded 35312 existing records from primary storage. [2025-10-31T17:59:47.418997] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-31T17:59:47.419749] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-31T17:59:47.419916] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-31T17:59:47.420150] [INFO ] [MAIN ] CMRE: Loaded 35312 existing records. [2025-10-31T17:59:47.463294] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-31T17:59:47.480170] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-31T17:59:47.480090] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-31T17:59:47.546797] [DEBUG] [LOCAL ] CMS: Loaded 52878 existing records from primary storage. [2025-10-31T17:59:47.546069] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-31T17:59:47.610728] [INFO ] [MAIN ] CMS: Loaded 52878 existing records. [2025-10-31T17:59:48.074471] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:59:48.251999] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-31T17:59:48.329685] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-31T17:59:48.375789] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T17:59:48.386601] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-31T17:59:48.430837] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-31T17:59:48.422718] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-31T17:59:48.498314] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-31T17:59:48.553667] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:48.632832] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-31T17:59:48.676327] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:48.665041] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-31T17:59:48.632775] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-31T17:59:48.721619] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-31T17:59:49.247524] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:49.258199] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-31T17:59:49.291896] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-31T17:59:49.317452] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-31T17:59:49.332707] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T17:59:49.333890] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-31T17:59:49.428078] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-31T17:59:49.429704] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-31T17:59:49.642492] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-31T17:59:49.643823] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-31T17:59:49.777417] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-31T17:59:49.778859] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-31T17:59:50.009527] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-31T17:59:50.010849] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-31T17:59:50.231570] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-31T17:59:50.330287] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T17:59:50.355855] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-31T17:59:50.647722] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T17:59:50.658088] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-31T17:59:51.457699] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-31T17:59:51.831634] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-31T17:59:51.844625] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T17:59:52.257681] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-31T17:59:53.057680] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-31T17:59:53.170848] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T17:59:53.411256] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-31T17:59:53.857666] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-31T17:59:54.220226] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-31T17:59:54.657668] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-31T17:59:55.457699] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-31T17:59:55.908208] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-31T17:59:55.950498] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T17:59:56.257712] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-31T17:59:57.057677] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-31T17:59:57.414305] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-31T17:59:57.614296] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T17:59:57.857694] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-31T17:59:58.657612] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-31T17:59:58.855474] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T17:59:59.013335] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-31T17:59:59.457684] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-31T18:00:00.257673] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-31T18:00:00.821530] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-31T18:00:00.908362] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T18:00:01.057675] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-31T18:00:01.857685] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-31T18:00:02.363556] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T18:00:02.411452] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-31T18:00:02.413942] [INFO ] [REMOTE ] CMSA: Full fetch complete (4758 records). [2025-10-31T18:00:02.414157] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-31T18:00:02.664404] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-31T18:00:02.835469] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-31T18:00:02.835550] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-31T18:00:02.835730] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-31T18:00:02.835793] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-31T18:00:02.836296] [DEBUG] [LOCAL ] CMSA: Trimmed 4758 records to 3435 (keeping 200 days of data) [2025-10-31T18:00:02.858626] [DEBUG] [LOCAL ] CMSA: Primary data saved (3435 records). [2025-10-31T18:00:02.858804] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-31T18:00:02.858892] [INFO ] [MAIN ] Update Progress: 481/2365 symbols completed. CMSA took 16.6s. Estimated remaining: 3h 54m 55s. Rate: 8.0 symbols/min [2025-10-31T18:00:03.054804] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:00:03.064029] [DEBUG] [LOCAL ] CMSD: Loaded 7366 existing records from primary storage. [2025-10-31T18:00:03.064291] [INFO ] [MAIN ] CMSD: Loaded 7366 existing records. [2025-10-31T18:00:03.328140] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:00:03.328451] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-31T18:00:03.328524] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-31T18:00:03.328837] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-31T18:00:03.328896] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-31T18:00:03.463221] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-31T18:00:03.912010] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:00:03.919149] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-31T18:00:03.949363] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T18:00:04.257722] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-31T18:00:05.057638] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-31T18:00:05.418493] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T18:00:05.418701] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-31T18:00:05.857703] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-31T18:00:06.657705] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-31T18:00:06.949130] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T18:00:07.458494] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-31T18:00:07.462697] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-31T18:00:08.257616] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-31T18:00:08.419771] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T18:00:09.057675] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-31T18:00:09.475067] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-31T18:00:09.539423] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T18:00:09.857629] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-31T18:00:10.208046] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-31T18:00:10.657633] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-31T18:00:11.457766] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-31T18:00:11.949604] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-31T18:00:11.951076] [INFO ] [REMOTE ] CMSC: Full fetch complete (6841 records). [2025-10-31T18:00:11.951147] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-31T18:00:12.264594] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-31T18:00:12.306163] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-31T18:00:12.306246] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-31T18:00:12.306465] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-31T18:00:12.306506] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-31T18:00:12.306943] [DEBUG] [LOCAL ] CMSC: Trimmed 6841 records to 4623 (keeping 200 days of data) [2025-10-31T18:00:12.335323] [DEBUG] [LOCAL ] CMSC: Primary data saved (4623 records). [2025-10-31T18:00:12.335431] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-31T18:00:12.335508] [INFO ] [MAIN ] Update Progress: 482/2365 symbols completed. CMSC took 26.1s. Estimated remaining: 3h 54m 55s. Rate: 8.0 symbols/min [2025-10-31T18:00:12.514462] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:00:12.514677] [DEBUG] [LOCAL ] CMTG: No existing data file found in primary storage. [2025-10-31T18:00:12.514730] [WARN ] [MAIN ] CMTG: No existing data found, performing full refresh instead. [2025-10-31T18:00:12.514844] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-31T18:00:12.514898] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-31T18:00:12.514980] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-31T18:00:12.515063] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-31T18:00:12.876321] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-31T18:00:12.957411] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:00:13.057675] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-31T18:00:13.857734] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-31T18:00:14.100324] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T18:00:14.474537] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T18:00:14.657682] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-31T18:00:15.457677] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-31T18:00:15.740007] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T18:00:15.979780] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (4.52 seconds). [2025-10-31T18:00:16.257680] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-31T18:00:16.550104] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T18:00:17.057630] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-31T18:00:17.164332] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T18:00:17.857674] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-31T18:00:18.178006] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T18:00:18.657723] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-31T18:00:19.044366] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T18:00:19.457675] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-31T18:00:19.783084] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T18:00:20.257671] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-31T18:00:20.745443] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-31T18:00:20.753976] [INFO ] [REMOTE ] CMRE: Full fetch complete (51185 records). [2025-10-31T18:00:20.754171] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-31T18:00:21.057739] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-31T18:00:21.179932] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-31T18:00:21.179778] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T18:00:21.180145] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-31T18:00:21.192102] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-31T18:00:21.192377] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-31T18:00:21.192747] [INFO ] [REMOTE ] CMS: Full fetch complete (75880 records). [2025-10-31T18:00:21.193247] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-31T18:00:21.194459] [DEBUG] [LOCAL ] CMRE: Trimmed 51185 records to 35544 (keeping 200 days of data) [2025-10-31T18:00:21.194348] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:00:21.194957] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:00:21.195334] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:00:21.195432] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-31T18:00:21.195529] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-31T18:00:21.195585] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-31T18:00:21.195873] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-31T18:00:21.196007] [INFO ] [MAIN ] Update Progress: 483/2365 symbols completed. CMS took 34.9s. Estimated remaining: 3h 54m 53s. Rate: 8.0 symbols/min [2025-10-31T18:00:21.473030] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:00:21.475419] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-31T18:00:21.475737] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-31T18:00:21.480553] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-31T18:00:21.482589] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-31T18:00:21.483178] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-31T18:00:21.483240] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-31T18:00:21.865987] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-31T18:00:21.924423] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-31T18:00:21.949742] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:00:21.962660] [DEBUG] [LOCAL ] CMRE: Primary data saved (35544 records). [2025-10-31T18:00:21.962792] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-31T18:00:21.962873] [INFO ] [MAIN ] Update Progress: 484/2365 symbols completed. CMRE took 35.7s. Estimated remaining: 3h 54m 19s. Rate: 8.0 symbols/min [2025-10-31T18:00:22.130801] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:00:22.130981] [DEBUG] [LOCAL ] CNA: No existing data file found in primary storage. [2025-10-31T18:00:22.131019] [WARN ] [MAIN ] CNA: No existing data found, performing full refresh instead. [2025-10-31T18:00:22.131170] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-31T18:00:22.131235] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-31T18:00:22.131282] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-31T18:00:22.131316] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-31T18:00:22.492543] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:00:22.657670] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-31T18:00:22.952625] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T18:00:23.074378] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-31T18:00:23.457718] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-31T18:00:24.014611] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-31T18:00:24.257685] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-31T18:00:25.057688] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-31T18:00:25.453365] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T18:00:25.557782] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-31T18:00:25.857636] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-31T18:00:26.325732] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-31T18:00:26.657697] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-31T18:00:27.457683] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-31T18:00:27.685570] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T18:00:27.923295] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-31T18:00:28.257698] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-31T18:00:29.057684] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-31T18:00:29.228740] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T18:00:29.445875] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-31T18:00:29.857678] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-31T18:00:30.268871] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-31T18:00:30.657639] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-31T18:00:31.457688] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-31T18:00:31.562709] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T18:00:32.183842] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-31T18:00:32.185782] [INFO ] [REMOTE ] CMSD: Full fetch complete (11249 records). [2025-10-31T18:00:32.185867] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-31T18:00:32.262745] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-31T18:00:32.558577] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-31T18:00:32.558680] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-31T18:00:32.558983] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-31T18:00:32.559037] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-31T18:00:32.559584] [DEBUG] [LOCAL ] CMSD: Trimmed 11249 records to 7433 (keeping 200 days of data) [2025-10-31T18:00:32.605780] [DEBUG] [LOCAL ] CMSD: Primary data saved (7433 records). [2025-10-31T18:00:32.605896] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-31T18:00:32.605971] [INFO ] [MAIN ] Update Progress: 485/2365 symbols completed. CMSD took 29.7s. Estimated remaining: 3h 54m 24s. Rate: 8.0 symbols/min [2025-10-31T18:00:32.785077] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:00:32.792025] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T18:00:32.842945] [DEBUG] [LOCAL ] CNC: Loaded 54170 existing records from primary storage. [2025-10-31T18:00:32.843245] [INFO ] [MAIN ] CNC: Loaded 54170 existing records. [2025-10-31T18:00:33.015673] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:00:33.015952] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-31T18:00:33.016009] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-31T18:00:33.017260] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-31T18:00:33.017317] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-31T18:00:33.062909] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-31T18:00:33.369817] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:00:33.716530] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T18:00:33.857714] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-31T18:00:34.657805] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-31T18:00:34.754520] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-31T18:00:34.760963] [INFO ] [REMOTE ] CMTG: Full fetch complete (52233 records). [2025-10-31T18:00:34.761086] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-31T18:00:35.134462] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-31T18:00:35.134612] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-31T18:00:35.136111] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-31T18:00:35.137047] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-31T18:00:35.137110] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-31T18:00:35.138129] [DEBUG] [LOCAL ] CMTG: Trimmed 52233 records to 34545 (keeping 200 days of data) [2025-10-31T18:00:35.324673] [DEBUG] [LOCAL ] CMTG: Primary data saved (34545 records). [2025-10-31T18:00:35.324812] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-31T18:00:35.324883] [INFO ] [MAIN ] Update Progress: 486/2365 symbols completed. CMTG took 23.0s. Estimated remaining: 3h 53m 58s. Rate: 8.0 symbols/min [2025-10-31T18:00:35.462281] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-31T18:00:35.496940] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:00:35.508098] [DEBUG] [LOCAL ] CNF: Loaded 10605 existing records from primary storage. [2025-10-31T18:00:35.508405] [INFO ] [MAIN ] CNF: Loaded 10605 existing records. [2025-10-31T18:00:35.681173] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:00:35.681378] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-31T18:00:35.681424] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-31T18:00:35.681611] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-31T18:00:35.681707] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-31T18:00:36.052524] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:00:36.257680] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-31T18:00:36.499116] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T18:00:36.710607] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-31T18:00:37.057719] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-31T18:00:37.857638] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-31T18:00:37.940021] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T18:00:38.149674] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-31T18:00:38.657746] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-31T18:00:39.457686] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-31T18:00:39.686981] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T18:00:40.257634] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-31T18:00:40.734485] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-31T18:00:40.819199] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T18:00:41.057672] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-31T18:00:41.857671] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-31T18:00:42.422715] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T18:00:42.657684] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-31T18:00:42.739810] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T18:00:43.219931] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-31T18:00:43.457699] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-31T18:00:44.257727] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-31T18:00:44.629447] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T18:00:44.682909] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T18:00:45.057672] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-31T18:00:45.548355] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T18:00:45.857685] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-31T18:00:46.534818] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T18:00:46.657675] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-31T18:00:47.457619] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-31T18:00:47.599064] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T18:00:48.057527] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T18:00:48.257684] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-31T18:00:48.673462] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-31T18:00:49.057676] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-31T18:00:49.472725] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T18:00:49.857693] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-31T18:00:50.345228] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-31T18:00:50.346570] [INFO ] [REMOTE ] CMU: Full fetch complete (9449 records). [2025-10-31T18:00:50.346638] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-31T18:00:50.672702] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-31T18:00:50.720876] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-31T18:00:50.720967] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-31T18:00:50.721306] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-31T18:00:50.721352] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-31T18:00:50.722023] [DEBUG] [LOCAL ] CMU: Trimmed 9449 records to 5865 (keeping 200 days of data) [2025-10-31T18:00:50.762597] [DEBUG] [LOCAL ] CMU: Primary data saved (5865 records). [2025-10-31T18:00:50.762763] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-31T18:00:50.762842] [INFO ] [MAIN ] Update Progress: 487/2365 symbols completed. CMU took 29.6s. Estimated remaining: 3h 54m 22s. Rate: 8.0 symbols/min [2025-10-31T18:00:51.009459] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:00:51.009701] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-31T18:00:51.009770] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-31T18:00:51.009912] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-31T18:00:51.010021] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-31T18:00:51.010107] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-31T18:00:51.010164] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-31T18:00:51.462989] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-31T18:00:51.539873] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:00:51.771838] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T18:00:52.257690] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-31T18:00:52.775016] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T18:00:52.795875] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T18:00:53.057725] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-31T18:00:53.735567] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T18:00:53.857688] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-31T18:00:54.657696] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-31T18:00:54.939087] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T18:00:55.457704] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-31T18:00:56.181087] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T18:00:56.257702] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-31T18:00:56.960683] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-31T18:00:57.057632] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-31T18:00:57.451805] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T18:00:57.857682] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-31T18:00:58.399194] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T18:00:58.657703] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-31T18:00:59.051989] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T18:00:59.457675] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-31T18:00:59.738317] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T18:01:00.257692] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-31T18:01:01.058029] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-31T18:01:01.063797] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-31T18:01:01.271037] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T18:01:01.840175] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T18:01:01.857708] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-31T18:01:02.410980] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-31T18:01:02.412728] [INFO ] [REMOTE ] CNF: Full fetch complete (12922 records). [2025-10-31T18:01:02.412801] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-31T18:01:02.662756] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-31T18:01:02.774844] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-31T18:01:02.774920] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-31T18:01:02.775226] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-31T18:01:02.775267] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-31T18:01:02.775778] [DEBUG] [LOCAL ] CNF: Trimmed 12922 records to 10615 (keeping 200 days of data) [2025-10-31T18:01:02.832292] [DEBUG] [LOCAL ] CNF: Primary data saved (10615 records). [2025-10-31T18:01:02.832416] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-31T18:01:02.832495] [INFO ] [MAIN ] Update Progress: 488/2365 symbols completed. CNF took 27.5s. Estimated remaining: 3h 54m 32s. Rate: 8.0 symbols/min [2025-10-31T18:01:03.001203] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:01:03.001378] [DEBUG] [LOCAL ] CNI: No existing data file found in primary storage. [2025-10-31T18:01:03.001462] [WARN ] [MAIN ] CNI: No existing data found, performing full refresh instead. [2025-10-31T18:01:03.001547] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-31T18:01:03.001585] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-31T18:01:03.001627] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-31T18:01:03.001694] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-31T18:01:03.354381] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:01:03.457633] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-31T18:01:04.257637] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-31T18:01:04.577527] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T18:01:04.584864] [INFO ] [REMOTE ] CNA: Full fetch complete (46524 records). [2025-10-31T18:01:04.584979] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-31T18:01:04.933104] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-31T18:01:05.027917] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-31T18:01:05.027997] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-31T18:01:05.028597] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-31T18:01:05.028636] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-31T18:01:05.029581] [DEBUG] [LOCAL ] CNA: Trimmed 46524 records to 32853 (keeping 200 days of data) [2025-10-31T18:01:05.089388] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-31T18:01:05.229318] [DEBUG] [LOCAL ] CNA: Primary data saved (32853 records). [2025-10-31T18:01:05.229444] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-31T18:01:05.229515] [INFO ] [MAIN ] Update Progress: 489/2365 symbols completed. CNA took 43.3s. Estimated remaining: 3h 54m 5s. Rate: 8.0 symbols/min [2025-10-31T18:01:05.397396] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:01:05.444590] [DEBUG] [LOCAL ] CNK: Loaded 53251 existing records from primary storage. [2025-10-31T18:01:05.444952] [INFO ] [MAIN ] CNK: Loaded 53251 existing records. [2025-10-31T18:01:05.628251] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:01:05.628547] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-31T18:01:05.628600] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-31T18:01:05.629456] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-31T18:01:05.629513] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-31T18:01:05.870689] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-31T18:01:06.000998] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:01:06.020624] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-31T18:01:06.461703] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T18:01:06.657709] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-31T18:01:07.457667] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-31T18:01:07.691847] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-31T18:01:07.913277] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T18:01:08.257696] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-31T18:01:08.792886] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-31T18:01:09.057709] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-31T18:01:09.857699] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-31T18:01:10.464790] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T18:01:10.657630] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-31T18:01:11.292167] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T18:01:11.413703] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (3.16 seconds). [2025-10-31T18:01:11.457620] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-31T18:01:12.035797] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T18:01:12.257682] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-31T18:01:12.499331] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T18:01:13.057682] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-31T18:01:13.857628] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-31T18:01:13.950623] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-31T18:01:14.307886] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T18:01:14.657673] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-31T18:01:15.115557] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T18:01:15.457721] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-31T18:01:16.140133] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T18:01:16.199475] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-31T18:01:16.212085] [INFO ] [REMOTE ] CNC: Full fetch complete (77869 records). [2025-10-31T18:01:16.212256] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-31T18:01:16.264990] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-31T18:01:16.600934] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-31T18:01:16.601022] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-31T18:01:16.601942] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-31T18:01:16.602005] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-31T18:01:16.603434] [DEBUG] [LOCAL ] CNC: Trimmed 77869 records to 54560 (keeping 200 days of data) [2025-10-31T18:01:16.935451] [DEBUG] [LOCAL ] CNC: Primary data saved (54560 records). [2025-10-31T18:01:16.935584] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-31T18:01:16.936358] [INFO ] [MAIN ] Update Progress: 490/2365 symbols completed. CNC took 44.3s. Estimated remaining: 3h 54m 13s. Rate: 8.0 symbols/min [2025-10-31T18:01:17.062737] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-31T18:01:17.106250] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:01:17.106393] [DEBUG] [LOCAL ] CNM: No existing data file found in primary storage. [2025-10-31T18:01:17.106434] [WARN ] [MAIN ] CNM: No existing data found, performing full refresh instead. [2025-10-31T18:01:17.106550] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-31T18:01:17.106590] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-31T18:01:17.106678] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-31T18:01:17.106730] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-31T18:01:17.460167] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:01:17.647548] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T18:01:17.857703] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-31T18:01:18.468141] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T18:01:18.657672] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-31T18:01:19.316499] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T18:01:19.457705] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-31T18:01:19.934150] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T18:01:20.257666] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-31T18:01:21.057743] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-31T18:01:21.158506] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-31T18:01:21.172568] [INFO ] [REMOTE ] CNH: Full fetch complete (77315 records). [2025-10-31T18:01:21.172867] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-31T18:01:21.173922] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:01:21.174012] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:01:21.174056] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:01:21.174130] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-31T18:01:21.174198] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-31T18:01:21.174237] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-31T18:01:21.174275] [DEBUG] [LOCAL ] CNH: No derivative data file found to delete. [2025-10-31T18:01:21.174340] [INFO ] [MAIN ] Update Progress: 491/2365 symbols completed. CNH took 30.4s. Estimated remaining: 3h 53m 53s. Rate: 8.0 symbols/min [2025-10-31T18:01:21.349704] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:01:21.349883] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-31T18:01:21.349921] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-31T18:01:21.350030] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-31T18:01:21.350071] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-31T18:01:21.350113] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-31T18:01:21.350147] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-31T18:01:21.729563] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:01:21.773316] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-31T18:01:21.857635] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-31T18:01:22.218292] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T18:01:22.657701] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-31T18:01:22.838571] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:01:23.457681] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-31T18:01:24.075165] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-31T18:01:24.257688] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-31T18:01:24.579126] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T18:01:25.057693] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-31T18:01:25.304624] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-31T18:01:25.857698] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-31T18:01:26.463259] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T18:01:26.657671] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-31T18:01:27.164255] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T18:01:27.457683] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-31T18:01:27.650768] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T18:01:28.257678] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-31T18:01:28.654238] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T18:01:29.057690] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-31T18:01:29.857728] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-31T18:01:30.074341] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-31T18:01:30.112389] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T18:01:30.657673] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-31T18:01:31.457676] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-31T18:01:31.799288] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-31T18:01:31.811478] [INFO ] [REMOTE ] CNK: Full fetch complete (76383 records). [2025-10-31T18:01:31.811632] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-31T18:01:32.225014] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-31T18:01:32.225163] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-31T18:01:32.226095] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-31T18:01:32.226174] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-31T18:01:32.227790] [DEBUG] [LOCAL ] CNK: Trimmed 76383 records to 53619 (keeping 200 days of data) [2025-10-31T18:01:32.296193] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-31T18:01:32.361661] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-31T18:01:32.557071] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T18:01:32.657615] [DEBUG] [LOCAL ] CNK: Primary data saved (53619 records). [2025-10-31T18:01:32.657796] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-31T18:01:32.657908] [INFO ] [MAIN ] Update Progress: 492/2365 symbols completed. CNK took 27.4s. Estimated remaining: 3h 54m 1s. Rate: 8.0 symbols/min [2025-10-31T18:01:32.832712] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:01:32.832924] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-31T18:01:32.832962] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-31T18:01:32.833074] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-31T18:01:32.833116] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-31T18:01:32.833157] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-31T18:01:32.833190] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-31T18:01:33.062854] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-31T18:01:33.212455] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:01:33.719525] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T18:01:33.857632] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-31T18:01:34.539040] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-31T18:01:34.657620] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-31T18:01:34.681353] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T18:01:35.457686] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-31T18:01:36.257624] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-31T18:01:36.895070] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-31T18:01:36.908577] [INFO ] [REMOTE ] CNI: Full fetch complete (74819 records). [2025-10-31T18:01:36.908828] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-31T18:01:37.071976] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-31T18:01:37.318876] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-31T18:01:37.363689] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-31T18:01:37.363800] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-31T18:01:37.364963] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-31T18:01:37.365029] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-31T18:01:37.366706] [DEBUG] [LOCAL ] CNI: Trimmed 74819 records to 52304 (keeping 200 days of data) [2025-10-31T18:01:37.708586] [DEBUG] [LOCAL ] CNI: Primary data saved (52304 records). [2025-10-31T18:01:37.708797] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-31T18:01:37.708894] [INFO ] [MAIN ] Update Progress: 493/2365 symbols completed. CNI took 34.9s. Estimated remaining: 3h 53m 44s. Rate: 8.0 symbols/min [2025-10-31T18:01:37.858485] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-31T18:01:37.863759] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-31T18:01:37.957081] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:01:37.977171] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T18:01:38.020704] [DEBUG] [LOCAL ] CNO: Loaded 40074 existing records from primary storage. [2025-10-31T18:01:38.020988] [INFO ] [MAIN ] CNO: Loaded 40074 existing records. [2025-10-31T18:01:38.197622] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:01:38.197922] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-31T18:01:38.197980] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-31T18:01:38.198159] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-31T18:01:38.198198] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-31T18:01:38.561132] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:01:38.657712] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-31T18:01:39.097209] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T18:01:39.457716] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-31T18:01:39.828077] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T18:01:40.257681] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-31T18:01:40.356611] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-31T18:01:41.057710] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-31T18:01:41.266910] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T18:01:41.857733] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-31T18:01:42.353304] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T18:01:42.657674] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-31T18:01:42.982726] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T18:01:43.457672] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-31T18:01:43.566253] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T18:01:44.257728] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-31T18:01:44.578872] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T18:01:45.057701] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-31T18:01:45.284020] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-31T18:01:45.291055] [INFO ] [REMOTE ] CNMD: Full fetch complete (47440 records). [2025-10-31T18:01:45.291146] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-31T18:01:45.743841] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-31T18:01:45.743920] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-31T18:01:45.744530] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-31T18:01:45.744571] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-31T18:01:45.745569] [DEBUG] [LOCAL ] CNMD: Trimmed 47440 records to 32007 (keeping 200 days of data) [2025-10-31T18:01:45.863257] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-31T18:01:45.961381] [DEBUG] [LOCAL ] CNMD: Primary data saved (32007 records). [2025-10-31T18:01:45.961519] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-31T18:01:45.961589] [INFO ] [MAIN ] Update Progress: 494/2365 symbols completed. CNMD took 24.8s. Estimated remaining: 3h 53m 40s. Rate: 8.0 symbols/min [2025-10-31T18:01:46.137447] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:01:46.188234] [DEBUG] [LOCAL ] CNP: Loaded 53861 existing records from primary storage. [2025-10-31T18:01:46.188569] [INFO ] [MAIN ] CNP: Loaded 53861 existing records. [2025-10-31T18:01:46.412493] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:01:46.412882] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-31T18:01:46.412953] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-31T18:01:46.413354] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-31T18:01:46.413468] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-31T18:01:46.669738] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-31T18:01:46.723125] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-31T18:01:46.853259] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:01:46.873163] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T18:01:47.457727] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-31T18:01:47.830624] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T18:01:48.257722] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-31T18:01:48.969935] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-31T18:01:49.057619] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-31T18:01:49.486193] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T18:01:49.857731] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-31T18:01:50.497443] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-31T18:01:50.657705] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-31T18:01:50.851417] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T18:01:51.457689] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-31T18:01:52.010286] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T18:01:52.257698] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-31T18:01:53.011587] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T18:01:53.057697] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-31T18:01:53.556701] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T18:01:53.857715] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-31T18:01:54.263687] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T18:01:54.657688] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-31T18:01:55.310775] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T18:01:55.324126] [INFO ] [REMOTE ] CNM: Full fetch complete (73645 records). [2025-10-31T18:01:55.324277] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-31T18:01:55.470129] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-31T18:01:55.756838] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-31T18:01:55.757042] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-31T18:01:55.758179] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-31T18:01:55.758260] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-31T18:01:55.779982] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T18:01:55.787970] [DEBUG] [LOCAL ] CNM: Trimmed 73645 records to 51594 (keeping 200 days of data) [2025-10-31T18:01:56.103893] [DEBUG] [LOCAL ] CNM: Primary data saved (51594 records). [2025-10-31T18:01:56.104019] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-31T18:01:56.104088] [INFO ] [MAIN ] Update Progress: 495/2365 symbols completed. CNM took 39.2s. Estimated remaining: 3h 53m 42s. Rate: 8.0 symbols/min [2025-10-31T18:01:56.262827] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-31T18:01:56.294153] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:01:56.294328] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-10-31T18:01:56.294366] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-10-31T18:01:56.294792] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-31T18:01:56.294869] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-31T18:01:56.294918] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-31T18:01:56.294952] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-31T18:01:56.682665] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:01:56.707181] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T18:01:57.057687] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-31T18:01:57.382232] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T18:01:57.857707] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-31T18:01:58.144004] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T18:01:58.657675] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-31T18:01:59.273771] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T18:01:59.457668] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-31T18:02:00.266380] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-31T18:02:00.286899] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-31T18:02:00.725323] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T18:02:01.057722] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-31T18:02:01.792363] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-31T18:02:01.857677] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-31T18:02:02.425031] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T18:02:02.657708] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-31T18:02:03.404826] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-31T18:02:03.457617] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-31T18:02:03.653350] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-31T18:02:04.257692] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-31T18:02:05.058682] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-31T18:02:05.073380] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-31T18:02:05.709827] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T18:02:05.718280] [INFO ] [REMOTE ] CNO: Full fetch complete (60225 records). [2025-10-31T18:02:05.718419] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-31T18:02:05.719050] [FATAL] [VALIDATOR ] CNO: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:02:05.719132] [FATAL] [MAIN ] CNO: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:02:05.719174] [WARN ] [MAIN ] CNO: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:02:05.719240] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-31T18:02:05.719300] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-31T18:02:05.719335] [INFO ] [LOCAL ] CNO: Starting deletion of derivative data. [2025-10-31T18:02:05.719472] [DEBUG] [LOCAL ] CNO: Deleted derivative data file. [2025-10-31T18:02:05.719561] [INFO ] [MAIN ] Update Progress: 496/2365 symbols completed. CNO took 28.0s. Estimated remaining: 3h 53m 43s. Rate: 8.0 symbols/min [2025-10-31T18:02:05.864767] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-31T18:02:05.889807] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:02:05.934058] [DEBUG] [LOCAL ] CNR: Loaded 43876 existing records from primary storage. [2025-10-31T18:02:05.934430] [INFO ] [MAIN ] CNR: Loaded 43876 existing records. [2025-10-31T18:02:06.129060] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:02:06.129294] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-31T18:02:06.129343] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-31T18:02:06.129693] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-10-31T18:02:06.129751] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-31T18:02:06.542012] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:02:06.577162] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T18:02:06.657679] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-31T18:02:07.412411] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T18:02:07.421100] [INFO ] [REMOTE ] CNNE: Full fetch complete (50731 records). [2025-10-31T18:02:07.421301] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-31T18:02:07.468405] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-31T18:02:07.877344] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-31T18:02:07.879447] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-31T18:02:07.879324] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T18:02:07.880761] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-31T18:02:07.887417] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-31T18:02:07.889318] [DEBUG] [LOCAL ] CNNE: Trimmed 50731 records to 35722 (keeping 200 days of data) [2025-10-31T18:02:08.120950] [DEBUG] [LOCAL ] CNNE: Primary data saved (35722 records). [2025-10-31T18:02:08.121100] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-31T18:02:08.121175] [INFO ] [MAIN ] Update Progress: 497/2365 symbols completed. CNNE took 35.5s. Estimated remaining: 3h 53m 16s. Rate: 8.0 symbols/min [2025-10-31T18:02:08.266898] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-31T18:02:08.300923] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:02:08.301754] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-31T18:02:08.301934] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-31T18:02:08.302054] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-31T18:02:08.302289] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-31T18:02:08.302371] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-31T18:02:08.302422] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-31T18:02:08.685858] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:02:09.004687] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-31T18:02:09.057704] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-31T18:02:09.474180] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T18:02:09.857662] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-31T18:02:10.513286] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-31T18:02:10.657690] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-31T18:02:11.189213] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T18:02:11.457741] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-31T18:02:11.881015] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T18:02:12.257703] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-31T18:02:12.479021] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T18:02:13.057698] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-31T18:02:13.701681] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-31T18:02:13.857692] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-31T18:02:14.264212] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T18:02:14.657668] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-31T18:02:15.261735] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T18:02:15.457604] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-31T18:02:16.257691] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-31T18:02:16.470826] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-31T18:02:17.011980] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-31T18:02:17.057630] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-31T18:02:17.530023] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-31T18:02:17.857664] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-31T18:02:18.419464] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T18:02:18.464500] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T18:02:18.476497] [INFO ] [REMOTE ] CNP: Full fetch complete (77170 records). [2025-10-31T18:02:18.476663] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-31T18:02:18.477444] [FATAL] [VALIDATOR ] CNP: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:02:18.477534] [FATAL] [MAIN ] CNP: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:02:18.477578] [WARN ] [MAIN ] CNP: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:02:18.477664] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-31T18:02:18.477754] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-31T18:02:18.477799] [INFO ] [LOCAL ] CNP: Starting deletion of derivative data. [2025-10-31T18:02:18.478012] [DEBUG] [LOCAL ] CNP: Deleted derivative data file. [2025-10-31T18:02:18.478105] [INFO ] [MAIN ] Update Progress: 498/2365 symbols completed. CNP took 32.5s. Estimated remaining: 3h 53m 19s. Rate: 8.0 symbols/min [2025-10-31T18:02:18.653128] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:02:18.657636] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-31T18:02:18.700749] [DEBUG] [LOCAL ] CNX: Loaded 51667 existing records from primary storage. [2025-10-31T18:02:18.701069] [INFO ] [MAIN ] CNX: Loaded 51667 existing records. [2025-10-31T18:02:18.881746] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:02:18.881958] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-31T18:02:18.882005] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-31T18:02:18.882227] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-31T18:02:18.882456] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-31T18:02:19.310329] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:02:19.457678] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-31T18:02:19.563046] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T18:02:20.257748] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-31T18:02:20.736507] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T18:02:21.057681] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-31T18:02:21.703944] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T18:02:21.716269] [INFO ] [REMOTE ] CNQ: Full fetch complete (77347 records). [2025-10-31T18:02:21.716428] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-31T18:02:21.717246] [FATAL] [VALIDATOR ] CNQ: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:02:21.717345] [FATAL] [MAIN ] CNQ: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:02:21.717420] [WARN ] [MAIN ] CNQ: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:02:21.717480] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-31T18:02:21.717536] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-31T18:02:21.717571] [INFO ] [LOCAL ] CNQ: Starting deletion of derivative data. [2025-10-31T18:02:21.717611] [DEBUG] [LOCAL ] CNQ: No derivative data file found to delete. [2025-10-31T18:02:21.717718] [INFO ] [MAIN ] Update Progress: 499/2365 symbols completed. CNQ took 25.6s. Estimated remaining: 3h 52m 56s. Rate: 8.0 symbols/min [2025-10-31T18:02:21.860156] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-31T18:02:21.878889] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-31T18:02:21.917799] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:02:21.959967] [DEBUG] [LOCAL ] CODI: Loaded 42520 existing records from primary storage. [2025-10-31T18:02:21.960254] [INFO ] [MAIN ] CODI: Loaded 42520 existing records. [2025-10-31T18:02:22.143756] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:02:22.143970] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-31T18:02:22.144017] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-31T18:02:22.144815] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-31T18:02:22.144878] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-31T18:02:22.514426] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:02:22.657634] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-31T18:02:23.148549] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T18:02:23.457682] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-31T18:02:23.905887] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T18:02:24.257632] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-31T18:02:24.301237] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T18:02:25.057713] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-31T18:02:25.639934] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T18:02:25.857634] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-31T18:02:25.931114] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-31T18:02:26.657694] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-31T18:02:27.340927] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-31T18:02:27.371421] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-31T18:02:27.457679] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-31T18:02:28.052824] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-31T18:02:28.257697] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-31T18:02:29.057689] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-31T18:02:29.123159] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T18:02:29.857668] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-31T18:02:30.335310] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T18:02:30.657623] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-31T18:02:30.723969] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-31T18:02:31.457732] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-31T18:02:31.800249] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T18:02:32.174497] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T18:02:32.257677] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-31T18:02:32.938096] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-31T18:02:33.057676] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-31T18:02:33.857730] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-31T18:02:34.339113] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T18:02:34.657908] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-31T18:02:34.728703] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T18:02:35.457721] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-31T18:02:35.700375] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T18:02:35.707052] [INFO ] [REMOTE ] CNS: Full fetch complete (31687 records). [2025-10-31T18:02:35.707179] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-31T18:02:36.099135] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-31T18:02:36.099215] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-31T18:02:36.099773] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-31T18:02:36.099834] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-31T18:02:36.101052] [DEBUG] [LOCAL ] CNS: Trimmed 31687 records to 21557 (keeping 200 days of data) [2025-10-31T18:02:36.236577] [DEBUG] [LOCAL ] CNS: Primary data saved (21557 records). [2025-10-31T18:02:36.236751] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-31T18:02:36.236842] [INFO ] [MAIN ] Update Progress: 500/2365 symbols completed. CNS took 28.1s. Estimated remaining: 3h 53m 15s. Rate: 8.0 symbols/min [2025-10-31T18:02:36.266475] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-31T18:02:36.416506] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:02:36.469895] [DEBUG] [LOCAL ] COF: Loaded 54015 existing records from primary storage. [2025-10-31T18:02:36.470215] [INFO ] [MAIN ] COF: Loaded 54015 existing records. [2025-10-31T18:02:36.655752] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:02:36.656069] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-31T18:02:36.656194] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-31T18:02:36.657240] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-31T18:02:36.657302] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-31T18:02:36.965057] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T18:02:37.064638] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-31T18:02:37.090827] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:02:37.358411] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T18:02:37.857763] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-31T18:02:38.233410] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T18:02:38.657698] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-31T18:02:38.800578] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-31T18:02:39.457711] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-31T18:02:40.257684] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-31T18:02:40.298603] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-31T18:02:40.762686] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:02:41.057700] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-31T18:02:41.660786] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:02:41.857687] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-31T18:02:42.572547] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-31T18:02:42.657704] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-31T18:02:43.184802] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:02:43.457732] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-31T18:02:44.116929] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T18:02:44.130911] [INFO ] [REMOTE ] CNR: Full fetch complete (64689 records). [2025-10-31T18:02:44.131100] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-31T18:02:44.269326] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-31T18:02:44.518994] [DEBUG] [VALIDATOR ] CNR: All expected trading days are present. [2025-10-31T18:02:44.519083] [DEBUG] [VALIDATOR ] CNR: Primary data validation passed. [2025-10-31T18:02:44.519892] [INFO ] [MAIN ] CNR: Fetched primary data is valid. [2025-10-31T18:02:44.519963] [DEBUG] [LOCAL ] CNR: Saving primary data. [2025-10-31T18:02:44.521400] [DEBUG] [LOCAL ] CNR: Trimmed 64689 records to 44208 (keeping 200 days of data) [2025-10-31T18:02:44.797833] [DEBUG] [LOCAL ] CNR: Primary data saved (44208 records). [2025-10-31T18:02:44.798005] [INFO ] [MAIN ] CNR: Full history saved. [2025-10-31T18:02:44.798093] [INFO ] [MAIN ] Update Progress: 501/2365 symbols completed. CNR took 39.1s. Estimated remaining: 3h 53m 11s. Rate: 8.0 symbols/min [2025-10-31T18:02:45.000197] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:02:45.035097] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-31T18:02:45.057615] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-31T18:02:45.096442] [DEBUG] [LOCAL ] COHR: Loaded 53758 existing records from primary storage. [2025-10-31T18:02:45.096799] [INFO ] [MAIN ] COHR: Loaded 53758 existing records. [2025-10-31T18:02:45.269480] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:02:45.269722] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-31T18:02:45.269777] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-31T18:02:45.270049] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-31T18:02:45.270107] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-31T18:02:45.618954] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:02:45.864369] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-31T18:02:45.882853] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-31T18:02:46.280218] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T18:02:46.657679] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-31T18:02:47.457636] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-31T18:02:47.519911] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-31T18:02:47.805471] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-31T18:02:48.257681] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-31T18:02:49.006772] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T18:02:49.018163] [INFO ] [REMOTE ] CNX: Full fetch complete (74501 records). [2025-10-31T18:02:49.018313] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-31T18:02:49.019155] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:02:49.019246] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:02:49.019300] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:02:49.019384] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-31T18:02:49.019461] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-31T18:02:49.019510] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-10-31T18:02:49.019722] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-10-31T18:02:49.019831] [INFO ] [MAIN ] Update Progress: 502/2365 symbols completed. CNX took 30.5s. Estimated remaining: 3h 52m 51s. Rate: 8.0 symbols/min [2025-10-31T18:02:49.062738] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-31T18:02:49.192671] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:02:49.243413] [DEBUG] [LOCAL ] COLD: Loaded 52894 existing records from primary storage. [2025-10-31T18:02:49.243835] [INFO ] [MAIN ] COLD: Loaded 52894 existing records. [2025-10-31T18:02:49.419026] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:02:49.419233] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-31T18:02:49.419298] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-31T18:02:49.419739] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-31T18:02:49.419800] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-31T18:02:49.791936] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:02:49.821492] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-31T18:02:49.857609] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-31T18:02:50.657623] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-31T18:02:50.771837] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-31T18:02:51.457622] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-31T18:02:51.536133] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-31T18:02:51.807048] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T18:02:52.257748] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-31T18:02:52.979444] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T18:02:53.057737] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-31T18:02:53.636485] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-31T18:02:53.857709] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-31T18:02:54.106008] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-31T18:02:54.657695] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-31T18:02:54.977497] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T18:02:55.457758] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-31T18:02:56.162558] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T18:02:56.257681] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-31T18:02:56.697563] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T18:02:57.057664] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-31T18:02:57.721724] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-31T18:02:57.857723] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-31T18:02:57.912303] [DEBUG] [REMOTE ] COF: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-31T18:02:57.912616] [WARN ] [REMOTE ] COF: No data returned for month 2025-07 [2025-10-31T18:02:57.912722] [FATAL] [REMOTE ] COF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:02:57.912797] [FATAL] [MAIN ] COF: Failed to fetch primary data. [2025-10-31T18:02:57.912859] [WARN ] [MAIN ] COF: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:02:57.912929] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-31T18:02:57.912991] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-10-31T18:02:57.913025] [INFO ] [LOCAL ] COF: Starting deletion of derivative data. [2025-10-31T18:02:57.913177] [DEBUG] [LOCAL ] COF: Deleted derivative data file. [2025-10-31T18:02:57.914200] [INFO ] [MAIN ] Update Progress: 503/2365 symbols completed. COF took 21.7s. Estimated remaining: 3h 52m 49s. Rate: 8.0 symbols/min [2025-10-31T18:02:58.131492] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:02:58.131748] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-31T18:02:58.131801] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-31T18:02:58.131906] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-31T18:02:58.131947] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-31T18:02:58.131988] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-31T18:02:58.132018] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-31T18:02:58.532611] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:02:58.564040] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T18:02:58.657636] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-31T18:02:59.457709] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-31T18:03:00.197205] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-31T18:03:00.257677] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-31T18:03:00.962312] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T18:03:01.057635] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-31T18:03:01.859236] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-31T18:03:01.865322] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-31T18:03:01.876267] [INFO ] [REMOTE ] CODI: Full fetch complete (54965 records). [2025-10-31T18:03:01.876424] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-31T18:03:02.265115] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-31T18:03:02.265285] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-31T18:03:02.266094] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-31T18:03:02.266177] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-31T18:03:02.267537] [DEBUG] [LOCAL ] CODI: Trimmed 54965 records to 42881 (keeping 200 days of data) [2025-10-31T18:03:02.521545] [DEBUG] [LOCAL ] CODI: Primary data saved (42881 records). [2025-10-31T18:03:02.521747] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-31T18:03:02.522885] [INFO ] [MAIN ] Update Progress: 504/2365 symbols completed. CODI took 40.8s. Estimated remaining: 3h 52m 31s. Rate: 8.0 symbols/min [2025-10-31T18:03:02.662865] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-31T18:03:02.803959] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-31T18:03:02.801903] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:03:02.814537] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-31T18:03:02.815031] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-31T18:03:02.815207] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-31T18:03:02.815284] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-31T18:03:02.815356] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-31T18:03:02.815407] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-31T18:03:03.203238] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:03:03.238720] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T18:03:03.457723] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-31T18:03:03.975596] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T18:03:04.257673] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-31T18:03:05.047400] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-31T18:03:05.058124] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-31T18:03:05.669398] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T18:03:05.857691] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-31T18:03:06.221414] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T18:03:06.657711] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-31T18:03:07.359394] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T18:03:07.457613] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-31T18:03:08.257633] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-31T18:03:08.518156] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T18:03:08.557398] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-31T18:03:09.057625] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-31T18:03:09.673621] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T18:03:09.857680] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-31T18:03:10.202145] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T18:03:10.657687] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-31T18:03:11.457697] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-31T18:03:11.545950] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-31T18:03:11.614949] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-31T18:03:12.257666] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-31T18:03:13.057633] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-31T18:03:13.090026] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-31T18:03:13.227224] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T18:03:13.857676] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-31T18:03:14.657683] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-31T18:03:14.858239] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-31T18:03:14.890674] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T18:03:15.457735] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-31T18:03:16.011488] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T18:03:16.257740] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-31T18:03:17.057639] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-31T18:03:17.225572] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-31T18:03:17.238266] [INFO ] [REMOTE ] COHR: Full fetch complete (77473 records). [2025-10-31T18:03:17.238411] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-31T18:03:17.627138] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-31T18:03:17.627219] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-31T18:03:17.628191] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-31T18:03:17.628256] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-31T18:03:17.630135] [DEBUG] [LOCAL ] COHR: Trimmed 77473 records to 54148 (keeping 200 days of data) [2025-10-31T18:03:17.751725] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-31T18:03:17.875833] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-31T18:03:17.998064] [DEBUG] [LOCAL ] COHR: Primary data saved (54148 records). [2025-10-31T18:03:17.998209] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-31T18:03:17.998286] [INFO ] [MAIN ] Update Progress: 505/2365 symbols completed. COHR took 33.2s. Estimated remaining: 3h 52m 53s. Rate: 8.0 symbols/min [2025-10-31T18:03:18.161559] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:03:18.161771] [DEBUG] [LOCAL ] COOK: No existing data file found in primary storage. [2025-10-31T18:03:18.161815] [WARN ] [MAIN ] COOK: No existing data found, performing full refresh instead. [2025-10-31T18:03:18.161922] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-31T18:03:18.161963] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-31T18:03:18.162003] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-31T18:03:18.162035] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-31T18:03:18.538009] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:03:18.577086] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T18:03:18.657721] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-31T18:03:19.403269] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-31T18:03:19.423475] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-31T18:03:19.457615] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-31T18:03:20.034085] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-31T18:03:20.257680] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-31T18:03:21.057627] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-31T18:03:21.274750] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T18:03:21.857696] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-31T18:03:21.881348] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T18:03:22.657674] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-31T18:03:23.182833] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T18:03:23.457637] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-31T18:03:23.494491] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-31T18:03:24.257671] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-31T18:03:24.967585] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T18:03:25.057692] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-31T18:03:25.623995] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T18:03:25.797089] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-31T18:03:25.857675] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-31T18:03:26.657638] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-31T18:03:26.908997] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T18:03:27.457677] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-31T18:03:28.263042] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-31T18:03:28.287373] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T18:03:28.300119] [INFO ] [REMOTE ] COMP: Full fetch complete (77414 records). [2025-10-31T18:03:28.300253] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-31T18:03:28.701450] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-31T18:03:28.701527] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-31T18:03:28.702371] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-31T18:03:28.702432] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-31T18:03:28.703885] [DEBUG] [LOCAL ] COMP: Trimmed 77414 records to 54168 (keeping 200 days of data) [2025-10-31T18:03:29.014707] [DEBUG] [LOCAL ] COMP: Primary data saved (54168 records). [2025-10-31T18:03:29.014887] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-31T18:03:29.014977] [INFO ] [MAIN ] Update Progress: 506/2365 symbols completed. COMP took 31.1s. Estimated remaining: 3h 52m 58s. Rate: 8.0 symbols/min [2025-10-31T18:03:29.077670] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-31T18:03:29.193959] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:03:29.210563] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-31T18:03:29.273060] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-31T18:03:29.302539] [INFO ] [REMOTE ] COLD: Full fetch complete (74748 records). [2025-10-31T18:03:29.302738] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-31T18:03:29.304034] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-31T18:03:29.304496] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:03:29.304697] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:03:29.304998] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-10-31T18:03:29.304877] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:03:29.310285] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-31T18:03:29.390754] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-31T18:03:29.417518] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-31T18:03:29.420180] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-31T18:03:29.441101] [INFO ] [MAIN ] Update Progress: 507/2365 symbols completed. COLD took 40.4s. Estimated remaining: 3h 52m 25s. Rate: 8.0 symbols/min [2025-10-31T18:03:29.589666] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:03:29.616033] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-31T18:03:29.619953] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-31T18:03:29.636481] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-31T18:03:29.636596] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-31T18:03:29.783176] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:03:29.803401] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-10-31T18:03:29.809736] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-10-31T18:03:29.809957] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-31T18:03:29.823395] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-31T18:03:29.823473] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-31T18:03:29.823841] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-31T18:03:29.863151] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-31T18:03:30.379334] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:03:30.522357] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:03:30.547756] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T18:03:30.657615] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-31T18:03:30.824246] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-31T18:03:31.457727] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-31T18:03:31.821766] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-31T18:03:31.831723] [INFO ] [REMOTE ] CON: Full fetch complete (56464 records). [2025-10-31T18:03:31.831891] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-31T18:03:32.222459] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-31T18:03:32.222545] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-31T18:03:32.223250] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-31T18:03:32.223312] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-31T18:03:32.224726] [DEBUG] [LOCAL ] CON: Trimmed 56464 records to 39030 (keeping 200 days of data) [2025-10-31T18:03:32.282720] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-31T18:03:32.465502] [DEBUG] [LOCAL ] CON: Primary data saved (39030 records). [2025-10-31T18:03:32.465633] [INFO ] [MAIN ] CON: Full history saved. [2025-10-31T18:03:32.465743] [INFO ] [MAIN ] Update Progress: 508/2365 symbols completed. CON took 29.9s. Estimated remaining: 3h 52m 1s. Rate: 8.0 symbols/min [2025-10-31T18:03:32.634217] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:03:32.685230] [DEBUG] [LOCAL ] COTY: Loaded 53633 existing records from primary storage. [2025-10-31T18:03:32.685538] [INFO ] [MAIN ] COTY: Loaded 53633 existing records. [2025-10-31T18:03:32.865392] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:03:32.865688] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-31T18:03:32.865802] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-31T18:03:32.866213] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-31T18:03:32.866365] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-31T18:03:33.072352] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-31T18:03:33.191266] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-31T18:03:33.323050] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:03:33.341887] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T18:03:33.857694] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-31T18:03:34.666116] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-31T18:03:34.672953] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T18:03:35.301166] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T18:03:35.457624] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-31T18:03:35.657392] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T18:03:35.663403] [INFO ] [REMOTE ] COOK: Full fetch complete (33222 records). [2025-10-31T18:03:35.663495] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-31T18:03:36.033692] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-31T18:03:36.033783] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-31T18:03:36.034288] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-31T18:03:36.034329] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-31T18:03:36.035251] [DEBUG] [LOCAL ] COOK: Trimmed 33222 records to 25025 (keeping 200 days of data) [2025-10-31T18:03:36.180300] [DEBUG] [LOCAL ] COOK: Primary data saved (25025 records). [2025-10-31T18:03:36.180495] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-31T18:03:36.180584] [INFO ] [MAIN ] Update Progress: 509/2365 symbols completed. COOK took 18.2s. Estimated remaining: 3h 51m 39s. Rate: 8.0 symbols/min [2025-10-31T18:03:36.262758] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-31T18:03:36.355507] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:03:36.397181] [DEBUG] [LOCAL ] COUR: Loaded 49834 existing records from primary storage. [2025-10-31T18:03:36.397473] [INFO ] [MAIN ] COUR: Loaded 49834 existing records. [2025-10-31T18:03:36.577375] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:03:36.577706] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-31T18:03:36.577802] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-31T18:03:36.578430] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-31T18:03:36.578548] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-31T18:03:36.865071] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T18:03:36.989404] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:03:37.057676] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-31T18:03:37.479159] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T18:03:37.857667] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-31T18:03:38.218616] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T18:03:38.657694] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-31T18:03:39.117990] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T18:03:39.457696] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-31T18:03:40.209337] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-31T18:03:40.257730] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-31T18:03:40.842685] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T18:03:41.057732] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-31T18:03:41.727584] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-31T18:03:41.857733] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-31T18:03:42.469727] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T18:03:42.657757] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-31T18:03:43.256983] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:03:43.457674] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-31T18:03:43.892694] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T18:03:44.257715] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-31T18:03:44.876633] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T18:03:45.057772] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-31T18:03:45.697501] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-31T18:03:45.857669] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-31T18:03:46.174984] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T18:03:46.657760] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-31T18:03:47.290677] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T18:03:47.457702] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-31T18:03:48.097905] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-31T18:03:48.257705] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-31T18:03:48.872889] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T18:03:49.057723] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-31T18:03:49.779788] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T18:03:49.857743] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-31T18:03:50.631231] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-31T18:03:50.657601] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-31T18:03:51.049753] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T18:03:51.457735] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-31T18:03:52.117469] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-31T18:03:52.257630] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-31T18:03:52.618057] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T18:03:53.057707] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-31T18:03:53.444329] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T18:03:53.857682] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-31T18:03:54.274699] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T18:03:54.657728] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-31T18:03:54.985441] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T18:03:55.457705] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-31T18:03:56.021290] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T18:03:56.257755] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-31T18:03:56.679736] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T18:03:57.057683] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-31T18:03:57.641603] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-31T18:03:57.653609] [INFO ] [REMOTE ] COTY: Full fetch complete (77281 records). [2025-10-31T18:03:57.653771] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-31T18:03:57.857638] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-31T18:03:58.037800] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-31T18:03:58.037907] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-31T18:03:58.038825] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-31T18:03:58.038890] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-31T18:03:58.040352] [DEBUG] [LOCAL ] COTY: Trimmed 77281 records to 54015 (keeping 200 days of data) [2025-10-31T18:03:58.338362] [DEBUG] [LOCAL ] COTY: Primary data saved (54015 records). [2025-10-31T18:03:58.338490] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-31T18:03:58.339057] [INFO ] [MAIN ] Update Progress: 510/2365 symbols completed. COTY took 25.9s. Estimated remaining: 3h 52m 25s. Rate: 8.0 symbols/min [2025-10-31T18:03:58.510136] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:03:58.541145] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T18:03:58.552700] [INFO ] [REMOTE ] COR: Full fetch complete (68176 records). [2025-10-31T18:03:58.552841] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-31T18:03:58.660678] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-31T18:03:58.886848] [DEBUG] [LOCAL ] CP: Loaded 53590 existing records from primary storage. [2025-10-31T18:03:58.903975] [INFO ] [MAIN ] CP: Loaded 53590 existing records. [2025-10-31T18:03:59.144677] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-31T18:03:59.149925] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-31T18:03:59.174094] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-31T18:03:59.185099] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-31T18:03:59.215871] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:03:59.216293] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-31T18:03:59.216387] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-31T18:03:59.217480] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-31T18:03:59.217732] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-31T18:03:59.265094] [DEBUG] [LOCAL ] COR: Trimmed 68176 records to 46535 (keeping 200 days of data) [2025-10-31T18:03:59.784266] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-31T18:03:59.889047] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-31T18:03:59.949549] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:03:59.965989] [DEBUG] [LOCAL ] COR: Primary data saved (46535 records). [2025-10-31T18:03:59.966554] [INFO ] [MAIN ] COR: Full history saved. [2025-10-31T18:03:59.966686] [INFO ] [MAIN ] Update Progress: 511/2365 symbols completed. COR took 30.5s. Estimated remaining: 3h 51m 56s. Rate: 8.0 symbols/min [2025-10-31T18:04:00.139054] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:04:00.139344] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-31T18:04:00.139442] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-31T18:04:00.139620] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-31T18:04:00.139732] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-31T18:04:00.139850] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-31T18:04:00.139979] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-31T18:04:00.260361] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-31T18:04:00.526973] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:04:00.529155] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-31T18:04:01.057619] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-31T18:04:01.250423] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T18:04:01.857691] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-31T18:04:01.979034] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-31T18:04:02.657626] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-31T18:04:02.767876] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-31T18:04:03.042897] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T18:04:03.457670] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-31T18:04:03.562407] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-31T18:04:04.257689] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-31T18:04:04.938891] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T18:04:05.057672] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-31T18:04:05.857686] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-31T18:04:06.025686] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-31T18:04:06.037612] [INFO ] [REMOTE ] COUR: Full fetch complete (71493 records). [2025-10-31T18:04:06.037787] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-31T18:04:06.446836] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-31T18:04:06.446952] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-31T18:04:06.448004] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-31T18:04:06.448082] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-31T18:04:06.449829] [DEBUG] [LOCAL ] COUR: Trimmed 71493 records to 50214 (keeping 200 days of data) [2025-10-31T18:04:06.668033] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-31T18:04:06.695481] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-31T18:04:06.801690] [DEBUG] [LOCAL ] COUR: Primary data saved (50214 records). [2025-10-31T18:04:06.801825] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-31T18:04:06.801901] [INFO ] [MAIN ] Update Progress: 512/2365 symbols completed. COUR took 30.6s. Estimated remaining: 3h 51m 46s. Rate: 8.0 symbols/min [2025-10-31T18:04:06.985610] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:04:06.985895] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-31T18:04:06.985952] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-31T18:04:06.986061] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-31T18:04:06.986105] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-31T18:04:06.986169] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-31T18:04:06.986204] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-31T18:04:07.354616] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:04:07.382202] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-31T18:04:07.457626] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-31T18:04:07.621306] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T18:04:07.858836] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-31T18:04:08.257667] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-31T18:04:08.470840] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-31T18:04:09.057682] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-31T18:04:09.336639] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-31T18:04:09.857689] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-31T18:04:10.458347] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T18:04:10.470813] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-31T18:04:10.470962] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-31T18:04:10.669695] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-31T18:04:10.873181] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-31T18:04:10.873268] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-31T18:04:10.874208] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-31T18:04:10.874277] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-31T18:04:10.875773] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 54507 (keeping 200 days of data) [2025-10-31T18:04:11.203326] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-10-31T18:04:11.203459] [INFO ] [MAIN ] COP: Full history saved. [2025-10-31T18:04:11.203541] [INFO ] [MAIN ] Update Progress: 513/2365 symbols completed. COP took 42.2s. Estimated remaining: 3h 51m 28s. Rate: 8.0 symbols/min [2025-10-31T18:04:11.383259] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:04:11.411752] [DEBUG] [LOCAL ] CPAY: Loaded 29838 existing records from primary storage. [2025-10-31T18:04:11.412010] [INFO ] [MAIN ] CPAY: Loaded 29838 existing records. [2025-10-31T18:04:11.462811] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-31T18:04:11.597117] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:04:11.597416] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-31T18:04:11.598197] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-31T18:04:11.598811] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-31T18:04:11.598871] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-31T18:04:11.841663] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-31T18:04:11.984065] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:04:12.224592] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-31T18:04:12.257615] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-31T18:04:12.559162] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-31T18:04:13.057678] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-31T18:04:13.857667] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-31T18:04:14.091455] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-31T18:04:14.259574] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T18:04:14.657687] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-31T18:04:14.950710] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-31T18:04:15.457680] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-31T18:04:16.257682] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-31T18:04:17.057677] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-31T18:04:17.129684] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-31T18:04:17.198934] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-31T18:04:17.857675] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-31T18:04:18.163455] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:04:18.206773] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-31T18:04:18.657683] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-31T18:04:19.457677] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-31T18:04:19.651889] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T18:04:20.257693] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-31T18:04:20.550306] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-31T18:04:20.757918] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T18:04:21.057689] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-31T18:04:21.478377] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-31T18:04:21.480023] [INFO ] [REMOTE ] CPAC: Full fetch complete (1802 records). [2025-10-31T18:04:21.480094] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-31T18:04:21.663446] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-31T18:04:21.663681] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:04:21.663740] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:04:21.663813] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-31T18:04:21.663887] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-31T18:04:21.663957] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-31T18:04:21.664025] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-31T18:04:21.664082] [INFO ] [MAIN ] Update Progress: 514/2365 symbols completed. CPAC took 14.9s. Estimated remaining: 3h 51m 31s. Rate: 8.0 symbols/min [2025-10-31T18:04:21.841778] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:04:21.856352] [DEBUG] [LOCAL ] CPF: Loaded 14985 existing records from primary storage. [2025-10-31T18:04:21.856552] [INFO ] [MAIN ] CPF: Loaded 14985 existing records. [2025-10-31T18:04:21.867526] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-31T18:04:22.036595] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:04:22.036809] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-31T18:04:22.036855] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-31T18:04:22.037383] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-31T18:04:22.037453] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-31T18:04:22.391153] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:04:22.657667] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-31T18:04:22.989718] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-31T18:04:23.457681] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-31T18:04:23.856260] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T18:04:24.198851] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-31T18:04:24.257609] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-31T18:04:24.983951] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-31T18:04:25.057638] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-31T18:04:25.702978] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T18:04:25.857693] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-31T18:04:26.657679] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-31T18:04:26.880252] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-31T18:04:27.457639] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-31T18:04:28.148897] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T18:04:28.257699] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-31T18:04:28.432870] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T18:04:29.057705] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-31T18:04:29.551566] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T18:04:29.857713] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-31T18:04:30.246977] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T18:04:30.657667] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-31T18:04:30.821318] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-31T18:04:31.457698] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-31T18:04:31.754589] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T18:04:32.257687] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-31T18:04:32.771853] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T18:04:33.057727] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-31T18:04:33.383173] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T18:04:33.861686] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-31T18:04:33.865293] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T18:04:34.657680] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-31T18:04:35.457681] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-31T18:04:35.699460] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T18:04:35.701451] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-31T18:04:35.720054] [INFO ] [REMOTE ] CP: Full fetch complete (77291 records). [2025-10-31T18:04:35.720181] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-31T18:04:36.119272] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-31T18:04:36.127308] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-31T18:04:36.128377] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-31T18:04:36.129392] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T18:04:36.129040] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-31T18:04:36.134886] [DEBUG] [LOCAL ] CP: Trimmed 77291 records to 53980 (keeping 200 days of data) [2025-10-31T18:04:36.258283] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-31T18:04:36.461722] [DEBUG] [LOCAL ] CP: Primary data saved (53980 records). [2025-10-31T18:04:36.461852] [INFO ] [MAIN ] CP: Full history saved. [2025-10-31T18:04:36.461928] [INFO ] [MAIN ] Update Progress: 515/2365 symbols completed. CP took 38.1s. Estimated remaining: 3h 51m 50s. Rate: 8.0 symbols/min [2025-10-31T18:04:36.632525] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:04:36.632709] [DEBUG] [LOCAL ] CPK: No existing data file found in primary storage. [2025-10-31T18:04:36.632760] [WARN ] [MAIN ] CPK: No existing data found, performing full refresh instead. [2025-10-31T18:04:36.632867] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-31T18:04:36.632908] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-31T18:04:36.632948] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-31T18:04:36.632980] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-31T18:04:36.995252] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:04:37.057668] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-31T18:04:37.351541] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T18:04:37.702922] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-31T18:04:37.857684] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-31T18:04:38.657710] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-31T18:04:38.862568] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-31T18:04:38.870704] [INFO ] [REMOTE ] CPA: Full fetch complete (40481 records). [2025-10-31T18:04:38.870830] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-31T18:04:39.264759] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-31T18:04:39.264942] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-31T18:04:39.265511] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-31T18:04:39.265554] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-31T18:04:39.266489] [DEBUG] [LOCAL ] CPA: Trimmed 40481 records to 27439 (keeping 200 days of data) [2025-10-31T18:04:39.380377] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T18:04:39.459331] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-31T18:04:39.459619] [DEBUG] [LOCAL ] CPA: Primary data saved (27439 records). [2025-10-31T18:04:39.459917] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-31T18:04:39.460035] [INFO ] [MAIN ] Update Progress: 516/2365 symbols completed. CPA took 39.5s. Estimated remaining: 3h 51m 26s. Rate: 8.0 symbols/min [2025-10-31T18:04:39.661533] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:04:39.712877] [DEBUG] [LOCAL ] CPNG: Loaded 54069 existing records from primary storage. [2025-10-31T18:04:39.713184] [INFO ] [MAIN ] CPNG: Loaded 54069 existing records. [2025-10-31T18:04:39.887199] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:04:39.887393] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-31T18:04:39.887446] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-31T18:04:39.888328] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-31T18:04:39.888412] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-31T18:04:40.236068] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:04:40.257610] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-31T18:04:40.809156] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T18:04:41.057704] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-31T18:04:41.857633] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-31T18:04:41.951948] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-31T18:04:42.090897] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T18:04:42.357168] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T18:04:42.657685] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-31T18:04:43.457679] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-31T18:04:44.257694] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-31T18:04:44.331052] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-31T18:04:44.528681] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-31T18:04:45.057679] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-31T18:04:45.205366] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-31T18:04:45.715677] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T18:04:45.857619] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-31T18:04:46.563878] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T18:04:46.657666] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-31T18:04:47.457672] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-31T18:04:47.513903] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-31T18:04:47.517794] [INFO ] [REMOTE ] CPF: Full fetch complete (23111 records). [2025-10-31T18:04:47.517893] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-31T18:04:47.876769] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-31T18:04:47.876857] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-31T18:04:47.877262] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-31T18:04:47.877304] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-31T18:04:47.878043] [DEBUG] [LOCAL ] CPF: Trimmed 23111 records to 15078 (keeping 200 days of data) [2025-10-31T18:04:47.966765] [DEBUG] [LOCAL ] CPF: Primary data saved (15078 records). [2025-10-31T18:04:47.966897] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-31T18:04:47.966973] [INFO ] [MAIN ] Update Progress: 517/2365 symbols completed. CPF took 26.3s. Estimated remaining: 3h 51m 22s. Rate: 8.0 symbols/min [2025-10-31T18:04:48.257735] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-31T18:04:48.623686] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T18:04:48.630488] [INFO ] [REMOTE ] CPAY: Full fetch complete (44668 records). [2025-10-31T18:04:48.630591] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-31T18:04:49.007201] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-31T18:04:49.007283] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-31T18:04:49.007998] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-31T18:04:49.008062] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-31T18:04:49.009248] [DEBUG] [LOCAL ] CPAY: Trimmed 44668 records to 30184 (keeping 200 days of data) [2025-10-31T18:04:49.062666] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-31T18:04:49.189089] [DEBUG] [LOCAL ] CPAY: Primary data saved (30184 records). [2025-10-31T18:04:49.189221] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-31T18:04:49.189340] [INFO ] [MAIN ] Update Progress: 518/2365 symbols completed. CPAY took 38.0s. Estimated remaining: 3h 50m 52s. Rate: 8.0 symbols/min [2025-10-31T18:04:49.828940] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T18:04:49.857616] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-31T18:04:50.075264] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-31T18:04:50.653604] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-31T18:04:50.658129] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-31T18:04:51.278615] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-31T18:04:51.457713] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-31T18:04:52.101423] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-31T18:04:52.257675] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-31T18:04:52.887237] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T18:04:53.057686] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-31T18:04:53.857747] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-31T18:04:54.443754] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T18:04:54.664681] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-31T18:04:54.691228] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-31T18:04:55.387134] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-31T18:04:55.457614] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-31T18:04:56.257681] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-31T18:04:56.390632] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T18:04:56.394669] [INFO ] [REMOTE ] CPK: Full fetch complete (18974 records). [2025-10-31T18:04:56.394746] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-31T18:04:56.756940] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-31T18:04:56.757031] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-31T18:04:56.757422] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-31T18:04:56.757461] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-31T18:04:56.758011] [DEBUG] [LOCAL ] CPK: Trimmed 18974 records to 13614 (keeping 200 days of data) [2025-10-31T18:04:56.838887] [DEBUG] [LOCAL ] CPK: Primary data saved (13614 records). [2025-10-31T18:04:56.839011] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-31T18:04:56.839078] [INFO ] [MAIN ] Update Progress: 519/2365 symbols completed. CPK took 20.4s. Estimated remaining: 3h 50m 45s. Rate: 8.0 symbols/min [2025-10-31T18:04:58.210026] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-31T18:04:58.221984] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-31T18:04:59.853969] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-31T18:04:59.866210] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-31T18:05:02.063476] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-31T18:05:02.075825] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-31T18:05:04.144556] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-31T18:05:04.156055] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-31T18:05:06.056500] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-31T18:05:06.068057] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-31T18:05:07.897418] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-31T18:05:07.909784] [INFO ] [REMOTE ] CPNG: Full fetch complete (77794 records). [2025-10-31T18:05:07.909943] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-31T18:05:08.303486] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-31T18:05:08.303571] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-31T18:05:08.304423] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-31T18:05:08.304488] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-31T18:05:08.306076] [DEBUG] [LOCAL ] CPNG: Trimmed 77794 records to 54459 (keeping 200 days of data) [2025-10-31T18:05:08.626067] [DEBUG] [LOCAL ] CPNG: Primary data saved (54459 records). [2025-10-31T18:05:08.626205] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-31T18:05:08.626281] [INFO ] [MAIN ] Update Progress: 520/2365 symbols completed. CPNG took 29.2s. Estimated remaining: 3h 50m 53s. Rate: 8.0 symbols/min [2025-10-31T18:05:09.220998] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:09.258403] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:09.289802] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:09.315188] [DEBUG] [LOCAL ] CPRI: No existing data file found in primary storage. [2025-10-31T18:05:09.345914] [WARN ] [MAIN ] CPRI: No existing data found, performing full refresh instead. [2025-10-31T18:05:09.351085] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:09.351460] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-31T18:05:09.351902] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-31T18:05:09.351972] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-31T18:05:09.352444] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-31T18:05:09.485252] [DEBUG] [LOCAL ] CPS: Loaded 24325 existing records from primary storage. [2025-10-31T18:05:09.485846] [DEBUG] [LOCAL ] CQP: Loaded 18800 existing records from primary storage. [2025-10-31T18:05:09.486236] [INFO ] [MAIN ] CPS: Loaded 24325 existing records. [2025-10-31T18:05:09.542804] [INFO ] [MAIN ] CQP: Loaded 18800 existing records. [2025-10-31T18:05:09.833956] [DEBUG] [LOCAL ] CPT: Loaded 44659 existing records from primary storage. [2025-10-31T18:05:09.875767] [INFO ] [MAIN ] CPT: Loaded 44659 existing records. [2025-10-31T18:05:10.085176] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:05:10.100803] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-31T18:05:10.145916] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-31T18:05:10.191084] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:05:10.222199] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-31T18:05:10.235100] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-31T18:05:10.240550] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-31T18:05:10.243711] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:10.254155] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-31T18:05:10.266053] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-31T18:05:10.266317] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-31T18:05:10.266505] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-31T18:05:10.423454] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:05:10.509770] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-31T18:05:10.534460] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-31T18:05:10.605909] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-31T18:05:10.620236] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-31T18:05:11.192555] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:11.220639] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-31T18:05:11.329009] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:11.341456] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-31T18:05:11.479447] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:11.479796] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-31T18:05:11.790774] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T18:05:11.800866] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-31T18:05:12.123556] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-31T18:05:12.128315] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-31T18:05:12.369682] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T18:05:12.375513] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-31T18:05:12.702683] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T18:05:12.711639] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-31T18:05:12.948298] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-31T18:05:12.953894] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-31T18:05:13.091998] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-31T18:05:13.097537] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-31T18:05:13.143988] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-31T18:05:13.154153] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-31T18:05:13.822618] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-31T18:05:13.828094] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-31T18:05:13.938617] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T18:05:13.942843] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T18:05:13.954767] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-31T18:05:13.954503] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-31T18:05:14.400152] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T18:05:14.410994] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-31T18:05:14.448146] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-31T18:05:14.452383] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-31T18:05:14.842316] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-31T18:05:14.849429] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-31T18:05:15.186821] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T18:05:15.191908] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-31T18:05:15.297675] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T18:05:15.457608] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-31T18:05:15.616524] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T18:05:15.758887] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T18:05:16.151708] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T18:05:16.257627] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-31T18:05:16.699572] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T18:05:17.057694] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-31T18:05:17.148182] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-31T18:05:17.857694] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-31T18:05:18.433746] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T18:05:18.662760] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-31T18:05:18.672380] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-31T18:05:19.457675] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-31T18:05:19.667797] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T18:05:20.190048] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T18:05:20.257688] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-31T18:05:20.952449] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-31T18:05:21.057767] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-31T18:05:21.857727] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-31T18:05:22.488996] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T18:05:22.657631] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-31T18:05:22.700702] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T18:05:23.457679] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-31T18:05:24.098493] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T18:05:24.147929] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T18:05:24.257704] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-31T18:05:25.006466] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T18:05:25.010318] [INFO ] [REMOTE ] CQP: Full fetch complete (29077 records). [2025-10-31T18:05:25.010394] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-31T18:05:25.010964] [FATAL] [VALIDATOR ] CQP: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:05:25.011040] [FATAL] [MAIN ] CQP: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:05:25.011105] [WARN ] [MAIN ] CQP: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:05:25.011174] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-31T18:05:25.011238] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-31T18:05:25.011273] [INFO ] [LOCAL ] CQP: Starting deletion of derivative data. [2025-10-31T18:05:25.011434] [DEBUG] [LOCAL ] CQP: Deleted derivative data file. [2025-10-31T18:05:25.011517] [INFO ] [MAIN ] Update Progress: 521/2365 symbols completed. CQP took 16.4s. Estimated remaining: 3h 51m 17s. Rate: 8.0 symbols/min [2025-10-31T18:05:25.064403] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-31T18:05:25.191025] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:25.213229] [DEBUG] [LOCAL ] CR: Loaded 24110 existing records from primary storage. [2025-10-31T18:05:25.213462] [INFO ] [MAIN ] CR: Loaded 24110 existing records. [2025-10-31T18:05:25.395941] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:05:25.396165] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-31T18:05:25.396212] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-31T18:05:25.397334] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-31T18:05:25.397391] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-31T18:05:25.754476] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:25.857675] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-31T18:05:26.254754] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T18:05:26.657666] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-31T18:05:26.675791] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T18:05:27.457690] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-31T18:05:27.921880] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T18:05:28.171808] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T18:05:28.257623] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-31T18:05:29.057625] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-31T18:05:29.132460] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T18:05:29.140049] [INFO ] [REMOTE ] CPS: Full fetch complete (36369 records). [2025-10-31T18:05:29.140228] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-31T18:05:29.141015] [FATAL] [VALIDATOR ] CPS: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:05:29.141121] [FATAL] [MAIN ] CPS: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:05:29.141178] [WARN ] [MAIN ] CPS: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:05:29.141274] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-31T18:05:29.141357] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-31T18:05:29.141401] [INFO ] [LOCAL ] CPS: Starting deletion of derivative data. [2025-10-31T18:05:29.141576] [DEBUG] [LOCAL ] CPS: Deleted derivative data file. [2025-10-31T18:05:29.141715] [INFO ] [MAIN ] Update Progress: 522/2365 symbols completed. CPS took 20.5s. Estimated remaining: 3h 50m 57s. Rate: 8.0 symbols/min [2025-10-31T18:05:29.311727] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:29.321060] [DEBUG] [LOCAL ] CRBD: Loaded 8580 existing records from primary storage. [2025-10-31T18:05:29.321241] [INFO ] [MAIN ] CRBD: Loaded 8580 existing records. [2025-10-31T18:05:29.498013] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:05:29.498225] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-31T18:05:29.498281] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-31T18:05:29.498444] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-31T18:05:29.498495] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-31T18:05:29.852256] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:29.857604] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-31T18:05:30.243859] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T18:05:30.395847] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-31T18:05:30.657705] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-31T18:05:31.168934] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-31T18:05:31.457669] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-31T18:05:32.045466] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T18:05:32.257742] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-31T18:05:33.057768] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-31T18:05:33.627404] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T18:05:33.857716] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-31T18:05:34.396857] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T18:05:34.657681] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-31T18:05:34.701585] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T18:05:34.713486] [INFO ] [REMOTE ] CPT: Full fetch complete (64969 records). [2025-10-31T18:05:34.713634] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-31T18:05:35.150127] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-31T18:05:35.150208] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-31T18:05:35.150993] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-31T18:05:35.151057] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-31T18:05:35.152298] [DEBUG] [LOCAL ] CPT: Trimmed 64969 records to 44988 (keeping 200 days of data) [2025-10-31T18:05:35.427235] [DEBUG] [LOCAL ] CPT: Primary data saved (44988 records). [2025-10-31T18:05:35.427357] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-31T18:05:35.428442] [INFO ] [MAIN ] Update Progress: 523/2365 symbols completed. CPT took 26.8s. Estimated remaining: 3h 50m 45s. Rate: 8.0 symbols/min [2025-10-31T18:05:35.460257] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-31T18:05:35.621291] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:35.621540] [DEBUG] [LOCAL ] CRBG: No existing data file found in primary storage. [2025-10-31T18:05:35.621589] [WARN ] [MAIN ] CRBG: No existing data found, performing full refresh instead. [2025-10-31T18:05:35.621718] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-31T18:05:35.621764] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-31T18:05:35.621806] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-10-31T18:05:35.621839] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-31T18:05:35.976183] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:36.008115] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T18:05:36.257667] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-31T18:05:36.351392] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-31T18:05:37.057720] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-31T18:05:37.525253] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-31T18:05:37.844220] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-31T18:05:37.857610] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-31T18:05:38.434335] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-31T18:05:38.657746] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-31T18:05:39.457708] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-31T18:05:39.950671] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-31T18:05:40.105817] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T18:05:40.257712] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-31T18:05:41.057683] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-31T18:05:41.503699] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:05:41.855086] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-31T18:05:41.860546] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-31T18:05:42.657633] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-31T18:05:43.183975] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-31T18:05:43.457617] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-31T18:05:43.637130] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-31T18:05:44.257667] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-31T18:05:44.862905] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-31T18:05:45.009279] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T18:05:45.022356] [INFO ] [REMOTE ] CPRI: Full fetch complete (76162 records). [2025-10-31T18:05:45.022552] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-31T18:05:45.062819] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-31T18:05:45.471241] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-31T18:05:45.471361] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-31T18:05:45.472592] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-31T18:05:45.472757] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-31T18:05:45.475120] [DEBUG] [LOCAL ] CPRI: Trimmed 76162 records to 53090 (keeping 200 days of data) [2025-10-31T18:05:45.602789] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-31T18:05:45.796803] [DEBUG] [LOCAL ] CPRI: Primary data saved (53090 records). [2025-10-31T18:05:45.796933] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-31T18:05:45.797004] [INFO ] [MAIN ] Update Progress: 524/2365 symbols completed. CPRI took 37.2s. Estimated remaining: 3h 50m 48s. Rate: 8.0 symbols/min [2025-10-31T18:05:45.862807] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-31T18:05:45.967242] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:46.005694] [DEBUG] [LOCAL ] CRC: Loaded 43887 existing records from primary storage. [2025-10-31T18:05:46.006016] [INFO ] [MAIN ] CRC: Loaded 43887 existing records. [2025-10-31T18:05:46.185933] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:05:46.186206] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-31T18:05:46.186259] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-31T18:05:46.187049] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-31T18:05:46.187110] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-31T18:05:46.560531] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:46.555602] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T18:05:46.562822] [INFO ] [REMOTE ] CRBD: Full fetch complete (12538 records). [2025-10-31T18:05:46.562890] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-31T18:05:46.563215] [FATAL] [VALIDATOR ] CRBD: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:05:46.563294] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:05:46.563341] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:05:46.563402] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-31T18:05:46.563461] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-31T18:05:46.563495] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-10-31T18:05:46.563709] [DEBUG] [LOCAL ] CRBD: Deleted derivative data file. [2025-10-31T18:05:46.563792] [INFO ] [MAIN ] Update Progress: 525/2365 symbols completed. CRBD took 17.4s. Estimated remaining: 3h 50m 17s. Rate: 8.0 symbols/min [2025-10-31T18:05:46.662828] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-31T18:05:46.740042] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:46.740195] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-31T18:05:46.740233] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-31T18:05:46.740342] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-31T18:05:46.740385] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-31T18:05:46.740427] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-31T18:05:46.740460] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-31T18:05:47.104437] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:47.457618] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-31T18:05:47.581532] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-31T18:05:48.257722] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-31T18:05:48.896117] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-31T18:05:49.057695] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-31T18:05:49.157630] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T18:05:49.238191] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T18:05:49.238613] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-31T18:05:49.238754] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:05:49.238833] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-31T18:05:49.238880] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:05:49.238924] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-31T18:05:49.238990] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-31T18:05:49.239029] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-31T18:05:49.239071] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-31T18:05:49.239126] [INFO ] [MAIN ] Update Progress: 526/2365 symbols completed. CRCL took 2.7s. Estimated remaining: 3h 49m 52s. Rate: 8.0 symbols/min [2025-10-31T18:05:49.436434] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:49.482400] [DEBUG] [LOCAL ] CRGY: Loaded 52865 existing records from primary storage. [2025-10-31T18:05:49.482741] [INFO ] [MAIN ] CRGY: Loaded 52865 existing records. [2025-10-31T18:05:49.662279] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:05:49.662538] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-31T18:05:49.662595] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-31T18:05:49.663403] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-31T18:05:49.663459] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-31T18:05:49.866417] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-31T18:05:50.037180] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:50.657618] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-31T18:05:50.760296] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-31T18:05:51.457667] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-31T18:05:51.846458] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T18:05:52.223730] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T18:05:52.257669] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-31T18:05:53.057682] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-31T18:05:53.713379] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-31T18:05:53.849776] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T18:05:53.857611] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-31T18:05:54.657724] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-31T18:05:55.033096] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-31T18:05:55.038987] [INFO ] [REMOTE ] CR: Full fetch complete (35223 records). [2025-10-31T18:05:55.039081] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-31T18:05:55.407826] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-31T18:05:55.407969] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-31T18:05:55.408561] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-31T18:05:55.408606] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-31T18:05:55.409601] [DEBUG] [LOCAL ] CR: Trimmed 35223 records to 24303 (keeping 200 days of data) [2025-10-31T18:05:55.463698] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-31T18:05:55.569006] [DEBUG] [LOCAL ] CR: Primary data saved (24303 records). [2025-10-31T18:05:55.569100] [INFO ] [MAIN ] CR: Full history saved. [2025-10-31T18:05:55.569175] [INFO ] [MAIN ] Update Progress: 527/2365 symbols completed. CR took 30.6s. Estimated remaining: 3h 49m 41s. Rate: 8.0 symbols/min [2025-10-31T18:05:55.747589] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:05:55.797835] [DEBUG] [LOCAL ] CRH: Loaded 53772 existing records from primary storage. [2025-10-31T18:05:55.798204] [INFO ] [MAIN ] CRH: Loaded 53772 existing records. [2025-10-31T18:05:55.974833] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:05:55.975118] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-31T18:05:55.975189] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-31T18:05:55.975957] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-31T18:05:55.976139] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-31T18:05:56.103314] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-31T18:05:56.262867] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-31T18:05:56.364703] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:05:56.684142] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T18:05:57.057685] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-31T18:05:57.464104] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T18:05:57.857732] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-31T18:05:58.322999] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T18:05:58.657687] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-31T18:05:59.126493] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T18:05:59.457632] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-31T18:05:59.917224] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-31T18:06:00.257668] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-31T18:06:00.867243] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T18:06:01.057687] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-31T18:06:01.750762] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-31T18:06:01.857670] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-31T18:06:02.657714] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-31T18:06:02.778818] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-31T18:06:02.810199] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T18:06:03.457662] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-31T18:06:03.925691] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-31T18:06:04.257637] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-31T18:06:04.905853] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T18:06:05.057683] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-31T18:06:05.407145] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T18:06:05.857686] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-31T18:06:06.420588] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:06:06.657679] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-31T18:06:07.049207] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T18:06:07.457741] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-31T18:06:07.990722] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T18:06:08.257714] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-31T18:06:08.741809] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T18:06:09.057709] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-31T18:06:09.686170] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-31T18:06:09.857689] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-31T18:06:10.585156] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T18:06:10.657638] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-31T18:06:11.457676] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-31T18:06:11.502344] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-31T18:06:12.068578] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T18:06:12.080779] [INFO ] [REMOTE ] CRBG: Full fetch complete (76033 records). [2025-10-31T18:06:12.080932] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-31T18:06:12.270167] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-31T18:06:12.468524] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-31T18:06:12.468603] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-31T18:06:12.469435] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-31T18:06:12.469499] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-31T18:06:12.470887] [DEBUG] [LOCAL ] CRBG: Trimmed 76033 records to 53321 (keeping 200 days of data) [2025-10-31T18:06:12.788374] [DEBUG] [LOCAL ] CRBG: Primary data saved (53321 records). [2025-10-31T18:06:12.788561] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-31T18:06:12.788662] [INFO ] [MAIN ] Update Progress: 528/2365 symbols completed. CRBG took 37.4s. Estimated remaining: 3h 50m 7s. Rate: 8.0 symbols/min [2025-10-31T18:06:12.965906] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:06:12.966104] [DEBUG] [LOCAL ] CRI: No existing data file found in primary storage. [2025-10-31T18:06:12.966175] [WARN ] [MAIN ] CRI: No existing data found, performing full refresh instead. [2025-10-31T18:06:12.966379] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-31T18:06:12.966447] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-31T18:06:12.966607] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-10-31T18:06:12.966774] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-31T18:06:13.059244] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-31T18:06:13.368320] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:06:13.363229] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-31T18:06:13.542948] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T18:06:13.857673] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-31T18:06:14.355585] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T18:06:14.657689] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-31T18:06:15.149221] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T18:06:15.457685] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-31T18:06:15.961921] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T18:06:16.257678] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-31T18:06:16.707017] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:06:17.057677] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-31T18:06:17.857668] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-31T18:06:17.891592] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T18:06:17.903748] [INFO ] [REMOTE ] CRGY: Full fetch complete (76166 records). [2025-10-31T18:06:17.903929] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-31T18:06:18.340351] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-31T18:06:18.340463] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-31T18:06:18.341458] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-31T18:06:18.341540] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-31T18:06:18.343214] [DEBUG] [LOCAL ] CRGY: Trimmed 76166 records to 53252 (keeping 200 days of data) [2025-10-31T18:06:18.469914] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T18:06:18.672047] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-31T18:06:18.694306] [DEBUG] [LOCAL ] CRGY: Primary data saved (53252 records). [2025-10-31T18:06:18.694414] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-31T18:06:18.695197] [INFO ] [MAIN ] Update Progress: 529/2365 symbols completed. CRGY took 29.5s. Estimated remaining: 3h 49m 54s. Rate: 8.0 symbols/min [2025-10-31T18:06:18.863519] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:06:18.914277] [DEBUG] [LOCAL ] CRK: Loaded 52527 existing records from primary storage. [2025-10-31T18:06:18.914591] [INFO ] [MAIN ] CRK: Loaded 52527 existing records. [2025-10-31T18:06:19.087728] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:06:19.087986] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-31T18:06:19.088054] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-31T18:06:19.089088] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-31T18:06:19.089158] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-31T18:06:19.463379] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-31T18:06:19.495721] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:06:19.529083] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-31T18:06:19.940217] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T18:06:20.257727] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-31T18:06:20.676740] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T18:06:21.057682] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-31T18:06:21.570125] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T18:06:21.857673] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-31T18:06:22.573402] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-31T18:06:22.657715] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-31T18:06:22.937147] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T18:06:23.457668] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-31T18:06:24.257698] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-31T18:06:24.661415] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-31T18:06:24.677148] [INFO ] [REMOTE ] CRH: Full fetch complete (77512 records). [2025-10-31T18:06:24.677364] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-31T18:06:24.971628] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T18:06:25.062798] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-31T18:06:25.150497] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-31T18:06:25.150579] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-31T18:06:25.151443] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-31T18:06:25.151544] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-31T18:06:25.153164] [DEBUG] [LOCAL ] CRH: Trimmed 77512 records to 54158 (keeping 200 days of data) [2025-10-31T18:06:25.487510] [DEBUG] [LOCAL ] CRH: Primary data saved (54158 records). [2025-10-31T18:06:25.487705] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-31T18:06:25.487813] [INFO ] [MAIN ] Update Progress: 530/2365 symbols completed. CRH took 29.9s. Estimated remaining: 3h 49m 44s. Rate: 8.0 symbols/min [2025-10-31T18:06:25.618457] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T18:06:25.695155] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:06:25.732741] [DEBUG] [LOCAL ] CRL: Loaded 42711 existing records from primary storage. [2025-10-31T18:06:25.733047] [INFO ] [MAIN ] CRL: Loaded 42711 existing records. [2025-10-31T18:06:25.862702] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-31T18:06:25.918857] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:06:25.919031] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-31T18:06:25.919078] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-31T18:06:25.919838] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-31T18:06:25.919898] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-31T18:06:26.288155] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:06:26.314582] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T18:06:26.657703] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-31T18:06:27.210608] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T18:06:27.457697] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-31T18:06:27.898410] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T18:06:28.257678] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-31T18:06:29.057684] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-31T18:06:29.498913] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-31T18:06:29.535077] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T18:06:29.857673] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-31T18:06:30.242300] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T18:06:30.657699] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-31T18:06:31.065502] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T18:06:31.457698] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-31T18:06:31.960845] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T18:06:32.257673] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-31T18:06:32.610923] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T18:06:33.057699] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-31T18:06:33.553758] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T18:06:33.563125] [INFO ] [REMOTE ] CRC: Full fetch complete (62585 records). [2025-10-31T18:06:33.563240] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-31T18:06:33.862759] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-31T18:06:33.944899] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-31T18:06:33.944972] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-31T18:06:33.945702] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-31T18:06:33.945763] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-31T18:06:33.946936] [DEBUG] [LOCAL ] CRC: Trimmed 62585 records to 44132 (keeping 200 days of data) [2025-10-31T18:06:34.203003] [DEBUG] [LOCAL ] CRC: Primary data saved (44132 records). [2025-10-31T18:06:34.203153] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-31T18:06:34.203292] [INFO ] [MAIN ] Update Progress: 531/2365 symbols completed. CRC took 48.4s. Estimated remaining: 3h 49m 40s. Rate: 8.0 symbols/min [2025-10-31T18:06:34.378922] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:06:34.409157] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T18:06:34.463332] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-31T18:06:34.463674] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-10-31T18:06:34.635923] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:06:34.636098] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-31T18:06:34.636146] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-31T18:06:34.637197] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-31T18:06:34.637254] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-31T18:06:34.667500] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-31T18:06:34.989438] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:06:35.326456] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T18:06:35.338239] [INFO ] [REMOTE ] CRI: Full fetch complete (71022 records). [2025-10-31T18:06:35.338394] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-31T18:06:35.462736] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-31T18:06:35.802408] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-31T18:06:35.802481] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-31T18:06:35.803273] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-31T18:06:35.803333] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-31T18:06:35.804590] [DEBUG] [LOCAL ] CRI: Trimmed 71022 records to 50109 (keeping 200 days of data) [2025-10-31T18:06:36.095772] [DEBUG] [LOCAL ] CRI: Primary data saved (50109 records). [2025-10-31T18:06:36.095893] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-31T18:06:36.095961] [INFO ] [MAIN ] Update Progress: 532/2365 symbols completed. CRI took 23.3s. Estimated remaining: 3h 49m 14s. Rate: 8.0 symbols/min [2025-10-31T18:06:36.268727] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:06:36.266298] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-31T18:06:36.303307] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T18:06:36.347844] [DEBUG] [LOCAL ] CRS: Loaded 43436 existing records from primary storage. [2025-10-31T18:06:36.348173] [INFO ] [MAIN ] CRS: Loaded 43436 existing records. [2025-10-31T18:06:36.520471] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:06:36.520706] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-31T18:06:36.520761] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-31T18:06:36.521677] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-31T18:06:36.521763] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-31T18:06:36.877332] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:06:36.907757] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T18:06:37.057615] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-31T18:06:37.857630] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-31T18:06:38.311840] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T18:06:38.463694] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-31T18:06:38.657626] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-31T18:06:39.188147] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T18:06:39.457721] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-31T18:06:40.257713] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-31T18:06:40.531417] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-31T18:06:40.859208] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:06:41.057679] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-31T18:06:41.492364] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T18:06:41.857679] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-31T18:06:42.251089] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T18:06:42.657675] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-31T18:06:43.038924] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T18:06:43.457683] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-31T18:06:44.257622] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-31T18:06:44.397955] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-31T18:06:44.760013] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T18:06:45.057688] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-31T18:06:45.387176] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T18:06:45.857668] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-31T18:06:46.459067] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T18:06:46.657718] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-31T18:06:47.042801] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T18:06:47.457715] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-31T18:06:47.943148] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T18:06:48.257718] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-31T18:06:49.057621] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-31T18:06:49.317893] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-31T18:06:49.604223] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-31T18:06:49.857685] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-31T18:06:50.444020] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-31T18:06:50.657630] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-31T18:06:51.180779] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T18:06:51.457671] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-31T18:06:52.257735] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-31T18:06:52.376050] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-31T18:06:52.388975] [INFO ] [REMOTE ] CRK: Full fetch complete (75726 records). [2025-10-31T18:06:52.389129] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-31T18:06:52.852394] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-31T18:06:52.907217] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-31T18:06:52.907407] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-31T18:06:52.908366] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-31T18:06:52.908447] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-31T18:06:52.910182] [DEBUG] [LOCAL ] CRK: Trimmed 75726 records to 52911 (keeping 200 days of data) [2025-10-31T18:06:53.079353] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-31T18:06:53.222908] [DEBUG] [LOCAL ] CRK: Primary data saved (52911 records). [2025-10-31T18:06:53.223040] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-31T18:06:53.223805] [INFO ] [MAIN ] Update Progress: 533/2365 symbols completed. CRK took 34.5s. Estimated remaining: 3h 49m 39s. Rate: 8.0 symbols/min [2025-10-31T18:06:53.387618] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:06:53.394418] [DEBUG] [LOCAL ] CRT: Loaded 4837 existing records from primary storage. [2025-10-31T18:06:53.394624] [INFO ] [MAIN ] CRT: Loaded 4837 existing records. [2025-10-31T18:06:53.565194] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:06:53.565383] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-31T18:06:53.565429] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-31T18:06:53.565606] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-31T18:06:53.565672] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-31T18:06:53.862526] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-31T18:06:53.915787] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:06:54.008159] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-31T18:06:54.117367] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T18:06:54.657670] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-31T18:06:55.244046] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-31T18:06:55.271501] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T18:06:55.457686] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-31T18:06:56.257635] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-31T18:06:56.591043] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T18:06:56.605390] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-31T18:06:57.057733] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-31T18:06:57.511069] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-31T18:06:57.857688] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-31T18:06:58.300832] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-31T18:06:58.657674] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-31T18:06:59.457681] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-31T18:06:59.904066] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-31T18:06:59.929027] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T18:07:00.257701] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-31T18:07:01.057710] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-31T18:07:01.844498] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T18:07:01.854127] [INFO ] [REMOTE ] CRL: Full fetch complete (63430 records). [2025-10-31T18:07:01.854235] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-31T18:07:01.854842] [FATAL] [VALIDATOR ] CRL: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:07:01.854923] [FATAL] [MAIN ] CRL: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:07:01.854965] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:07:01.855010] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-31T18:07:01.855067] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-10-31T18:07:01.855101] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-10-31T18:07:01.855260] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-10-31T18:07:01.855346] [INFO ] [MAIN ] Update Progress: 534/2365 symbols completed. CRL took 36.4s. Estimated remaining: 3h 49m 35s. Rate: 8.0 symbols/min [2025-10-31T18:07:01.866111] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-31T18:07:02.037548] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:02.074084] [DEBUG] [LOCAL ] CSAN: Loaded 42325 existing records from primary storage. [2025-10-31T18:07:02.074352] [INFO ] [MAIN ] CSAN: Loaded 42325 existing records. [2025-10-31T18:07:02.249094] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:07:02.249317] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-31T18:07:02.249364] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-31T18:07:02.249534] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-31T18:07:02.249570] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-31T18:07:02.368584] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-31T18:07:02.612814] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:02.665069] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-31T18:07:02.682389] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T18:07:02.692358] [INFO ] [REMOTE ] CRS: Full fetch complete (62719 records). [2025-10-31T18:07:02.692477] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-31T18:07:03.074444] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-31T18:07:03.074531] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-31T18:07:03.075350] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-31T18:07:03.075413] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-31T18:07:03.076676] [DEBUG] [LOCAL ] CRS: Trimmed 62719 records to 43666 (keeping 200 days of data) [2025-10-31T18:07:03.198987] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T18:07:03.362420] [DEBUG] [LOCAL ] CRS: Primary data saved (43666 records). [2025-10-31T18:07:03.362549] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-31T18:07:03.362630] [INFO ] [MAIN ] Update Progress: 535/2365 symbols completed. CRS took 27.3s. Estimated remaining: 3h 49m 7s. Rate: 8.0 symbols/min [2025-10-31T18:07:03.465013] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-31T18:07:03.542506] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:03.573479] [DEBUG] [LOCAL ] CSL: Loaded 31136 existing records from primary storage. [2025-10-31T18:07:03.573821] [INFO ] [MAIN ] CSL: Loaded 31136 existing records. [2025-10-31T18:07:03.755465] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:07:03.755701] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-31T18:07:03.755760] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-31T18:07:03.756269] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-31T18:07:03.756326] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-31T18:07:04.104224] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:04.257702] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-31T18:07:04.837954] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T18:07:05.057623] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-31T18:07:05.857726] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-31T18:07:06.041867] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T18:07:06.392117] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-31T18:07:06.657684] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-31T18:07:06.815926] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-31T18:07:07.457731] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-31T18:07:07.640917] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-31T18:07:08.257727] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-31T18:07:08.448818] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T18:07:08.785180] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-31T18:07:09.057710] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-31T18:07:09.434570] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-31T18:07:09.857693] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-31T18:07:10.657690] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-31T18:07:10.837951] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-31T18:07:10.839876] [INFO ] [REMOTE ] CRT: Full fetch complete (7425 records). [2025-10-31T18:07:10.839951] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-31T18:07:11.227184] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-31T18:07:11.227263] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-31T18:07:11.227449] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-31T18:07:11.227486] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-31T18:07:11.227939] [DEBUG] [LOCAL ] CRT: Trimmed 7425 records to 4867 (keeping 200 days of data) [2025-10-31T18:07:11.257300] [DEBUG] [LOCAL ] CRT: Primary data saved (4867 records). [2025-10-31T18:07:11.257428] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-31T18:07:11.257505] [INFO ] [MAIN ] Update Progress: 536/2365 symbols completed. CRT took 18.0s. Estimated remaining: 3h 49m 1s. Rate: 8.0 symbols/min [2025-10-31T18:07:11.422672] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:11.436220] [DEBUG] [LOCAL ] CSR: Loaded 13422 existing records from primary storage. [2025-10-31T18:07:11.436424] [INFO ] [MAIN ] CSR: Loaded 13422 existing records. [2025-10-31T18:07:11.466768] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-31T18:07:11.620147] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:07:11.620516] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-31T18:07:11.620584] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-31T18:07:11.620835] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-31T18:07:11.621028] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-31T18:07:11.820766] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T18:07:12.009361] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:12.257679] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-31T18:07:12.868176] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-31T18:07:13.057681] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-31T18:07:13.312743] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-31T18:07:13.592239] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T18:07:13.857673] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-31T18:07:14.403501] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T18:07:14.657673] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-31T18:07:15.457685] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-31T18:07:15.998503] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T18:07:16.257752] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-31T18:07:17.057703] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-31T18:07:17.279862] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T18:07:17.374479] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-31T18:07:17.857733] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-31T18:07:18.278357] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T18:07:18.611207] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T18:07:18.657677] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-31T18:07:19.347743] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-31T18:07:19.457696] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-31T18:07:20.257712] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-31T18:07:20.569586] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T18:07:21.057675] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-31T18:07:21.857668] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-31T18:07:22.099862] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T18:07:22.487822] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-31T18:07:22.657685] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-31T18:07:22.739708] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T18:07:23.457615] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-31T18:07:23.612369] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-31T18:07:24.128918] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T18:07:24.141181] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-10-31T18:07:24.141303] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-31T18:07:24.262774] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-31T18:07:24.525734] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-31T18:07:24.525831] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-31T18:07:24.526664] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-31T18:07:24.526726] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-31T18:07:24.528055] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 54550 (keeping 200 days of data) [2025-10-31T18:07:24.862391] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-10-31T18:07:24.862574] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-31T18:07:24.862691] [INFO ] [MAIN ] Update Progress: 537/2365 symbols completed. CRM took 50.7s. Estimated remaining: 3h 49m 14s. Rate: 8.0 symbols/min [2025-10-31T18:07:25.028263] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:25.068132] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-31T18:07:25.071008] [DEBUG] [LOCAL ] CSTM: Loaded 47705 existing records from primary storage. [2025-10-31T18:07:25.071351] [INFO ] [MAIN ] CSTM: Loaded 47705 existing records. [2025-10-31T18:07:25.251392] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:07:25.251827] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-31T18:07:25.251890] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-31T18:07:25.252119] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-31T18:07:25.252176] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-31T18:07:25.488212] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T18:07:25.639980] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:25.857615] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-31T18:07:25.912172] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T18:07:26.655218] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T18:07:26.658256] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-31T18:07:27.457665] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-31T18:07:28.022287] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T18:07:28.023283] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-31T18:07:28.257684] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-31T18:07:29.057709] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-31T18:07:29.496708] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-31T18:07:29.505418] [INFO ] [REMOTE ] CSAN: Full fetch complete (60111 records). [2025-10-31T18:07:29.505530] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-31T18:07:29.506143] [FATAL] [VALIDATOR ] CSAN: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:07:29.506225] [FATAL] [MAIN ] CSAN: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:07:29.506268] [WARN ] [MAIN ] CSAN: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:07:29.506305] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-31T18:07:29.506405] [DEBUG] [LOCAL ] CSAN: No primary data file found to delete. [2025-10-31T18:07:29.506446] [INFO ] [LOCAL ] CSAN: Starting deletion of derivative data. [2025-10-31T18:07:29.506608] [DEBUG] [LOCAL ] CSAN: Deleted derivative data file. [2025-10-31T18:07:29.506723] [INFO ] [MAIN ] Update Progress: 538/2365 symbols completed. CSAN took 27.7s. Estimated remaining: 3h 48m 57s. Rate: 8.0 symbols/min [2025-10-31T18:07:29.669920] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:29.682301] [DEBUG] [LOCAL ] CSV: Loaded 11910 existing records from primary storage. [2025-10-31T18:07:29.682507] [INFO ] [MAIN ] CSV: Loaded 11910 existing records. [2025-10-31T18:07:29.853490] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:07:29.853770] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-31T18:07:29.853820] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-31T18:07:29.853987] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-31T18:07:29.854041] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-31T18:07:29.865152] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-31T18:07:30.211590] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:30.238078] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T18:07:30.548126] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-31T18:07:30.657672] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-31T18:07:31.457674] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-31T18:07:31.753877] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-31T18:07:32.261448] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-31T18:07:32.267463] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T18:07:32.271981] [INFO ] [REMOTE ] CSR: Full fetch complete (18031 records). [2025-10-31T18:07:32.272058] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-31T18:07:32.691869] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-31T18:07:32.691980] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-31T18:07:32.692456] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-31T18:07:32.692519] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-31T18:07:32.693133] [DEBUG] [LOCAL ] CSR: Trimmed 18031 records to 13506 (keeping 200 days of data) [2025-10-31T18:07:32.780084] [DEBUG] [LOCAL ] CSR: Primary data saved (13506 records). [2025-10-31T18:07:32.780234] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-31T18:07:32.780355] [INFO ] [MAIN ] Update Progress: 539/2365 symbols completed. CSR took 21.5s. Estimated remaining: 3h 48m 35s. Rate: 8.0 symbols/min [2025-10-31T18:07:32.985633] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:32.985865] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-31T18:07:32.985910] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-31T18:07:32.986020] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-31T18:07:32.986061] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-31T18:07:32.986104] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-31T18:07:32.986137] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-31T18:07:33.062547] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-31T18:07:33.359318] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:33.380903] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T18:07:33.789196] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T18:07:33.857714] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-31T18:07:34.010272] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T18:07:34.010632] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-31T18:07:34.010736] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:07:34.010801] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-31T18:07:34.010866] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:07:34.010936] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-31T18:07:34.010995] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-31T18:07:34.011030] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-31T18:07:34.011069] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-31T18:07:34.011114] [INFO ] [MAIN ] Update Progress: 540/2365 symbols completed. CSW took 1.2s. Estimated remaining: 3h 48m 6s. Rate: 8.0 symbols/min [2025-10-31T18:07:34.177518] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:34.177693] [DEBUG] [LOCAL ] CTBB: No existing data file found in primary storage. [2025-10-31T18:07:34.177743] [WARN ] [MAIN ] CTBB: No existing data found, performing full refresh instead. [2025-10-31T18:07:34.177859] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-31T18:07:34.177915] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-31T18:07:34.177964] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-31T18:07:34.177997] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-31T18:07:34.519146] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:34.657635] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-31T18:07:35.205178] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-31T18:07:35.457683] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-31T18:07:36.257693] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-31T18:07:36.558000] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T18:07:36.718870] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-31T18:07:37.057726] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-31T18:07:37.857689] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-31T18:07:38.209431] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-31T18:07:38.217023] [INFO ] [REMOTE ] CSL: Full fetch complete (45954 records). [2025-10-31T18:07:38.217158] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-31T18:07:38.614551] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-31T18:07:38.614630] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-31T18:07:38.615266] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-31T18:07:38.615315] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-31T18:07:38.616342] [DEBUG] [LOCAL ] CSL: Trimmed 45954 records to 31367 (keeping 200 days of data) [2025-10-31T18:07:38.670848] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-31T18:07:38.807709] [DEBUG] [LOCAL ] CSL: Primary data saved (31367 records). [2025-10-31T18:07:38.807845] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-31T18:07:38.807964] [INFO ] [MAIN ] Update Progress: 541/2365 symbols completed. CSL took 35.4s. Estimated remaining: 3h 47m 50s. Rate: 8.0 symbols/min [2025-10-31T18:07:38.981303] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:39.009121] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T18:07:39.022051] [DEBUG] [LOCAL ] CTDD: Loaded 4939 existing records from primary storage. [2025-10-31T18:07:39.022292] [INFO ] [MAIN ] CTDD: Loaded 4939 existing records. [2025-10-31T18:07:39.143599] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-31T18:07:39.217245] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:07:39.217452] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-31T18:07:39.217499] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-31T18:07:39.217738] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-31T18:07:39.217795] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-31T18:07:39.462864] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-31T18:07:39.577995] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:40.257682] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-31T18:07:40.554336] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T18:07:40.763056] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T18:07:41.057705] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-31T18:07:41.681032] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-31T18:07:41.857673] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-31T18:07:42.657672] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-31T18:07:43.130405] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T18:07:43.151609] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-31T18:07:43.457682] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-31T18:07:44.230065] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T18:07:44.257632] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-31T18:07:44.669901] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-31T18:07:45.057667] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-31T18:07:45.755286] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T18:07:45.857627] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-31T18:07:46.461932] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-31T18:07:46.657687] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-31T18:07:47.065726] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-31T18:07:47.457673] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-31T18:07:48.257680] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-31T18:07:48.551360] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T18:07:48.840184] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-31T18:07:49.057686] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-31T18:07:49.641597] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-31T18:07:49.857749] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-31T18:07:50.263118] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-31T18:07:50.657702] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-31T18:07:51.115139] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-31T18:07:51.457707] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-31T18:07:52.019975] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-31T18:07:52.257690] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-31T18:07:53.057732] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-31T18:07:53.391738] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T18:07:53.523518] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-31T18:07:53.857665] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-31T18:07:54.476351] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-31T18:07:54.657677] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-31T18:07:55.067728] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T18:07:55.457669] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-31T18:07:56.061875] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-31T18:07:56.257746] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-31T18:07:56.656746] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-31T18:07:57.057729] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-31T18:07:57.527436] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-31T18:07:57.529252] [INFO ] [REMOTE ] CTBB: Full fetch complete (9980 records). [2025-10-31T18:07:57.529346] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-31T18:07:57.859387] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-31T18:07:57.882121] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-31T18:07:57.882198] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-31T18:07:57.882451] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-31T18:07:57.882487] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-31T18:07:57.882936] [DEBUG] [LOCAL ] CTBB: Trimmed 9980 records to 6275 (keeping 200 days of data) [2025-10-31T18:07:57.920591] [DEBUG] [LOCAL ] CTBB: Primary data saved (6275 records). [2025-10-31T18:07:57.920740] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-31T18:07:57.920819] [INFO ] [MAIN ] Update Progress: 542/2365 symbols completed. CTBB took 23.9s. Estimated remaining: 3h 48m 21s. Rate: 8.0 symbols/min [2025-10-31T18:07:58.086964] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:58.087159] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-31T18:07:58.087196] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-31T18:07:58.087304] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-31T18:07:58.087345] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-31T18:07:58.087385] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-31T18:07:58.087416] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-31T18:07:58.456539] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:07:58.466679] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-31T18:07:58.657672] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-31T18:07:59.457690] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-31T18:07:59.603191] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T18:07:59.603500] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-31T18:07:59.603589] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:07:59.603634] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-31T18:07:59.603715] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:07:59.603791] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-31T18:07:59.603886] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-31T18:07:59.603952] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-31T18:07:59.604002] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-31T18:07:59.604049] [INFO ] [MAIN ] Update Progress: 543/2365 symbols completed. CTEV took 1.7s. Estimated remaining: 3h 47m 54s. Rate: 8.0 symbols/min [2025-10-31T18:07:59.775426] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:07:59.804760] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-31T18:07:59.835965] [DEBUG] [LOCAL ] CTO: Loaded 27282 existing records from primary storage. [2025-10-31T18:07:59.836224] [INFO ] [MAIN ] CTO: Loaded 27282 existing records. [2025-10-31T18:08:00.017592] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:08:00.017818] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-31T18:08:00.017904] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-31T18:08:00.018414] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-31T18:08:00.018472] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-31T18:08:00.262887] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-31T18:08:00.385357] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:08:00.747544] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-31T18:08:01.057685] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-31T18:08:01.857702] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-31T18:08:02.284230] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T18:08:02.522421] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-31T18:08:02.525239] [INFO ] [REMOTE ] CSV: Full fetch complete (18753 records). [2025-10-31T18:08:02.525313] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-31T18:08:02.662797] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-31T18:08:02.888965] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-31T18:08:02.889040] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-31T18:08:02.889420] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-31T18:08:02.889459] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-31T18:08:02.889989] [DEBUG] [LOCAL ] CSV: Trimmed 18753 records to 11963 (keeping 200 days of data) [2025-10-31T18:08:02.959660] [DEBUG] [LOCAL ] CSV: Primary data saved (11963 records). [2025-10-31T18:08:02.959802] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-31T18:08:02.959882] [INFO ] [MAIN ] Update Progress: 544/2365 symbols completed. CSV took 33.5s. Estimated remaining: 3h 47m 33s. Rate: 8.0 symbols/min [2025-10-31T18:08:03.124286] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:08:03.158810] [DEBUG] [LOCAL ] CTOS: Loaded 37426 existing records from primary storage. [2025-10-31T18:08:03.159149] [INFO ] [MAIN ] CTOS: Loaded 37426 existing records. [2025-10-31T18:08:03.276426] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-31T18:08:03.344994] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:08:03.345218] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-31T18:08:03.345270] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-31T18:08:03.345903] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-31T18:08:03.345961] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-31T18:08:03.462862] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-31T18:08:03.747052] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:08:04.257738] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-31T18:08:04.939842] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-31T18:08:05.057718] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-31T18:08:05.411092] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T18:08:05.857740] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-31T18:08:06.568136] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-31T18:08:06.578570] [INFO ] [REMOTE ] CSTM: Full fetch complete (69199 records). [2025-10-31T18:08:06.578733] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-31T18:08:06.579369] [FATAL] [VALIDATOR ] CSTM: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:08:06.579486] [FATAL] [MAIN ] CSTM: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:08:06.579529] [WARN ] [MAIN ] CSTM: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:08:06.579566] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-31T18:08:06.579623] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-31T18:08:06.579702] [INFO ] [LOCAL ] CSTM: Starting deletion of derivative data. [2025-10-31T18:08:06.579916] [DEBUG] [LOCAL ] CSTM: Deleted derivative data file. [2025-10-31T18:08:06.580002] [INFO ] [MAIN ] Update Progress: 545/2365 symbols completed. CSTM took 41.7s. Estimated remaining: 3h 47m 12s. Rate: 8.0 symbols/min [2025-10-31T18:08:06.662917] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-31T18:08:06.754262] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:08:06.811880] [DEBUG] [LOCAL ] CTRA: Loaded 54036 existing records from primary storage. [2025-10-31T18:08:06.819268] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T18:08:06.818761] [INFO ] [MAIN ] CTRA: Loaded 54036 existing records. [2025-10-31T18:08:07.002840] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:08:07.003063] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-31T18:08:07.003112] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-31T18:08:07.004045] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-31T18:08:07.004102] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-31T18:08:07.165963] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T18:08:07.371034] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:08:07.457616] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-31T18:08:08.257687] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-31T18:08:08.893121] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T18:08:09.057668] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-31T18:08:09.333712] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T18:08:09.366503] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-31T18:08:09.857672] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-31T18:08:10.657630] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-31T18:08:10.692946] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-31T18:08:11.457682] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-31T18:08:12.184319] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-31T18:08:12.257674] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-31T18:08:12.385855] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T18:08:13.057719] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-31T18:08:13.698326] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-31T18:08:13.857635] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-31T18:08:14.198132] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T18:08:14.657667] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-31T18:08:15.291096] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-31T18:08:15.457796] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-31T18:08:15.661669] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-31T18:08:16.257693] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-31T18:08:16.870815] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T18:08:16.872358] [INFO ] [REMOTE ] CTDD: Full fetch complete (7922 records). [2025-10-31T18:08:16.872437] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-31T18:08:17.060468] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-31T18:08:17.051971] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-31T18:08:17.282827] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-31T18:08:17.282900] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-31T18:08:17.283098] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-31T18:08:17.283137] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-31T18:08:17.283537] [DEBUG] [LOCAL ] CTDD: Trimmed 7922 records to 5015 (keeping 200 days of data) [2025-10-31T18:08:17.313290] [DEBUG] [LOCAL ] CTDD: Primary data saved (5015 records). [2025-10-31T18:08:17.313412] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-31T18:08:17.313493] [INFO ] [MAIN ] Update Progress: 546/2365 symbols completed. CTDD took 38.5s. Estimated remaining: 3h 47m 16s. Rate: 8.0 symbols/min [2025-10-31T18:08:17.491945] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:08:17.536514] [DEBUG] [LOCAL ] CTRE: Loaded 49771 existing records from primary storage. [2025-10-31T18:08:17.536906] [INFO ] [MAIN ] CTRE: Loaded 49771 existing records. [2025-10-31T18:08:17.714719] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:08:17.714952] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-31T18:08:17.715000] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-31T18:08:17.715939] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-31T18:08:17.715996] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-31T18:08:17.864394] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-31T18:08:18.071535] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:08:18.284632] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T18:08:18.657684] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-31T18:08:18.710692] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-31T18:08:19.457703] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-31T18:08:19.989871] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:08:20.257665] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-31T18:08:20.399814] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T18:08:21.057671] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-31T18:08:21.800274] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-31T18:08:21.857598] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-31T18:08:21.968376] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T18:08:22.657668] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-31T18:08:22.901516] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T18:08:23.457714] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-31T18:08:24.110955] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T18:08:24.257703] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-31T18:08:24.782447] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T18:08:25.057716] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-31T18:08:25.700932] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T18:08:25.857672] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-31T18:08:26.070505] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T18:08:26.657721] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-31T18:08:26.756857] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-31T18:08:27.457678] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-31T18:08:27.795549] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T18:08:28.257686] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-31T18:08:29.045813] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T18:08:29.057625] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-31T18:08:29.058996] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-31T18:08:29.059079] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-31T18:08:29.348410] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T18:08:29.532189] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-31T18:08:29.532280] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-31T18:08:29.533256] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-31T18:08:29.533326] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-31T18:08:29.534848] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 54426 (keeping 200 days of data) [2025-10-31T18:08:29.870134] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-31T18:08:29.901387] [DEBUG] [LOCAL ] CTRA: Primary data saved (54426 records). [2025-10-31T18:08:29.901564] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-31T18:08:29.901700] [INFO ] [MAIN ] Update Progress: 547/2365 symbols completed. CTRA took 23.3s. Estimated remaining: 3h 47m 25s. Rate: 8.0 symbols/min [2025-10-31T18:08:30.099960] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:08:30.137997] [DEBUG] [LOCAL ] CTRI: Loaded 41628 existing records from primary storage. [2025-10-31T18:08:30.138291] [INFO ] [MAIN ] CTRI: Loaded 41628 existing records. [2025-10-31T18:08:30.348879] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:08:30.349201] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-31T18:08:30.349285] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-31T18:08:30.350143] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-31T18:08:30.350206] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-31T18:08:30.662986] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-31T18:08:30.713483] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-31T18:08:30.811142] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:08:30.833620] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T18:08:31.457711] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-31T18:08:31.823117] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T18:08:32.257635] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-31T18:08:32.421227] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-31T18:08:33.057700] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-31T18:08:33.529868] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T18:08:33.536917] [INFO ] [REMOTE ] CTO: Full fetch complete (41527 records). [2025-10-31T18:08:33.537014] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-31T18:08:33.862772] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-31T18:08:33.935878] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-31T18:08:33.935993] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-31T18:08:33.937213] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-31T18:08:33.937282] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-31T18:08:33.938517] [DEBUG] [LOCAL ] CTO: Trimmed 41527 records to 27479 (keeping 200 days of data) [2025-10-31T18:08:34.120370] [DEBUG] [LOCAL ] CTO: Primary data saved (27479 records). [2025-10-31T18:08:34.120613] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-31T18:08:34.120767] [INFO ] [MAIN ] Update Progress: 548/2365 symbols completed. CTO took 34.5s. Estimated remaining: 3h 47m 7s. Rate: 8.0 symbols/min [2025-10-31T18:08:34.304304] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:08:34.336966] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T18:08:34.362965] [DEBUG] [LOCAL ] CTS: Loaded 19504 existing records from primary storage. [2025-10-31T18:08:34.363399] [INFO ] [MAIN ] CTS: Loaded 19504 existing records. [2025-10-31T18:08:34.556047] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:08:34.556378] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-31T18:08:34.556432] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-31T18:08:34.557100] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-31T18:08:34.557161] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-31T18:08:34.663787] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-31T18:08:34.860797] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T18:08:34.981767] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:08:35.457632] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-31T18:08:35.663142] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T18:08:36.257719] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-31T18:08:36.743089] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T18:08:37.057689] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-31T18:08:37.193265] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-31T18:08:37.857718] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-31T18:08:38.223777] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T18:08:38.657627] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-31T18:08:38.772487] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-31T18:08:39.457705] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-31T18:08:39.926309] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T18:08:40.193281] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-31T18:08:40.257685] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-31T18:08:40.884913] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T18:08:41.057711] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-31T18:08:41.788680] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-31T18:08:41.857697] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-31T18:08:42.657745] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-31T18:08:42.939358] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T18:08:43.457668] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-31T18:08:43.641186] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T18:08:44.257631] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-31T18:08:44.325507] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T18:08:45.057687] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-31T18:08:45.618764] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T18:08:45.628281] [INFO ] [REMOTE ] CTOS: Full fetch complete (54223 records). [2025-10-31T18:08:45.628432] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-31T18:08:45.862755] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-31T18:08:46.014698] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-31T18:08:46.014794] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-31T18:08:46.015547] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-31T18:08:46.015637] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-31T18:08:46.016964] [DEBUG] [LOCAL ] CTOS: Trimmed 54223 records to 37693 (keeping 200 days of data) [2025-10-31T18:08:46.228127] [DEBUG] [LOCAL ] CTOS: Primary data saved (37693 records). [2025-10-31T18:08:46.228353] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-31T18:08:46.228474] [INFO ] [MAIN ] Update Progress: 549/2365 symbols completed. CTOS took 43.3s. Estimated remaining: 3h 47m 15s. Rate: 8.0 symbols/min [2025-10-31T18:08:46.356775] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:08:46.436133] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:08:46.482420] [DEBUG] [LOCAL ] CTVA: Loaded 53687 existing records from primary storage. [2025-10-31T18:08:46.482760] [INFO ] [MAIN ] CTVA: Loaded 53687 existing records. [2025-10-31T18:08:46.655201] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:08:46.655410] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-31T18:08:46.655458] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-31T18:08:46.656554] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-31T18:08:46.656613] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-31T18:08:46.667767] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-31T18:08:47.003855] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:08:47.384217] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-31T18:08:47.457683] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-31T18:08:47.704128] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T18:08:48.257691] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-31T18:08:48.847798] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T18:08:48.862588] [INFO ] [REMOTE ] CTRE: Full fetch complete (71476 records). [2025-10-31T18:08:48.862789] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-31T18:08:49.062861] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-31T18:08:49.250819] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-31T18:08:49.250897] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-31T18:08:49.251719] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-31T18:08:49.251782] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-31T18:08:49.253084] [DEBUG] [LOCAL ] CTRE: Trimmed 71476 records to 50135 (keeping 200 days of data) [2025-10-31T18:08:49.552437] [DEBUG] [LOCAL ] CTRE: Primary data saved (50135 records). [2025-10-31T18:08:49.552635] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-31T18:08:49.552833] [INFO ] [MAIN ] Update Progress: 550/2365 symbols completed. CTRE took 32.2s. Estimated remaining: 3h 46m 53s. Rate: 8.0 symbols/min [2025-10-31T18:08:49.753008] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:08:49.755408] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-31T18:08:49.755326] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T18:08:49.755569] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-31T18:08:49.765729] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-31T18:08:49.766462] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-31T18:08:49.766523] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-31T18:08:49.766557] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-31T18:08:49.863431] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-31T18:08:50.134375] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:08:50.149193] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T18:08:50.657627] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-31T18:08:51.115008] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:08:51.457663] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-31T18:08:51.491187] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T18:08:52.257703] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-31T18:08:52.734156] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T18:08:52.862720] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-31T18:08:53.057664] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-31T18:08:53.790325] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T18:08:53.857668] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-31T18:08:54.166737] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-31T18:08:54.657638] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-31T18:08:54.896569] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-31T18:08:55.457683] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-31T18:08:56.230155] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T18:08:56.257613] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-31T18:08:56.898764] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T18:08:57.057685] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-31T18:08:57.857705] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-31T18:08:58.398270] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T18:08:58.657632] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-31T18:08:58.834105] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-31T18:08:58.840310] [INFO ] [REMOTE ] CTS: Full fetch complete (27639 records). [2025-10-31T18:08:58.840497] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-31T18:08:59.018198] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-31T18:08:59.212816] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-31T18:08:59.212894] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-31T18:08:59.213380] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-31T18:08:59.213419] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-31T18:08:59.214061] [DEBUG] [LOCAL ] CTS: Trimmed 27639 records to 19617 (keeping 200 days of data) [2025-10-31T18:08:59.327775] [DEBUG] [LOCAL ] CTS: Primary data saved (19617 records). [2025-10-31T18:08:59.327939] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-31T18:08:59.328025] [INFO ] [MAIN ] Update Progress: 551/2365 symbols completed. CTS took 25.2s. Estimated remaining: 3h 46m 53s. Rate: 8.0 symbols/min [2025-10-31T18:08:59.465607] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-31T18:08:59.499877] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:08:59.551401] [DEBUG] [LOCAL ] CUBE: Loaded 51222 existing records from primary storage. [2025-10-31T18:08:59.551816] [INFO ] [MAIN ] CUBE: Loaded 51222 existing records. [2025-10-31T18:08:59.731995] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:08:59.732200] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-31T18:08:59.732298] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-31T18:08:59.732742] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-31T18:08:59.732799] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-31T18:09:00.102503] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:00.257692] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-31T18:09:01.057730] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-31T18:09:01.118606] [DEBUG] [REMOTE ] CUBE: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-31T18:09:01.118984] [WARN ] [REMOTE ] CUBE: No data returned for month 2025-01 [2025-10-31T18:09:01.119076] [FATAL] [REMOTE ] CUBE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:09:01.119124] [FATAL] [MAIN ] CUBE: Failed to fetch primary data. [2025-10-31T18:09:01.119192] [WARN ] [MAIN ] CUBE: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:09:01.119267] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-31T18:09:01.119332] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-31T18:09:01.119368] [INFO ] [LOCAL ] CUBE: Starting deletion of derivative data. [2025-10-31T18:09:01.119530] [DEBUG] [LOCAL ] CUBE: Deleted derivative data file. [2025-10-31T18:09:01.120372] [INFO ] [MAIN ] Update Progress: 552/2365 symbols completed. CUBE took 1.8s. Estimated remaining: 3h 46m 27s. Rate: 8.0 symbols/min [2025-10-31T18:09:01.305073] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:01.343398] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-31T18:09:01.355253] [INFO ] [REMOTE ] CTRI: Full fetch complete (55689 records). [2025-10-31T18:09:01.355421] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-31T18:09:01.500418] [DEBUG] [LOCAL ] CUBI: Loaded 26914 existing records from primary storage. [2025-10-31T18:09:01.525099] [INFO ] [MAIN ] CUBI: Loaded 26914 existing records. [2025-10-31T18:09:01.882868] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-31T18:09:01.976931] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:09:01.993999] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-31T18:09:01.994178] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-31T18:09:01.994225] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-31T18:09:01.995090] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-31T18:09:01.995289] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-31T18:09:01.995152] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-31T18:09:01.995927] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-31T18:09:01.996135] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-31T18:09:02.053306] [DEBUG] [LOCAL ] CTRI: Trimmed 55689 records to 41963 (keeping 200 days of data) [2025-10-31T18:09:02.273082] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-31T18:09:02.292061] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-31T18:09:02.623078] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:02.658321] [DEBUG] [LOCAL ] CTRI: Primary data saved (41963 records). [2025-10-31T18:09:02.658471] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-31T18:09:02.658200] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-31T18:09:02.659349] [INFO ] [MAIN ] Update Progress: 553/2365 symbols completed. CTRI took 32.8s. Estimated remaining: 3h 45m 60s. Rate: 8.0 symbols/min [2025-10-31T18:09:02.845579] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:02.892093] [DEBUG] [LOCAL ] CUK: Loaded 51422 existing records from primary storage. [2025-10-31T18:09:02.892401] [INFO ] [MAIN ] CUK: Loaded 51422 existing records. [2025-10-31T18:09:03.074731] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:09:03.074991] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-31T18:09:03.075042] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-31T18:09:03.075827] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-31T18:09:03.075884] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-31T18:09:03.158301] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-31T18:09:03.433557] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:03.457620] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-31T18:09:04.257697] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-31T18:09:04.523407] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-31T18:09:04.822200] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T18:09:05.057665] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-31T18:09:05.857619] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-31T18:09:06.390367] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-31T18:09:06.657670] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-31T18:09:07.164788] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T18:09:07.457719] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-31T18:09:07.603482] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T18:09:08.257700] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-31T18:09:08.834317] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T18:09:09.057678] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-31T18:09:09.566170] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T18:09:09.857683] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-31T18:09:10.583826] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T18:09:10.606791] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T18:09:10.657611] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-31T18:09:11.457665] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-31T18:09:12.018379] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T18:09:12.257612] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-31T18:09:12.295302] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T18:09:13.057675] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-31T18:09:13.574711] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T18:09:13.857637] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-31T18:09:14.391150] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:09:14.657625] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-31T18:09:14.960744] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T18:09:15.457731] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-31T18:09:16.257618] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-31T18:09:16.313581] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-31T18:09:16.959830] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T18:09:17.042944] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-31T18:09:17.057609] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-31T18:09:17.857629] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-31T18:09:18.288545] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T18:09:18.657707] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-31T18:09:19.134235] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T18:09:19.457679] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-31T18:09:19.990288] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T18:09:20.257613] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-31T18:09:20.597438] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-31T18:09:21.057610] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-31T18:09:21.213633] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-31T18:09:21.225425] [INFO ] [REMOTE ] CTVA: Full fetch complete (76850 records). [2025-10-31T18:09:21.225554] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-31T18:09:21.226218] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:09:21.226305] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:09:21.226349] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:09:21.226387] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-31T18:09:21.226455] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-31T18:09:21.226513] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-31T18:09:21.226694] [DEBUG] [LOCAL ] CTVA: Deleted derivative data file. [2025-10-31T18:09:21.226782] [INFO ] [MAIN ] Update Progress: 554/2365 symbols completed. CTVA took 35.0s. Estimated remaining: 3h 46m 29s. Rate: 8.0 symbols/min [2025-10-31T18:09:21.393307] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:21.393474] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-31T18:09:21.393512] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-31T18:09:21.393619] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-31T18:09:21.393690] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-31T18:09:21.393748] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-31T18:09:21.393782] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-31T18:09:21.738360] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:21.857611] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-31T18:09:22.657719] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-31T18:09:22.712455] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T18:09:22.738447] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T18:09:22.737760] [INFO ] [REMOTE ] CUK: Full fetch complete (74442 records). [2025-10-31T18:09:22.743575] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-31T18:09:23.142283] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-31T18:09:23.145835] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-31T18:09:23.146405] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-31T18:09:23.147318] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-31T18:09:23.148853] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-31T18:09:23.150102] [DEBUG] [LOCAL ] CUK: Trimmed 74442 records to 51808 (keeping 200 days of data) [2025-10-31T18:09:23.441021] [DEBUG] [LOCAL ] CUK: Primary data saved (51808 records). [2025-10-31T18:09:23.441149] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-31T18:09:23.441224] [INFO ] [MAIN ] Update Progress: 555/2365 symbols completed. CUK took 20.8s. Estimated remaining: 3h 46m 4s. Rate: 8.0 symbols/min [2025-10-31T18:09:23.462733] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-31T18:09:23.615283] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:23.643674] [DEBUG] [LOCAL ] CURB: Loaded 32896 existing records from primary storage. [2025-10-31T18:09:23.643952] [INFO ] [MAIN ] CURB: Loaded 32896 existing records. [2025-10-31T18:09:23.836202] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:09:23.836410] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-31T18:09:23.836483] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-31T18:09:23.829080] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-31T18:09:23.838389] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-31T18:09:23.838467] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-31T18:09:24.187270] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:24.257692] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-31T18:09:25.057679] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-31T18:09:25.370634] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:09:25.857726] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-31T18:09:25.967310] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T18:09:26.201774] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-31T18:09:26.657627] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-31T18:09:27.018618] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-31T18:09:27.457708] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-31T18:09:27.873227] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-31T18:09:28.257626] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-31T18:09:28.567994] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-31T18:09:29.057737] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-31T18:09:29.259628] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-10-31T18:09:29.857674] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-31T18:09:30.657629] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-31T18:09:30.729152] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-31T18:09:31.199327] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-31T18:09:31.200121] [INFO ] [REMOTE ] CUBB: Full fetch complete (966 records). [2025-10-31T18:09:31.200187] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-31T18:09:31.200496] [FATAL] [VALIDATOR ] CUBB: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:09:31.200573] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:09:31.200616] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:09:31.200763] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-31T18:09:31.200879] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-31T18:09:31.200927] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-31T18:09:31.200968] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-31T18:09:31.201018] [INFO ] [MAIN ] Update Progress: 556/2365 symbols completed. CUBB took 41.6s. Estimated remaining: 3h 45m 57s. Rate: 8.0 symbols/min [2025-10-31T18:09:31.370217] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:31.394853] [DEBUG] [LOCAL ] CURV: Loaded 27730 existing records from primary storage. [2025-10-31T18:09:31.395101] [INFO ] [MAIN ] CURV: Loaded 27730 existing records. [2025-10-31T18:09:31.462834] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-31T18:09:31.574889] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:09:31.575122] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-31T18:09:31.575169] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-31T18:09:31.575631] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-31T18:09:31.575734] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-31T18:09:31.858046] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-31T18:09:31.929495] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:32.257663] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-31T18:09:32.598860] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-31T18:09:33.057628] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-31T18:09:33.582837] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-31T18:09:33.857686] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-31T18:09:34.645326] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T18:09:34.657606] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-31T18:09:35.457748] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-31T18:09:35.848471] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T18:09:35.849156] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-31T18:09:36.257640] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-31T18:09:36.732153] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-31T18:09:36.733519] [INFO ] [REMOTE ] CULP: Full fetch complete (4432 records). [2025-10-31T18:09:36.733591] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-31T18:09:37.060369] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-31T18:09:37.151291] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-31T18:09:37.151365] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-31T18:09:37.151533] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-31T18:09:37.151594] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-31T18:09:37.151995] [DEBUG] [LOCAL ] CULP: Trimmed 4432 records to 2825 (keeping 200 days of data) [2025-10-31T18:09:37.169484] [DEBUG] [LOCAL ] CULP: Primary data saved (2825 records). [2025-10-31T18:09:37.169569] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-31T18:09:37.169632] [INFO ] [MAIN ] Update Progress: 557/2365 symbols completed. CULP took 15.9s. Estimated remaining: 3h 45m 45s. Rate: 8.0 symbols/min [2025-10-31T18:09:37.857671] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-31T18:09:38.265392] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T18:09:38.657685] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-31T18:09:38.890168] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T18:09:39.457621] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-31T18:09:39.516418] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T18:09:40.257729] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-31T18:09:40.588967] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-31T18:09:40.595262] [INFO ] [REMOTE ] CUBI: Full fetch complete (39066 records). [2025-10-31T18:09:40.595387] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-31T18:09:40.962437] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-31T18:09:40.962516] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-31T18:09:40.963103] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-31T18:09:40.963162] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-31T18:09:40.963992] [DEBUG] [LOCAL ] CUBI: Trimmed 39066 records to 27104 (keeping 200 days of data) [2025-10-31T18:09:41.062917] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-31T18:09:41.138995] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T18:09:41.147258] [DEBUG] [LOCAL ] CUBI: Primary data saved (27104 records). [2025-10-31T18:09:41.147721] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-31T18:09:41.147817] [INFO ] [MAIN ] Update Progress: 558/2365 symbols completed. CUBI took 40.0s. Estimated remaining: 3h 45m 26s. Rate: 8.0 symbols/min [2025-10-31T18:09:41.857720] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-31T18:09:41.875302] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T18:09:42.644433] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-31T18:09:42.657611] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-31T18:09:43.457747] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-31T18:09:43.577758] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-31T18:09:44.257609] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-31T18:09:44.292393] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-31T18:09:45.057698] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-31T18:09:45.369086] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T18:09:45.857739] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-31T18:09:45.909807] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-31T18:09:46.657715] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-31T18:09:46.929589] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T18:09:47.420504] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-31T18:09:47.457624] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-31T18:09:48.225932] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-31T18:09:48.257710] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-31T18:09:49.057752] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-31T18:09:49.448860] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T18:09:49.457437] [INFO ] [REMOTE ] CURB: Full fetch complete (47741 records). [2025-10-31T18:09:49.457564] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-31T18:09:49.824330] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-31T18:09:49.824407] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-31T18:09:49.825047] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-31T18:09:49.825110] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-31T18:09:49.826092] [DEBUG] [LOCAL ] CURB: Trimmed 47741 records to 33160 (keeping 200 days of data) [2025-10-31T18:09:50.028238] [DEBUG] [LOCAL ] CURB: Primary data saved (33160 records). [2025-10-31T18:09:50.028536] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-31T18:09:50.028737] [INFO ] [MAIN ] Update Progress: 559/2365 symbols completed. CURB took 26.6s. Estimated remaining: 3h 45m 23s. Rate: 8.0 symbols/min [2025-10-31T18:09:50.095156] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T18:09:50.102804] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-31T18:09:51.094889] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T18:09:51.101213] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-31T18:09:52.124698] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T18:09:52.132118] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-31T18:09:53.175925] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T18:09:53.183885] [INFO ] [REMOTE ] CURV: Full fetch complete (39164 records). [2025-10-31T18:09:53.184026] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-31T18:09:53.568065] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-31T18:09:53.568145] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-31T18:09:53.568734] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-31T18:09:53.568796] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-31T18:09:53.569620] [DEBUG] [LOCAL ] CURV: Trimmed 39164 records to 27958 (keeping 200 days of data) [2025-10-31T18:09:53.720009] [DEBUG] [LOCAL ] CURV: Primary data saved (27958 records). [2025-10-31T18:09:53.720141] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-31T18:09:53.720220] [INFO ] [MAIN ] Update Progress: 560/2365 symbols completed. CURV took 22.5s. Estimated remaining: 3h 45m 3s. Rate: 8.0 symbols/min [2025-10-31T18:09:54.415504] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:54.418355] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:54.440765] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:54.504386] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:09:54.517980] [DEBUG] [LOCAL ] CVEO: Loaded 15133 existing records from primary storage. [2025-10-31T18:09:54.518403] [INFO ] [MAIN ] CVEO: Loaded 15133 existing records. [2025-10-31T18:09:54.678120] [DEBUG] [LOCAL ] CVI: Loaded 46799 existing records from primary storage. [2025-10-31T18:09:54.740626] [INFO ] [MAIN ] CVI: Loaded 46799 existing records. [2025-10-31T18:09:54.740096] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:09:54.763470] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-31T18:09:54.801188] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-31T18:09:54.866790] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-31T18:09:54.886347] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-31T18:09:54.916575] [DEBUG] [LOCAL ] CUZ: Loaded 49667 existing records from primary storage. [2025-10-31T18:09:55.029698] [INFO ] [MAIN ] CUZ: Loaded 49667 existing records. [2025-10-31T18:09:55.048874] [DEBUG] [LOCAL ] CVE: Loaded 53948 existing records from primary storage. [2025-10-31T18:09:55.111743] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:09:55.161903] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-31T18:09:55.172418] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-31T18:09:55.177722] [INFO ] [MAIN ] CVE: Loaded 53948 existing records. [2025-10-31T18:09:55.214839] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-31T18:09:55.255066] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-31T18:09:55.601171] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:09:55.650414] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-31T18:09:55.693550] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-31T18:09:55.855842] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-31T18:09:55.861283] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:09:55.861551] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-31T18:09:55.861733] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-31T18:09:55.881637] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-31T18:09:56.070869] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-31T18:09:56.110710] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:56.141912] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-31T18:09:56.110856] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-31T18:09:56.444068] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:56.456675] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-31T18:09:56.806414] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:56.827328] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-31T18:09:56.886554] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-31T18:09:56.886298] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:09:56.889016] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-31T18:09:56.889318] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-31T18:09:57.418596] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T18:09:57.421666] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-31T18:09:57.748873] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T18:09:57.757784] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-31T18:09:57.989794] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T18:09:57.994985] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-31T18:09:58.420081] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-31T18:09:58.458775] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-31T18:09:58.595860] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-31T18:09:58.657604] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-31T18:09:58.872924] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T18:09:59.340928] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T18:09:59.457688] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-31T18:10:00.136070] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T18:10:00.257624] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-31T18:10:01.057667] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-31T18:10:01.719706] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T18:10:01.857619] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-31T18:10:01.943101] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-31T18:10:02.657710] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-31T18:10:03.063787] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T18:10:03.315779] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T18:10:03.457668] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-31T18:10:04.044526] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-31T18:10:04.257700] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-31T18:10:05.061800] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-31T18:10:05.065465] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T18:10:05.069880] [INFO ] [REMOTE ] CVEO: Full fetch complete (21225 records). [2025-10-31T18:10:05.069988] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-31T18:10:05.480314] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-31T18:10:05.480402] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-31T18:10:05.480889] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-31T18:10:05.480950] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-31T18:10:05.481565] [DEBUG] [LOCAL ] CVEO: Trimmed 21225 records to 15355 (keeping 200 days of data) [2025-10-31T18:10:05.569602] [DEBUG] [LOCAL ] CVEO: Primary data saved (15355 records). [2025-10-31T18:10:05.569750] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-31T18:10:05.569833] [INFO ] [MAIN ] Update Progress: 561/2365 symbols completed. CVEO took 11.8s. Estimated remaining: 3h 45m 10s. Rate: 8.0 symbols/min [2025-10-31T18:10:05.744828] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:10:05.759442] [DEBUG] [LOCAL ] CVLG: Loaded 15290 existing records from primary storage. [2025-10-31T18:10:05.759697] [INFO ] [MAIN ] CVLG: Loaded 15290 existing records. [2025-10-31T18:10:05.862734] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-31T18:10:05.947046] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:10:05.947280] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-31T18:10:05.947346] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-31T18:10:05.947754] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-31T18:10:05.947830] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-31T18:10:06.338720] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:10:06.659717] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-31T18:10:06.665192] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-31T18:10:07.152979] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T18:10:07.457636] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-31T18:10:07.537885] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-31T18:10:08.257705] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-31T18:10:08.785879] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T18:10:09.057706] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-31T18:10:09.540234] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T18:10:09.646985] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T18:10:09.857685] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-31T18:10:10.657689] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-31T18:10:11.041020] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T18:10:11.457632] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-31T18:10:12.048234] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T18:10:12.257695] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-31T18:10:12.827702] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T18:10:13.057686] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-31T18:10:13.687539] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-31T18:10:13.698430] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-31T18:10:13.857639] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-31T18:10:14.657677] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-31T18:10:15.069611] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T18:10:15.457609] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-31T18:10:15.498558] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-31T18:10:16.257668] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-31T18:10:17.057677] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-31T18:10:17.653809] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-31T18:10:17.810573] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-31T18:10:17.857608] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-31T18:10:18.414276] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T18:10:18.657677] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-31T18:10:19.365574] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-31T18:10:19.457689] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-31T18:10:20.136500] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T18:10:20.257680] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-31T18:10:20.315368] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-31T18:10:21.057680] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-31T18:10:21.789901] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T18:10:21.857618] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-31T18:10:21.899464] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-31T18:10:22.657711] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-31T18:10:23.066020] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T18:10:23.457727] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-31T18:10:23.912573] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T18:10:24.257668] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-31T18:10:24.765196] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T18:10:24.834821] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T18:10:24.848087] [INFO ] [REMOTE ] CVE: Full fetch complete (77711 records). [2025-10-31T18:10:24.848263] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-31T18:10:25.062926] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-31T18:10:25.262795] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-31T18:10:25.262890] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-31T18:10:25.263840] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-31T18:10:25.263909] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-31T18:10:25.265433] [DEBUG] [LOCAL ] CVE: Trimmed 77711 records to 54338 (keeping 200 days of data) [2025-10-31T18:10:25.601219] [DEBUG] [LOCAL ] CVE: Primary data saved (54338 records). [2025-10-31T18:10:25.601371] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-31T18:10:25.601458] [INFO ] [MAIN ] Update Progress: 562/2365 symbols completed. CVE took 31.9s. Estimated remaining: 3h 45m 43s. Rate: 8.0 symbols/min [2025-10-31T18:10:25.772240] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:10:25.820244] [DEBUG] [LOCAL ] CVNA: Loaded 53193 existing records from primary storage. [2025-10-31T18:10:25.820539] [INFO ] [MAIN ] CVNA: Loaded 53193 existing records. [2025-10-31T18:10:25.864556] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-31T18:10:26.003842] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:10:26.004047] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-31T18:10:26.004122] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-31T18:10:26.005252] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-31T18:10:26.005314] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-31T18:10:26.366074] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:10:26.515639] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T18:10:26.657640] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-31T18:10:27.107179] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T18:10:27.457670] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-31T18:10:27.847318] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T18:10:28.257748] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-31T18:10:28.755727] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T18:10:28.766292] [INFO ] [REMOTE ] CVI: Full fetch complete (66834 records). [2025-10-31T18:10:28.766467] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-31T18:10:28.767202] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:10:28.767288] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:10:28.767334] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:10:28.767428] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-31T18:10:28.767518] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-31T18:10:28.767564] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-31T18:10:28.767761] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-31T18:10:28.767883] [INFO ] [MAIN ] Update Progress: 563/2365 symbols completed. CVI took 35.0s. Estimated remaining: 3h 45m 21s. Rate: 8.0 symbols/min [2025-10-31T18:10:28.935348] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:10:28.982465] [DEBUG] [LOCAL ] CVS: Loaded 54084 existing records from primary storage. [2025-10-31T18:10:28.982817] [INFO ] [MAIN ] CVS: Loaded 54084 existing records. [2025-10-31T18:10:29.062768] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-31T18:10:29.175998] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:10:29.176219] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-31T18:10:29.176267] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-31T18:10:29.177389] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-31T18:10:29.177446] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-31T18:10:29.528842] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:10:29.857618] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-31T18:10:30.028175] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-31T18:10:30.537837] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T18:10:30.558293] [INFO ] [REMOTE ] CUZ: Full fetch complete (70893 records). [2025-10-31T18:10:30.559367] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T18:10:30.559019] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-31T18:10:30.662714] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-31T18:10:31.012186] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-31T18:10:31.012285] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-31T18:10:31.013193] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-31T18:10:31.013258] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-31T18:10:31.014682] [DEBUG] [LOCAL ] CUZ: Trimmed 70893 records to 50056 (keeping 200 days of data) [2025-10-31T18:10:31.261039] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-31T18:10:31.358995] [DEBUG] [LOCAL ] CUZ: Primary data saved (50056 records). [2025-10-31T18:10:31.359124] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-31T18:10:31.359203] [INFO ] [MAIN ] Update Progress: 564/2365 symbols completed. CUZ took 37.6s. Estimated remaining: 3h 44m 58s. Rate: 8.0 symbols/min [2025-10-31T18:10:31.462754] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-31T18:10:31.566663] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:10:31.617679] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-31T18:10:31.618035] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-10-31T18:10:31.816767] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:10:31.816967] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-31T18:10:31.817012] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-31T18:10:31.818007] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-31T18:10:31.818067] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-31T18:10:32.162537] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:10:32.257732] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-31T18:10:33.057687] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-31T18:10:33.096202] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-31T18:10:33.862780] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-31T18:10:33.868394] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-31T18:10:34.612542] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T18:10:34.657637] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-31T18:10:34.729883] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-31T18:10:35.457720] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-31T18:10:36.177122] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-31T18:10:36.212083] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T18:10:36.215696] [INFO ] [REMOTE ] CVLG: Full fetch complete (21434 records). [2025-10-31T18:10:36.215783] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-31T18:10:36.262793] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-31T18:10:36.593500] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-31T18:10:36.593573] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-31T18:10:36.593996] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-31T18:10:36.594056] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-31T18:10:36.594685] [DEBUG] [LOCAL ] CVLG: Trimmed 21434 records to 15372 (keeping 200 days of data) [2025-10-31T18:10:36.697610] [DEBUG] [LOCAL ] CVLG: Primary data saved (15372 records). [2025-10-31T18:10:36.697779] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-31T18:10:36.697889] [INFO ] [MAIN ] Update Progress: 565/2365 symbols completed. CVLG took 31.1s. Estimated remaining: 3h 44m 44s. Rate: 8.0 symbols/min [2025-10-31T18:10:36.864043] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:10:36.882884] [DEBUG] [LOCAL ] CW: Loaded 21892 existing records from primary storage. [2025-10-31T18:10:36.883095] [INFO ] [MAIN ] CW: Loaded 21892 existing records. [2025-10-31T18:10:37.057985] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:10:37.058304] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-31T18:10:37.058113] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-31T18:10:37.058666] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-31T18:10:37.060024] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-31T18:10:37.060120] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-31T18:10:37.406495] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:10:37.857674] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-31T18:10:37.952575] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-31T18:10:38.611135] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-31T18:10:38.657606] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-31T18:10:38.884561] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T18:10:39.457674] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-31T18:10:40.257636] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-31T18:10:40.296159] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T18:10:40.366831] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T18:10:41.057671] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-31T18:10:41.857618] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-31T18:10:41.937942] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-31T18:10:42.646226] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-31T18:10:42.657610] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-31T18:10:42.743859] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-31T18:10:43.420388] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T18:10:43.457612] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-31T18:10:44.257701] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-31T18:10:45.057673] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-31T18:10:45.244339] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-31T18:10:45.618161] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:10:45.857665] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-31T18:10:45.932421] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-31T18:10:46.657710] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-31T18:10:47.457700] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-31T18:10:47.690037] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-31T18:10:48.235990] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-31T18:10:48.257616] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-31T18:10:49.031576] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-31T18:10:49.057613] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-31T18:10:49.594123] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T18:10:49.857669] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-31T18:10:50.657633] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-31T18:10:50.802788] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-31T18:10:51.457616] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-31T18:10:51.538443] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T18:10:51.949455] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-31T18:10:52.257709] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-31T18:10:52.992773] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T18:10:53.057697] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-31T18:10:53.857742] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-31T18:10:54.091767] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-31T18:10:54.647544] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-31T18:10:54.657596] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-31T18:10:54.879808] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-31T18:10:55.345771] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-31T18:10:55.457638] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-31T18:10:56.257688] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-31T18:10:56.301548] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-31T18:10:56.309976] [INFO ] [REMOTE ] CW: Full fetch complete (33112 records). [2025-10-31T18:10:56.310197] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-31T18:10:56.849955] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-31T18:10:56.850053] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-31T18:10:56.850629] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-31T18:10:56.850728] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-31T18:10:56.851908] [DEBUG] [LOCAL ] CW: Trimmed 33112 records to 22103 (keeping 200 days of data) [2025-10-31T18:10:57.005179] [DEBUG] [LOCAL ] CW: Primary data saved (22103 records). [2025-10-31T18:10:57.005351] [INFO ] [MAIN ] CW: Full history saved. [2025-10-31T18:10:57.005474] [INFO ] [MAIN ] Update Progress: 566/2365 symbols completed. CW took 20.3s. Estimated remaining: 3h 45m 17s. Rate: 8.0 symbols/min [2025-10-31T18:10:57.062850] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-31T18:10:57.176618] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:10:57.224833] [DEBUG] [LOCAL ] CWAN: Loaded 53049 existing records from primary storage. [2025-10-31T18:10:57.225129] [INFO ] [MAIN ] CWAN: Loaded 53049 existing records. [2025-10-31T18:10:57.400124] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:10:57.400323] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-31T18:10:57.400370] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-31T18:10:57.400676] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-31T18:10:57.400734] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-31T18:10:57.774605] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:10:57.805188] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-31T18:10:57.857618] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-31T18:10:58.662937] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-31T18:10:58.676908] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-31T18:10:59.369589] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T18:10:59.457625] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-31T18:11:00.062023] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T18:11:00.075758] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-31T18:11:00.075949] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-31T18:11:00.264049] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-31T18:11:00.505118] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-31T18:11:00.505279] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-31T18:11:00.506272] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-31T18:11:00.506387] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-31T18:11:00.508030] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 54474 (keeping 200 days of data) [2025-10-31T18:11:00.645858] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-31T18:11:00.903982] [DEBUG] [LOCAL ] CVS: Primary data saved (54474 records). [2025-10-31T18:11:00.904113] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-31T18:11:00.905086] [INFO ] [MAIN ] Update Progress: 567/2365 symbols completed. CVS took 32.1s. Estimated remaining: 3h 44m 58s. Rate: 8.0 symbols/min [2025-10-31T18:11:01.074375] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-31T18:11:01.100051] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:01.144101] [DEBUG] [LOCAL ] CWEN: Loaded 45419 existing records from primary storage. [2025-10-31T18:11:01.144414] [INFO ] [MAIN ] CWEN: Loaded 45419 existing records. [2025-10-31T18:11:01.323576] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:11:01.323787] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-31T18:11:01.323833] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-31T18:11:01.324505] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-31T18:11:01.324562] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-31T18:11:01.674090] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:11:01.797372] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-31T18:11:01.857629] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-31T18:11:02.420118] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T18:11:02.657686] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-31T18:11:02.711624] [DEBUG] [REMOTE ] CWAN: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-31T18:11:02.711989] [WARN ] [REMOTE ] CWAN: No data returned for month 2025-02 [2025-10-31T18:11:02.712085] [FATAL] [REMOTE ] CWAN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:11:02.712170] [FATAL] [MAIN ] CWAN: Failed to fetch primary data. [2025-10-31T18:11:02.712242] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:11:02.712330] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-31T18:11:02.712414] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-31T18:11:02.712462] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-10-31T18:11:02.712737] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-10-31T18:11:02.712842] [INFO ] [MAIN ] Update Progress: 568/2365 symbols completed. CWAN took 5.7s. Estimated remaining: 3h 44m 32s. Rate: 8.0 symbols/min [2025-10-31T18:11:02.884350] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:02.884537] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-31T18:11:02.884573] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-31T18:11:02.884725] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-31T18:11:02.884794] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-31T18:11:02.884896] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-31T18:11:02.884947] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-31T18:11:03.244198] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:11:03.457700] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-31T18:11:03.660311] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-31T18:11:04.257679] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-31T18:11:04.710782] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T18:11:05.057683] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-31T18:11:05.857638] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-31T18:11:06.161239] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-31T18:11:06.175780] [INFO ] [REMOTE ] CVNA: Full fetch complete (76711 records). [2025-10-31T18:11:06.176026] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-31T18:11:06.313487] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:11:06.667900] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-31T18:11:06.696508] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-31T18:11:06.696611] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-31T18:11:06.697622] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-31T18:11:06.697711] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-31T18:11:06.699396] [DEBUG] [LOCAL ] CVNA: Trimmed 76711 records to 53581 (keeping 200 days of data) [2025-10-31T18:11:07.024536] [DEBUG] [LOCAL ] CVNA: Primary data saved (53581 records). [2025-10-31T18:11:07.024824] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-31T18:11:07.025948] [INFO ] [MAIN ] Update Progress: 569/2365 symbols completed. CVNA took 41.4s. Estimated remaining: 3h 44m 15s. Rate: 8.0 symbols/min [2025-10-31T18:11:07.122191] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T18:11:07.234322] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:07.300060] [DEBUG] [LOCAL ] CWK: Loaded 49967 existing records from primary storage. [2025-10-31T18:11:07.300398] [INFO ] [MAIN ] CWK: Loaded 49967 existing records. [2025-10-31T18:11:07.463775] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-31T18:11:07.473962] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:11:07.475194] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-31T18:11:07.475245] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-31T18:11:07.475515] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-31T18:11:07.475553] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-31T18:11:07.832365] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:11:07.855901] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T18:11:08.257699] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-31T18:11:08.928221] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T18:11:09.057684] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-31T18:11:09.440541] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T18:11:09.857696] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-31T18:11:10.282434] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T18:11:10.657664] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-31T18:11:11.385261] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T18:11:11.457620] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-31T18:11:12.257693] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-31T18:11:12.778807] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-31T18:11:13.057639] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-31T18:11:13.117269] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-31T18:11:13.706148] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T18:11:13.718922] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-31T18:11:13.719086] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-31T18:11:13.860041] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-31T18:11:13.950562] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-31T18:11:14.155305] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-31T18:11:14.155380] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-31T18:11:14.156259] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-31T18:11:14.156321] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-31T18:11:14.157742] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 54540 (keeping 200 days of data) [2025-10-31T18:11:14.490578] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-10-31T18:11:14.490738] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-31T18:11:14.490822] [INFO ] [MAIN ] Update Progress: 570/2365 symbols completed. CVX took 43.1s. Estimated remaining: 3h 44m 7s. Rate: 8.0 symbols/min [2025-10-31T18:11:14.669222] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-31T18:11:14.672753] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:14.673601] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-31T18:11:14.673691] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-31T18:11:14.673802] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-31T18:11:14.673846] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-31T18:11:14.673890] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-31T18:11:14.673924] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-31T18:11:15.050762] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:11:15.192899] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:11:15.457686] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-31T18:11:15.863685] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T18:11:16.257684] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-31T18:11:16.673224] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T18:11:17.057699] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-31T18:11:17.316260] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T18:11:17.857682] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-31T18:11:18.277394] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T18:11:18.657668] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-31T18:11:19.023879] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T18:11:19.457674] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-31T18:11:20.033576] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T18:11:20.257683] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-31T18:11:20.618722] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T18:11:21.057677] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-31T18:11:21.455453] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T18:11:21.857695] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-31T18:11:22.204206] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T18:11:22.657671] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-31T18:11:23.039315] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T18:11:23.457682] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-31T18:11:23.577420] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T18:11:24.257720] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-31T18:11:24.634226] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T18:11:25.057677] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-31T18:11:25.453335] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T18:11:25.857711] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-31T18:11:25.938522] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T18:11:26.657675] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-31T18:11:26.965342] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T18:11:27.457672] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-31T18:11:27.823783] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T18:11:28.257680] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-31T18:11:28.805837] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T18:11:29.057625] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-31T18:11:29.156609] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-31T18:11:29.857695] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-31T18:11:30.402936] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-31T18:11:30.414378] [INFO ] [REMOTE ] CWH: Full fetch complete (73366 records). [2025-10-31T18:11:30.414507] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-31T18:11:30.663354] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-31T18:11:30.816075] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-31T18:11:30.816140] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-31T18:11:30.817420] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-31T18:11:30.817498] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-31T18:11:30.819135] [DEBUG] [LOCAL ] CWH: Trimmed 73366 records to 51988 (keeping 200 days of data) [2025-10-31T18:11:31.157551] [DEBUG] [LOCAL ] CWH: Primary data saved (51988 records). [2025-10-31T18:11:31.157884] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-31T18:11:31.158051] [INFO ] [MAIN ] Update Progress: 571/2365 symbols completed. CWH took 28.4s. Estimated remaining: 3h 44m 29s. Rate: 8.0 symbols/min [2025-10-31T18:11:31.292868] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T18:11:31.371881] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:31.415694] [DEBUG] [LOCAL ] CX: Loaded 53144 existing records from primary storage. [2025-10-31T18:11:31.415996] [INFO ] [MAIN ] CX: Loaded 53144 existing records. [2025-10-31T18:11:31.470960] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-31T18:11:31.599718] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:11:31.600148] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-31T18:11:31.600306] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-31T18:11:31.606359] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-31T18:11:31.615921] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-31T18:11:31.682420] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-31T18:11:31.973736] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:11:32.257720] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-31T18:11:33.057668] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-31T18:11:33.302784] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-31T18:11:33.314484] [INFO ] [REMOTE ] CWEN: Full fetch complete (65863 records). [2025-10-31T18:11:33.314630] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-31T18:11:33.748745] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-31T18:11:33.748863] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-31T18:11:33.749900] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-31T18:11:33.750352] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-31T18:11:33.751893] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-31T18:11:33.763234] [DEBUG] [LOCAL ] CWEN: Trimmed 65863 records to 45776 (keeping 200 days of data) [2025-10-31T18:11:33.857786] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-31T18:11:34.046871] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-31T18:11:34.062185] [DEBUG] [LOCAL ] CWEN: Primary data saved (45776 records). [2025-10-31T18:11:34.062271] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-31T18:11:34.063095] [INFO ] [MAIN ] Update Progress: 572/2365 symbols completed. CWEN took 33.2s. Estimated remaining: 3h 44m 7s. Rate: 8.0 symbols/min [2025-10-31T18:11:34.227308] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:34.235187] [DEBUG] [LOCAL ] CXE: Loaded 6405 existing records from primary storage. [2025-10-31T18:11:34.235387] [INFO ] [MAIN ] CXE: Loaded 6405 existing records. [2025-10-31T18:11:34.408870] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:11:34.409036] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-31T18:11:34.409083] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-31T18:11:34.409235] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-31T18:11:34.409273] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-31T18:11:34.662972] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-31T18:11:34.765709] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:11:35.064451] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T18:11:35.457731] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-31T18:11:35.926892] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T18:11:36.061464] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-31T18:11:36.257682] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-31T18:11:37.057628] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-31T18:11:37.497584] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T18:11:37.857708] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-31T18:11:38.045910] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T18:11:38.657712] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-31T18:11:39.457717] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-31T18:11:39.677560] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-31T18:11:39.884120] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T18:11:40.031170] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T18:11:40.257684] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-31T18:11:41.057671] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-31T18:11:41.218628] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T18:11:41.857693] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-31T18:11:42.288036] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T18:11:42.657693] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-31T18:11:43.390692] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-31T18:11:43.402812] [INFO ] [REMOTE ] CWK: Full fetch complete (71516 records). [2025-10-31T18:11:43.402979] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-31T18:11:43.467328] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-31T18:11:43.943070] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-31T18:11:43.943182] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-31T18:11:43.944294] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-31T18:11:43.944473] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-31T18:11:43.964744] [DEBUG] [LOCAL ] CWK: Trimmed 71516 records to 50347 (keeping 200 days of data) [2025-10-31T18:11:43.979994] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T18:11:44.078945] [INFO ] [REMOTE ] CWT: Full fetch complete (41424 records). [2025-10-31T18:11:44.093465] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-31T18:11:44.104941] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-31T18:11:44.260999] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-31T18:11:44.594112] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-31T18:11:44.594250] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-31T18:11:44.595081] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-31T18:11:44.650740] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-31T18:11:44.685032] [DEBUG] [LOCAL ] CWT: Trimmed 41424 records to 28175 (keeping 200 days of data) [2025-10-31T18:11:44.791057] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T18:11:44.950006] [DEBUG] [LOCAL ] CWK: Primary data saved (50347 records). [2025-10-31T18:11:44.953078] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-31T18:11:44.954915] [INFO ] [MAIN ] Update Progress: 573/2365 symbols completed. CWK took 37.9s. Estimated remaining: 3h 44m 10s. Rate: 8.0 symbols/min [2025-10-31T18:11:45.030215] [DEBUG] [LOCAL ] CWT: Primary data saved (28175 records). [2025-10-31T18:11:45.048684] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-31T18:11:45.060624] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-31T18:11:45.072081] [INFO ] [MAIN ] Update Progress: 574/2365 symbols completed. CWT took 30.6s. Estimated remaining: 3h 43m 39s. Rate: 8.0 symbols/min [2025-10-31T18:11:45.288555] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:45.366319] [DEBUG] [LOCAL ] CXH: Loaded 4344 existing records from primary storage. [2025-10-31T18:11:45.381339] [INFO ] [MAIN ] CXH: Loaded 4344 existing records. [2025-10-31T18:11:45.418096] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:45.570053] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:11:45.570294] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-31T18:11:45.570358] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-31T18:11:45.570624] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-31T18:11:45.570731] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-31T18:11:45.757447] [DEBUG] [LOCAL ] CXM: Loaded 47319 existing records from primary storage. [2025-10-31T18:11:45.774776] [INFO ] [MAIN ] CXM: Loaded 47319 existing records. [2025-10-31T18:11:45.865005] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-31T18:11:46.084582] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:11:46.159460] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:11:46.159692] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-31T18:11:46.159751] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-31T18:11:46.160437] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-31T18:11:46.160495] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-31T18:11:46.563501] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T18:11:46.595372] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:11:46.597734] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-31T18:11:46.657610] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-31T18:11:47.457688] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-31T18:11:47.981086] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T18:11:48.257720] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-31T18:11:48.565838] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:11:49.057678] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-31T18:11:49.584099] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T18:11:49.857635] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-31T18:11:49.950277] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-31T18:11:50.657690] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-31T18:11:51.067870] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T18:11:51.169357] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T18:11:51.457674] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-31T18:11:51.764604] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T18:11:52.257677] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-31T18:11:52.680625] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-31T18:11:53.057689] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-31T18:11:53.857690] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-31T18:11:54.147739] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-31T18:11:54.231219] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T18:11:54.657633] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-31T18:11:55.054588] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-31T18:11:55.457692] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-31T18:11:56.257734] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-31T18:11:56.883290] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T18:11:56.959937] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-31T18:11:57.057618] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-31T18:11:57.857718] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-31T18:11:58.592699] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-31T18:11:58.604791] [INFO ] [REMOTE ] CX: Full fetch complete (76541 records). [2025-10-31T18:11:58.604948] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-31T18:11:58.668010] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-31T18:11:58.998014] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-31T18:11:58.998202] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-31T18:11:58.999171] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-31T18:11:58.999253] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-31T18:11:59.015411] [DEBUG] [LOCAL ] CX: Trimmed 76541 records to 53523 (keeping 200 days of data) [2025-10-31T18:11:59.029545] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T18:11:59.125822] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T18:11:59.355044] [DEBUG] [LOCAL ] CX: Primary data saved (53523 records). [2025-10-31T18:11:59.355224] [INFO ] [MAIN ] CX: Full history saved. [2025-10-31T18:11:59.355307] [INFO ] [MAIN ] Update Progress: 575/2365 symbols completed. CX took 28.2s. Estimated remaining: 3h 43m 53s. Rate: 8.0 symbols/min [2025-10-31T18:11:59.462875] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-31T18:11:59.524104] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:11:59.553352] [DEBUG] [LOCAL ] CXT: Loaded 30508 existing records from primary storage. [2025-10-31T18:11:59.553609] [INFO ] [MAIN ] CXT: Loaded 30508 existing records. [2025-10-31T18:11:59.727666] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:11:59.727919] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-31T18:11:59.727972] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-31T18:11:59.728168] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-31T18:11:59.728222] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-31T18:11:59.943352] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-31T18:12:00.090221] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:12:00.257638] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-31T18:12:01.057678] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-31T18:12:01.722717] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T18:12:01.857666] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-31T18:12:02.160671] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-31T18:12:02.657765] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-31T18:12:03.028447] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T18:12:03.432913] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T18:12:03.434873] [INFO ] [REMOTE ] CXE: Full fetch complete (10969 records). [2025-10-31T18:12:03.434942] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-31T18:12:03.435290] [FATAL] [VALIDATOR ] CXE: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:12:03.435369] [FATAL] [MAIN ] CXE: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:12:03.435412] [WARN ] [MAIN ] CXE: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:12:03.435449] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-31T18:12:03.435503] [DEBUG] [LOCAL ] CXE: No primary data file found to delete. [2025-10-31T18:12:03.435538] [INFO ] [LOCAL ] CXE: Starting deletion of derivative data. [2025-10-31T18:12:03.435725] [DEBUG] [LOCAL ] CXE: Deleted derivative data file. [2025-10-31T18:12:03.435808] [INFO ] [MAIN ] Update Progress: 576/2365 symbols completed. CXE took 29.4s. Estimated remaining: 3h 43m 35s. Rate: 8.0 symbols/min [2025-10-31T18:12:03.464792] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-31T18:12:03.604605] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:12:03.644460] [DEBUG] [LOCAL ] CXW: Loaded 43763 existing records from primary storage. [2025-10-31T18:12:03.644751] [INFO ] [MAIN ] CXW: Loaded 43763 existing records. [2025-10-31T18:12:03.818459] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:12:03.818665] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-31T18:12:03.818724] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-31T18:12:03.819328] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-31T18:12:03.819384] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-31T18:12:04.155535] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-31T18:12:04.185520] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:12:04.257607] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-31T18:12:05.057720] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-31T18:12:05.701607] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T18:12:05.857620] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-31T18:12:05.985618] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T18:12:06.657681] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-31T18:12:07.058841] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T18:12:07.457622] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-31T18:12:07.615317] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T18:12:07.754979] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-31T18:12:08.257673] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-31T18:12:09.057687] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-31T18:12:09.471532] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T18:12:09.857679] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-31T18:12:10.177844] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T18:12:10.657684] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-31T18:12:10.897336] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T18:12:11.077176] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T18:12:11.457638] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-31T18:12:12.257678] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-31T18:12:12.459252] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T18:12:13.057634] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-31T18:12:13.432546] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T18:12:13.573171] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-31T18:12:13.574164] [INFO ] [REMOTE ] CXH: Full fetch complete (5301 records). [2025-10-31T18:12:13.574231] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-31T18:12:13.862776] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-31T18:12:13.955926] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-31T18:12:13.956012] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-31T18:12:13.956198] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-31T18:12:13.956239] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-31T18:12:13.956671] [DEBUG] [LOCAL ] CXH: Trimmed 5301 records to 4362 (keeping 200 days of data) [2025-10-31T18:12:13.982739] [DEBUG] [LOCAL ] CXH: Primary data saved (4362 records). [2025-10-31T18:12:13.982883] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-31T18:12:13.982965] [INFO ] [MAIN ] Update Progress: 577/2365 symbols completed. CXH took 29.0s. Estimated remaining: 3h 43m 37s. Rate: 8.0 symbols/min [2025-10-31T18:12:14.154277] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:12:14.182376] [DEBUG] [LOCAL ] CYD: Loaded 27034 existing records from primary storage. [2025-10-31T18:12:14.182666] [INFO ] [MAIN ] CYD: Loaded 27034 existing records. [2025-10-31T18:12:14.361750] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:12:14.362058] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-31T18:12:14.362117] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-31T18:12:14.363260] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-31T18:12:14.363319] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-31T18:12:14.662976] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-31T18:12:14.715633] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:12:15.096604] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T18:12:15.457695] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-31T18:12:15.601063] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T18:12:16.257679] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-31T18:12:16.726790] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T18:12:16.806584] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-31T18:12:17.057674] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-31T18:12:17.857684] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-31T18:12:18.348587] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T18:12:18.619733] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T18:12:18.657666] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-31T18:12:19.457748] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-31T18:12:20.066579] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T18:12:20.258033] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-31T18:12:20.460195] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T18:12:21.057674] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-31T18:12:21.385322] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T18:12:21.857627] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-31T18:12:21.903457] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-31T18:12:22.657677] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-31T18:12:23.181074] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T18:12:23.457680] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-31T18:12:23.970357] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-31T18:12:23.980833] [INFO ] [REMOTE ] CXM: Full fetch complete (68325 records). [2025-10-31T18:12:23.981017] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-31T18:12:24.264993] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-31T18:12:24.429417] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-31T18:12:24.429502] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-31T18:12:24.430290] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-31T18:12:24.430352] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-31T18:12:24.431565] [DEBUG] [LOCAL ] CXM: Trimmed 68325 records to 47633 (keeping 200 days of data) [2025-10-31T18:12:24.696200] [DEBUG] [LOCAL ] CXM: Primary data saved (47633 records). [2025-10-31T18:12:24.696469] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-31T18:12:24.696633] [INFO ] [MAIN ] Update Progress: 578/2365 symbols completed. CXM took 39.6s. Estimated remaining: 3h 43m 39s. Rate: 8.0 symbols/min [2025-10-31T18:12:24.870000] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:12:24.870343] [DEBUG] [LOCAL ] CYH: No existing data file found in primary storage. [2025-10-31T18:12:24.870400] [WARN ] [MAIN ] CYH: No existing data found, performing full refresh instead. [2025-10-31T18:12:24.870539] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-31T18:12:24.894102] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-31T18:12:24.894738] [DEBUG] [LOCAL ] CYH: No primary data file found to delete. [2025-10-31T18:12:24.895636] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-31T18:12:24.895583] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-31T18:12:25.062818] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-31T18:12:25.281805] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:12:25.427926] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T18:12:25.857745] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-31T18:12:26.332001] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T18:12:26.643984] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T18:12:26.657710] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-31T18:12:27.457735] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-31T18:12:28.086499] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-31T18:12:28.097236] [INFO ] [REMOTE ] CXW: Full fetch complete (64777 records). [2025-10-31T18:12:28.097451] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-31T18:12:28.271050] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-31T18:12:28.561138] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T18:12:28.588510] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-31T18:12:28.588633] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-31T18:12:28.589994] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-31T18:12:28.590068] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-31T18:12:28.591942] [DEBUG] [LOCAL ] CXW: Trimmed 64777 records to 44078 (keeping 200 days of data) [2025-10-31T18:12:28.843635] [DEBUG] [LOCAL ] CXW: Primary data saved (44078 records). [2025-10-31T18:12:28.843799] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-31T18:12:28.844804] [INFO ] [MAIN ] Update Progress: 579/2365 symbols completed. CXW took 25.4s. Estimated remaining: 3h 43m 21s. Rate: 8.0 symbols/min [2025-10-31T18:12:29.011664] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:12:29.060691] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-31T18:12:29.062688] [DEBUG] [LOCAL ] D: Loaded 54038 existing records from primary storage. [2025-10-31T18:12:29.063063] [INFO ] [MAIN ] D: Loaded 54038 existing records. [2025-10-31T18:12:29.237587] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:12:29.237799] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-31T18:12:29.237867] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-31T18:12:29.238803] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-31T18:12:29.238861] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-31T18:12:29.599534] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:12:29.626558] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T18:12:29.857696] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-31T18:12:30.141188] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T18:12:30.148376] [INFO ] [REMOTE ] CXT: Full fetch complete (45395 records). [2025-10-31T18:12:30.148496] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-31T18:12:30.521812] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-31T18:12:30.521897] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-31T18:12:30.522523] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-31T18:12:30.522572] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-31T18:12:30.523681] [DEBUG] [LOCAL ] CXT: Trimmed 45395 records to 30744 (keeping 200 days of data) [2025-10-31T18:12:30.669556] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-31T18:12:30.707075] [DEBUG] [LOCAL ] CXT: Primary data saved (30744 records). [2025-10-31T18:12:30.707608] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-31T18:12:30.707733] [INFO ] [MAIN ] Update Progress: 580/2365 symbols completed. CXT took 31.4s. Estimated remaining: 3h 42m 56s. Rate: 8.0 symbols/min [2025-10-31T18:12:30.879958] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:12:30.891166] [DEBUG] [LOCAL ] DAC: Loaded 11857 existing records from primary storage. [2025-10-31T18:12:30.891358] [INFO ] [MAIN ] DAC: Loaded 11857 existing records. [2025-10-31T18:12:31.074692] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:12:31.074985] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-31T18:12:31.075118] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-31T18:12:31.075496] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-31T18:12:31.075621] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-31T18:12:31.462990] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-31T18:12:31.471314] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-31T18:12:31.469176] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:12:31.906175] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T18:12:32.099254] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T18:12:32.257669] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-31T18:12:33.054943] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T18:12:33.060531] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-31T18:12:33.857691] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-31T18:12:34.554071] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-31T18:12:34.657675] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-31T18:12:34.920451] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T18:12:35.457721] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-31T18:12:36.126337] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T18:12:36.218837] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-31T18:12:36.257725] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-31T18:12:37.057675] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-31T18:12:37.146278] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-31T18:12:37.857715] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-31T18:12:38.415032] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:12:38.516023] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T18:12:38.657636] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-31T18:12:39.314047] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T18:12:39.457689] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-31T18:12:40.257707] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-31T18:12:40.786941] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T18:12:40.819197] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:12:41.057703] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-31T18:12:41.857625] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-31T18:12:42.004354] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-31T18:12:42.657684] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-31T18:12:43.279126] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T18:12:43.445556] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T18:12:43.457605] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-31T18:12:44.257718] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-31T18:12:44.660335] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-31T18:12:44.667414] [INFO ] [REMOTE ] CYD: Full fetch complete (37041 records). [2025-10-31T18:12:44.667503] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-31T18:12:45.030218] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-31T18:12:45.030293] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-31T18:12:45.030837] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-31T18:12:45.030898] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-31T18:12:45.031683] [DEBUG] [LOCAL ] CYD: Trimmed 37041 records to 27178 (keeping 200 days of data) [2025-10-31T18:12:45.079975] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-31T18:12:45.190244] [DEBUG] [LOCAL ] CYD: Primary data saved (27178 records). [2025-10-31T18:12:45.190391] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-31T18:12:45.190478] [INFO ] [MAIN ] Update Progress: 581/2365 symbols completed. CYD took 31.2s. Estimated remaining: 3h 43m 10s. Rate: 8.0 symbols/min [2025-10-31T18:12:45.354391] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:12:45.402206] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-31T18:12:45.402565] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-10-31T18:12:45.578968] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:12:45.579370] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-31T18:12:45.579499] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-31T18:12:45.580518] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-31T18:12:45.580577] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-31T18:12:45.862708] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-31T18:12:45.875464] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-31T18:12:45.984597] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:12:46.558049] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T18:12:46.591078] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T18:12:46.657625] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-31T18:12:47.457683] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-31T18:12:47.990528] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T18:12:48.257697] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-31T18:12:49.005497] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T18:12:49.057608] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-31T18:12:49.508805] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T18:12:49.857638] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-31T18:12:50.615322] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-31T18:12:50.657607] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-31T18:12:51.404044] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T18:12:51.457626] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-31T18:12:52.257674] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-31T18:12:52.641452] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-31T18:12:52.785395] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T18:12:52.935453] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T18:12:53.057673] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-31T18:12:53.857700] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-31T18:12:54.238357] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T18:12:54.495140] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-31T18:12:54.657636] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-31T18:12:55.258404] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-31T18:12:55.457634] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-31T18:12:56.257664] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-31T18:12:57.057711] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-31T18:12:57.124031] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-31T18:12:57.857677] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-31T18:12:58.150409] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-31T18:12:58.571013] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-31T18:12:58.581770] [INFO ] [REMOTE ] CYH: Full fetch complete (70056 records). [2025-10-31T18:12:58.581885] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-31T18:12:58.662901] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-31T18:12:58.967027] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-31T18:12:58.967112] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-31T18:12:58.967989] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-31T18:12:58.968058] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-31T18:12:58.969376] [DEBUG] [LOCAL ] CYH: Trimmed 70056 records to 48335 (keeping 200 days of data) [2025-10-31T18:12:59.235576] [DEBUG] [LOCAL ] CYH: Primary data saved (48335 records). [2025-10-31T18:12:59.235893] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-31T18:12:59.235986] [INFO ] [MAIN ] Update Progress: 582/2365 symbols completed. CYH took 34.5s. Estimated remaining: 3h 43m 23s. Rate: 8.0 symbols/min [2025-10-31T18:12:59.411500] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:12:59.421816] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-31T18:12:59.464566] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-31T18:12:59.475459] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-31T18:12:59.524837] [DEBUG] [LOCAL ] DAN: Loaded 49707 existing records from primary storage. [2025-10-31T18:12:59.525195] [INFO ] [MAIN ] DAN: Loaded 49707 existing records. [2025-10-31T18:12:59.706897] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:12:59.707126] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-31T18:12:59.707177] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-31T18:12:59.708048] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-31T18:12:59.708106] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-31T18:13:00.058836] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:13:00.257692] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-31T18:13:01.057778] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-31T18:13:01.667268] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-31T18:13:01.857715] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-31T18:13:01.911626] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T18:13:01.925117] [INFO ] [REMOTE ] D: Full fetch complete (77423 records). [2025-10-31T18:13:01.925325] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-31T18:13:01.926281] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:13:01.926398] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:13:01.926442] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:13:01.926480] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-31T18:13:01.926540] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-31T18:13:01.926575] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-31T18:13:01.926779] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-10-31T18:13:01.927475] [INFO ] [MAIN ] Update Progress: 583/2365 symbols completed. D took 33.1s. Estimated remaining: 3h 43m 1s. Rate: 8.0 symbols/min [2025-10-31T18:13:02.111769] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:13:02.131753] [DEBUG] [LOCAL ] DAO: Loaded 19842 existing records from primary storage. [2025-10-31T18:13:02.132018] [INFO ] [MAIN ] DAO: Loaded 19842 existing records. [2025-10-31T18:13:02.348017] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:13:02.349592] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-31T18:13:02.353358] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-31T18:13:02.353580] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-31T18:13:02.364973] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-31T18:13:02.365054] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-31T18:13:02.659233] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-31T18:13:02.707327] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T18:13:02.745023] [INFO ] [REMOTE ] DAC: Full fetch complete (18629 records). [2025-10-31T18:13:02.756008] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-31T18:13:02.789287] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:13:03.146315] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-31T18:13:03.146395] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-31T18:13:03.146765] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-31T18:13:03.146826] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-31T18:13:03.147361] [DEBUG] [LOCAL ] DAC: Trimmed 18629 records to 11936 (keeping 200 days of data) [2025-10-31T18:13:03.216877] [DEBUG] [LOCAL ] DAC: Primary data saved (11936 records). [2025-10-31T18:13:03.216999] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-31T18:13:03.217074] [INFO ] [MAIN ] Update Progress: 584/2365 symbols completed. DAC took 32.5s. Estimated remaining: 3h 42m 34s. Rate: 8.0 symbols/min [2025-10-31T18:13:03.381512] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:13:03.426314] [DEBUG] [LOCAL ] DAR: Loaded 52350 existing records from primary storage. [2025-10-31T18:13:03.426638] [INFO ] [MAIN ] DAR: Loaded 52350 existing records. [2025-10-31T18:13:03.463015] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-31T18:13:03.603694] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:13:03.603914] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-31T18:13:03.604007] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-31T18:13:03.604937] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-31T18:13:03.604993] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-31T18:13:03.958108] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:13:04.019053] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-31T18:13:04.257678] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-31T18:13:05.057688] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-31T18:13:05.394010] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-31T18:13:05.432275] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T18:13:05.785627] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T18:13:05.857611] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-31T18:13:06.657613] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-31T18:13:06.857818] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T18:13:07.457709] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-31T18:13:08.021791] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T18:13:08.257714] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-31T18:13:09.057731] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-31T18:13:09.507752] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:13:09.553615] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-31T18:13:09.857682] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-31T18:13:10.505090] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T18:13:10.657632] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-31T18:13:11.457675] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-31T18:13:11.755953] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-31T18:13:12.006356] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T18:13:12.257639] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-31T18:13:12.791195] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T18:13:13.057753] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-31T18:13:13.857629] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-31T18:13:13.973304] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-31T18:13:14.113563] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T18:13:14.657636] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-31T18:13:15.233286] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T18:13:15.457677] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-31T18:13:15.505947] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-31T18:13:16.257728] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-31T18:13:16.703049] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T18:13:17.057689] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-31T18:13:17.269588] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T18:13:17.857709] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-31T18:13:18.522885] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-31T18:13:18.544136] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T18:13:18.657675] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-31T18:13:19.457724] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-31T18:13:19.987611] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:13:20.257730] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-31T18:13:20.841783] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T18:13:21.057688] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-31T18:13:21.644831] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-31T18:13:21.717438] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-31T18:13:21.857611] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-31T18:13:22.657663] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-31T18:13:23.136175] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T18:13:23.458253] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-31T18:13:23.469415] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T18:13:24.257741] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-31T18:13:24.770173] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T18:13:24.851473] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T18:13:24.863981] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-31T18:13:24.864163] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-31T18:13:25.062848] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-31T18:13:25.256872] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-31T18:13:25.256956] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-31T18:13:25.257909] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-31T18:13:25.257982] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-31T18:13:25.259504] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 54533 (keeping 200 days of data) [2025-10-31T18:13:25.591113] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-10-31T18:13:25.591294] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-31T18:13:25.592030] [INFO ] [MAIN ] Update Progress: 585/2365 symbols completed. DAL took 40.4s. Estimated remaining: 3h 43m 12s. Rate: 8.0 symbols/min [2025-10-31T18:13:25.759695] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:13:25.799542] [DEBUG] [LOCAL ] DAVA: Loaded 42283 existing records from primary storage. [2025-10-31T18:13:25.799842] [INFO ] [MAIN ] DAVA: Loaded 42283 existing records. [2025-10-31T18:13:25.862777] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-31T18:13:25.981263] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:13:25.981609] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-31T18:13:25.988090] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-31T18:13:25.997612] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-31T18:13:25.997716] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-31T18:13:26.003564] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T18:13:26.355498] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:13:26.657693] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-31T18:13:27.076324] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T18:13:27.457699] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-31T18:13:27.633211] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:13:28.257624] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-31T18:13:28.375510] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T18:13:28.381338] [INFO ] [REMOTE ] DAO: Full fetch complete (33060 records). [2025-10-31T18:13:28.381457] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-31T18:13:28.827477] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-31T18:13:28.827593] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-31T18:13:28.828252] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-31T18:13:28.828316] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-31T18:13:28.829118] [DEBUG] [LOCAL ] DAO: Trimmed 33060 records to 20067 (keeping 200 days of data) [2025-10-31T18:13:28.953950] [DEBUG] [LOCAL ] DAO: Primary data saved (20067 records). [2025-10-31T18:13:28.954093] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-31T18:13:28.954182] [INFO ] [MAIN ] Update Progress: 586/2365 symbols completed. DAO took 27.0s. Estimated remaining: 3h 42m 52s. Rate: 8.0 symbols/min [2025-10-31T18:13:29.062945] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-31T18:13:29.167665] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:13:29.211507] [DEBUG] [LOCAL ] DAY: Loaded 49453 existing records from primary storage. [2025-10-31T18:13:29.211866] [INFO ] [MAIN ] DAY: Loaded 49453 existing records. [2025-10-31T18:13:29.390639] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:13:29.390924] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-31T18:13:29.391018] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-31T18:13:29.391912] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-31T18:13:29.392002] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-31T18:13:29.597239] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-31T18:13:29.788851] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:13:29.857694] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-31T18:13:30.057687] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T18:13:30.657711] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-31T18:13:31.320444] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T18:13:31.457683] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-31T18:13:32.257716] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-31T18:13:32.302164] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T18:13:32.314123] [INFO ] [REMOTE ] DAR: Full fetch complete (75235 records). [2025-10-31T18:13:32.314322] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-31T18:13:32.716817] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-31T18:13:32.716933] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-31T18:13:32.718148] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-31T18:13:32.718224] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-31T18:13:32.719824] [DEBUG] [LOCAL ] DAR: Trimmed 75235 records to 52719 (keeping 200 days of data) [2025-10-31T18:13:33.057968] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-31T18:13:33.060300] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T18:13:33.097082] [INFO ] [REMOTE ] DAN: Full fetch complete (71564 records). [2025-10-31T18:13:33.096897] [DEBUG] [LOCAL ] DAR: Primary data saved (52719 records). [2025-10-31T18:13:33.097245] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-31T18:13:33.097362] [INFO ] [MAIN ] Update Progress: 587/2365 symbols completed. DAR took 29.9s. Estimated remaining: 3h 42m 34s. Rate: 8.0 symbols/min [2025-10-31T18:13:33.097442] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-31T18:13:33.501377] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:13:33.725486] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-31T18:13:33.725631] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-31T18:13:33.726949] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-31T18:13:33.727043] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-31T18:13:33.755506] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-31T18:13:33.753632] [DEBUG] [LOCAL ] DAN: Trimmed 71564 records to 50070 (keeping 200 days of data) [2025-10-31T18:13:33.871219] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-31T18:13:33.984667] [DEBUG] [LOCAL ] DB: Loaded 52768 existing records from primary storage. [2025-10-31T18:13:34.016383] [INFO ] [MAIN ] DB: Loaded 52768 existing records. [2025-10-31T18:13:34.272044] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:13:34.280804] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-31T18:13:34.281982] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-31T18:13:34.290190] [DEBUG] [LOCAL ] DAN: Primary data saved (50070 records). [2025-10-31T18:13:34.290614] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-31T18:13:34.290817] [INFO ] [MAIN ] Update Progress: 588/2365 symbols completed. DAN took 35.1s. Estimated remaining: 3h 42m 7s. Rate: 8.0 symbols/min [2025-10-31T18:13:34.301799] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-31T18:13:34.326956] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-31T18:13:34.523144] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T18:13:34.607746] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:13:34.608009] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-31T18:13:34.608339] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-31T18:13:34.647188] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-31T18:13:34.665485] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-31T18:13:34.665607] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-31T18:13:34.667678] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-31T18:13:34.668114] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-31T18:13:35.077061] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:13:35.276235] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:13:35.304806] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T18:13:35.457616] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-31T18:13:35.746125] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T18:13:36.032984] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-31T18:13:36.257727] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-31T18:13:37.057724] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-31T18:13:37.562353] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T18:13:37.857630] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-31T18:13:38.303905] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T18:13:38.657736] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-31T18:13:39.048439] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T18:13:39.457713] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-31T18:13:40.077049] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-31T18:13:40.257729] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-31T18:13:40.829423] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T18:13:41.057638] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-31T18:13:41.323211] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T18:13:41.857686] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-31T18:13:42.309145] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:13:42.657724] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-31T18:13:43.034248] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T18:13:43.457690] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-31T18:13:44.053019] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-31T18:13:44.257684] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-31T18:13:44.753139] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T18:13:45.057710] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-31T18:13:45.320059] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T18:13:45.857679] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-31T18:13:46.563033] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T18:13:46.657616] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-31T18:13:47.046365] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T18:13:47.457678] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-31T18:13:48.048436] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T18:13:48.058732] [INFO ] [REMOTE ] DAVA: Full fetch complete (57837 records). [2025-10-31T18:13:48.058851] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-31T18:13:48.262759] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-31T18:13:48.436236] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-31T18:13:48.436315] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-31T18:13:48.437041] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-31T18:13:48.437103] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-31T18:13:48.438260] [DEBUG] [LOCAL ] DAVA: Trimmed 57837 records to 42604 (keeping 200 days of data) [2025-10-31T18:13:48.677274] [DEBUG] [LOCAL ] DAVA: Primary data saved (42604 records). [2025-10-31T18:13:48.677394] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-31T18:13:48.678110] [INFO ] [MAIN ] Update Progress: 589/2365 symbols completed. DAVA took 23.1s. Estimated remaining: 3h 42m 21s. Rate: 8.0 symbols/min [2025-10-31T18:13:48.844197] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:13:48.855095] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T18:13:48.896756] [DEBUG] [LOCAL ] DBI: Loaded 43087 existing records from primary storage. [2025-10-31T18:13:48.897042] [INFO ] [MAIN ] DBI: Loaded 43087 existing records. [2025-10-31T18:13:49.063321] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-31T18:13:49.128390] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:13:49.128739] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-31T18:13:49.128835] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-31T18:13:49.129903] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-31T18:13:49.129970] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-31T18:13:49.352182] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-31T18:13:49.580351] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:13:49.789409] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-31T18:13:49.857621] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-31T18:13:50.657708] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-31T18:13:51.312949] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-31T18:13:51.457729] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-31T18:13:51.991581] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T18:13:52.257626] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-31T18:13:52.953748] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T18:13:52.987480] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-31T18:13:53.057694] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-31T18:13:53.858202] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-31T18:13:53.861317] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-31T18:13:54.657678] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-31T18:13:55.119835] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T18:13:55.457692] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-31T18:13:56.013315] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T18:13:56.257686] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-31T18:13:57.022878] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-31T18:13:57.057614] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-31T18:13:57.512746] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T18:13:57.857712] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-31T18:13:58.564249] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T18:13:58.657612] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-31T18:13:59.215868] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T18:13:59.226734] [INFO ] [REMOTE ] DAY: Full fetch complete (71989 records). [2025-10-31T18:13:59.226870] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-31T18:13:59.462744] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-31T18:13:59.630498] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-31T18:13:59.630627] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-31T18:13:59.631588] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-31T18:13:59.631677] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-31T18:13:59.633043] [DEBUG] [LOCAL ] DAY: Trimmed 71989 records to 49823 (keeping 200 days of data) [2025-10-31T18:13:59.916333] [DEBUG] [LOCAL ] DAY: Primary data saved (49823 records). [2025-10-31T18:13:59.916461] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-31T18:13:59.916536] [INFO ] [MAIN ] Update Progress: 590/2365 symbols completed. DAY took 31.0s. Estimated remaining: 3h 42m 24s. Rate: 8.0 symbols/min [2025-10-31T18:14:00.087311] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:14:00.097195] [DEBUG] [LOCAL ] DBL: Loaded 9237 existing records from primary storage. [2025-10-31T18:14:00.097392] [INFO ] [MAIN ] DBL: Loaded 9237 existing records. [2025-10-31T18:14:00.280039] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-31T18:14:00.284849] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:14:00.286139] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-31T18:14:00.286215] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-31T18:14:00.286604] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-31T18:14:00.286690] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-31T18:14:00.685124] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:14:00.687713] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-31T18:14:00.707623] [INFO ] [REMOTE ] DB: Full fetch complete (75407 records). [2025-10-31T18:14:00.714161] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T18:14:00.713700] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-31T18:14:00.720791] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:14:00.720906] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:14:00.720983] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:14:00.721066] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-31T18:14:00.721145] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-31T18:14:00.721207] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-10-31T18:14:00.721394] [DEBUG] [LOCAL ] DB: Deleted derivative data file. [2025-10-31T18:14:00.721481] [INFO ] [MAIN ] Update Progress: 591/2365 symbols completed. DB took 27.6s. Estimated remaining: 3h 41m 57s. Rate: 8.0 symbols/min [2025-10-31T18:14:00.887659] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:14:00.887842] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-31T18:14:00.887913] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-31T18:14:00.888024] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-31T18:14:00.888087] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-31T18:14:00.888153] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-31T18:14:00.888197] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-31T18:14:01.062980] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-31T18:14:01.242621] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:14:01.857670] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-31T18:14:02.075215] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T18:14:02.257108] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-31T18:14:02.657626] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-31T18:14:03.061989] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T18:14:03.377077] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T18:14:03.457683] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-31T18:14:04.257674] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-31T18:14:04.659098] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T18:14:04.718942] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T18:14:05.057668] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-31T18:14:05.651716] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-31T18:14:05.857690] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-31T18:14:06.657699] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-31T18:14:06.740013] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T18:14:07.457672] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-31T18:14:08.040328] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-31T18:14:08.205417] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-31T18:14:08.257743] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-31T18:14:09.057722] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-31T18:14:09.057839] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-31T18:14:09.857665] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-31T18:14:10.424136] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T18:14:10.657630] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-31T18:14:10.746027] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-31T18:14:10.751918] [INFO ] [REMOTE ] DBD: Full fetch complete (32403 records). [2025-10-31T18:14:10.752042] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-31T18:14:10.752524] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:14:10.752634] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:14:10.752842] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:14:10.752943] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-31T18:14:10.753031] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-31T18:14:10.753071] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-31T18:14:10.753109] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-31T18:14:10.753163] [INFO ] [MAIN ] Update Progress: 592/2365 symbols completed. DBD took 36.5s. Estimated remaining: 3h 41m 57s. Rate: 8.0 symbols/min [2025-10-31T18:14:10.946197] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:14:10.981894] [DEBUG] [LOCAL ] DCI: Loaded 36884 existing records from primary storage. [2025-10-31T18:14:10.982141] [INFO ] [MAIN ] DCI: Loaded 36884 existing records. [2025-10-31T18:14:11.160530] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:14:11.160789] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-31T18:14:11.160846] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-31T18:14:11.161423] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-31T18:14:11.161480] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-31T18:14:11.462719] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-31T18:14:11.516894] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:14:12.024218] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-31T18:14:12.031049] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T18:14:12.257714] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-31T18:14:13.057678] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-31T18:14:13.417179] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T18:14:13.857676] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-31T18:14:14.418602] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T18:14:14.536842] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T18:14:14.657617] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-31T18:14:15.272805] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-31T18:14:15.457674] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-31T18:14:16.257665] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-31T18:14:16.996882] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-31T18:14:17.057662] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-31T18:14:17.214055] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T18:14:17.857689] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-31T18:14:18.379449] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-31T18:14:18.446672] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T18:14:18.657676] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-31T18:14:19.457696] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-31T18:14:19.979078] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-31T18:14:20.257708] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-31T18:14:20.412026] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-31T18:14:20.770730] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-31T18:14:21.057706] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-31T18:14:21.857688] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-31T18:14:22.422815] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-31T18:14:22.451238] [INFO ] [REMOTE ] DBL: Full fetch complete (12613 records). [2025-10-31T18:14:22.451413] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-31T18:14:22.453713] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T18:14:22.452048] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:14:22.463991] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:14:22.464434] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:14:22.464540] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-31T18:14:22.464674] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-31T18:14:22.464739] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-31T18:14:22.465216] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-10-31T18:14:22.465329] [INFO ] [MAIN ] Update Progress: 593/2365 symbols completed. DBL took 22.5s. Estimated remaining: 3h 42m 2s. Rate: 8.0 symbols/min [2025-10-31T18:14:22.637044] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:14:22.637204] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-31T18:14:22.637241] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-31T18:14:22.637349] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-31T18:14:22.637390] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-31T18:14:22.637432] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-31T18:14:22.637466] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-31T18:14:22.666029] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-31T18:14:22.986912] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:14:23.457680] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-31T18:14:24.001830] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T18:14:24.102579] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-31T18:14:24.257661] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-31T18:14:25.057685] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-31T18:14:25.380709] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T18:14:25.857672] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-31T18:14:26.235168] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T18:14:26.657692] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-31T18:14:27.232045] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T18:14:27.457704] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-31T18:14:27.842304] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T18:14:28.077401] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-31T18:14:28.257684] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-31T18:14:29.057735] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-31T18:14:29.431424] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T18:14:29.439734] [INFO ] [REMOTE ] DBI: Full fetch complete (64147 records). [2025-10-31T18:14:29.439839] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-31T18:14:29.648985] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T18:14:29.846833] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-31T18:14:29.846905] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-31T18:14:29.847631] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-31T18:14:29.847707] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-31T18:14:29.848947] [DEBUG] [LOCAL ] DBI: Trimmed 64147 records to 43345 (keeping 200 days of data) [2025-10-31T18:14:29.900720] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-31T18:14:30.101293] [DEBUG] [LOCAL ] DBI: Primary data saved (43345 records). [2025-10-31T18:14:30.101426] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-31T18:14:30.102349] [INFO ] [MAIN ] Update Progress: 594/2365 symbols completed. DBI took 41.4s. Estimated remaining: 3h 41m 55s. Rate: 8.0 symbols/min [2025-10-31T18:14:30.293593] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:14:30.341833] [DEBUG] [LOCAL ] DD: Loaded 53293 existing records from primary storage. [2025-10-31T18:14:30.342142] [INFO ] [MAIN ] DD: Loaded 53293 existing records. [2025-10-31T18:14:30.521024] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:14:30.521272] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-31T18:14:30.521320] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-31T18:14:30.522562] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-31T18:14:30.522622] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-31T18:14:30.666807] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-31T18:14:30.885412] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:14:31.311610] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T18:14:31.457637] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-31T18:14:31.830318] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T18:14:32.257674] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-31T18:14:33.057729] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-31T18:14:33.147911] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-31T18:14:33.166980] [INFO ] [REMOTE ] DBRG: Full fetch complete (72770 records). [2025-10-31T18:14:33.167185] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-31T18:14:33.658194] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-31T18:14:33.706734] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-31T18:14:33.707964] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-31T18:14:33.710418] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-31T18:14:33.710550] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-31T18:14:33.724536] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T18:14:33.729348] [DEBUG] [LOCAL ] DBRG: Trimmed 72770 records to 50748 (keeping 200 days of data) [2025-10-31T18:14:33.858052] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-31T18:14:34.065890] [DEBUG] [LOCAL ] DBRG: Primary data saved (50748 records). [2025-10-31T18:14:34.066037] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-31T18:14:34.066115] [INFO ] [MAIN ] Update Progress: 595/2365 symbols completed. DBRG took 33.3s. Estimated remaining: 3h 41m 37s. Rate: 8.0 symbols/min [2025-10-31T18:14:34.272376] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:14:34.325193] [DEBUG] [LOCAL ] DDD: Loaded 51304 existing records from primary storage. [2025-10-31T18:14:34.325516] [INFO ] [MAIN ] DDD: Loaded 51304 existing records. [2025-10-31T18:14:34.546568] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:14:34.546881] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-31T18:14:34.546955] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-31T18:14:34.547341] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-31T18:14:34.547401] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-31T18:14:34.663010] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-31T18:14:34.996786] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:14:35.021349] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T18:14:35.299867] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T18:14:35.457687] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-31T18:14:36.172769] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T18:14:36.257673] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-31T18:14:37.057740] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-31T18:14:37.678738] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T18:14:37.827524] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T18:14:37.857615] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-31T18:14:38.504535] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-31T18:14:38.657692] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-31T18:14:39.457688] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-31T18:14:40.032110] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T18:14:40.151876] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-31T18:14:40.257631] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-31T18:14:41.059978] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-31T18:14:41.064567] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T18:14:41.069588] [INFO ] [REMOTE ] DCO: Full fetch complete (20030 records). [2025-10-31T18:14:41.069698] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-31T18:14:41.436229] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-31T18:14:41.436304] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-31T18:14:41.436732] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-31T18:14:41.436793] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-31T18:14:41.437321] [DEBUG] [LOCAL ] DCO: Trimmed 20030 records to 15396 (keeping 200 days of data) [2025-10-31T18:14:41.524672] [DEBUG] [LOCAL ] DCO: Primary data saved (15396 records). [2025-10-31T18:14:41.524802] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-31T18:14:41.524870] [INFO ] [MAIN ] Update Progress: 596/2365 symbols completed. DCO took 19.1s. Estimated remaining: 3h 41m 29s. Rate: 8.0 symbols/min [2025-10-31T18:14:41.698974] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:14:41.732406] [DEBUG] [LOCAL ] DDL: Loaded 37475 existing records from primary storage. [2025-10-31T18:14:41.732697] [INFO ] [MAIN ] DDL: Loaded 37475 existing records. [2025-10-31T18:14:41.871248] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-31T18:14:41.931832] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:14:41.932007] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-31T18:14:41.932052] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-31T18:14:41.932496] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-31T18:14:41.932564] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-31T18:14:42.284044] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:14:42.544072] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T18:14:42.657712] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-31T18:14:43.086476] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T18:14:43.457668] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-31T18:14:43.741566] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T18:14:44.257627] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-31T18:14:44.607451] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T18:14:45.057626] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-31T18:14:45.132980] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T18:14:45.857681] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-31T18:14:46.521760] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T18:14:46.657693] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-31T18:14:47.092064] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T18:14:47.100244] [INFO ] [REMOTE ] DCI: Full fetch complete (53944 records). [2025-10-31T18:14:47.100344] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-31T18:14:47.462844] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-31T18:14:47.485462] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-31T18:14:47.485550] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-31T18:14:47.486271] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-31T18:14:47.486336] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-31T18:14:47.487507] [DEBUG] [LOCAL ] DCI: Trimmed 53944 records to 37184 (keeping 200 days of data) [2025-10-31T18:14:47.705142] [DEBUG] [LOCAL ] DCI: Primary data saved (37184 records). [2025-10-31T18:14:47.705326] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-31T18:14:47.705436] [INFO ] [MAIN ] Update Progress: 597/2365 symbols completed. DCI took 37.0s. Estimated remaining: 3h 41m 17s. Rate: 8.0 symbols/min [2025-10-31T18:14:48.198390] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-31T18:14:48.257680] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-31T18:14:48.985069] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-31T18:14:49.057670] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-31T18:14:49.661506] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:14:49.857615] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-31T18:14:50.424564] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T18:14:50.657718] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-31T18:14:50.986357] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T18:14:51.457729] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-31T18:14:51.673024] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T18:14:52.257747] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-31T18:14:52.840221] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T18:14:53.057690] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-31T18:14:53.776078] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T18:14:53.857680] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-31T18:14:54.357764] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T18:14:54.657689] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-31T18:14:55.105366] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T18:14:55.457717] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-31T18:14:55.934674] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T18:14:56.257710] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-31T18:14:56.532676] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-31T18:14:57.057708] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-31T18:14:57.845589] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T18:14:57.857872] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-31T18:14:58.084358] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T18:14:58.657716] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-31T18:14:59.344345] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-31T18:14:59.457637] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-31T18:15:00.151707] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-31T18:15:00.257675] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-31T18:15:01.057735] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-31T18:15:01.691036] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-31T18:15:01.712003] [INFO ] [REMOTE ] DDD: Full fetch complete (74084 records). [2025-10-31T18:15:01.712424] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-31T18:15:02.208337] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-31T18:15:02.208559] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-31T18:15:02.209575] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-31T18:15:02.209693] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-31T18:15:02.211387] [DEBUG] [LOCAL ] DDD: Trimmed 74084 records to 51686 (keeping 200 days of data) [2025-10-31T18:15:02.327346] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-31T18:15:02.347284] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-31T18:15:02.575266] [DEBUG] [LOCAL ] DDD: Primary data saved (51686 records). [2025-10-31T18:15:02.575416] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-31T18:15:02.575502] [INFO ] [MAIN ] Update Progress: 598/2365 symbols completed. DDD took 28.5s. Estimated remaining: 3h 41m 32s. Rate: 8.0 symbols/min [2025-10-31T18:15:03.614396] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-31T18:15:03.621062] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-31T18:15:04.404050] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-31T18:15:04.416373] [INFO ] [REMOTE ] DD: Full fetch complete (76643 records). [2025-10-31T18:15:04.416523] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-31T18:15:04.863410] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-31T18:15:04.863506] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-31T18:15:04.864497] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-31T18:15:04.864571] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-31T18:15:04.866353] [DEBUG] [LOCAL ] DD: Trimmed 76643 records to 53680 (keeping 200 days of data) [2025-10-31T18:15:05.222287] [DEBUG] [LOCAL ] DD: Primary data saved (53680 records). [2025-10-31T18:15:05.222415] [INFO ] [MAIN ] DD: Full history saved. [2025-10-31T18:15:05.223063] [INFO ] [MAIN ] Update Progress: 599/2365 symbols completed. DD took 35.1s. Estimated remaining: 3h 41m 10s. Rate: 8.0 symbols/min [2025-10-31T18:15:05.843207] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-31T18:15:05.849710] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-31T18:15:07.003913] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T18:15:07.010632] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-31T18:15:08.081066] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T18:15:08.090474] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-31T18:15:09.422622] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-31T18:15:09.432793] [INFO ] [REMOTE ] DDL: Full fetch complete (53991 records). [2025-10-31T18:15:09.432945] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-31T18:15:09.433603] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:15:09.433717] [FATAL] [MAIN ] DDL: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:15:09.433761] [WARN ] [MAIN ] DDL: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:15:09.433798] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-31T18:15:09.433855] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-31T18:15:09.433891] [INFO ] [LOCAL ] DDL: Starting deletion of derivative data. [2025-10-31T18:15:09.434072] [DEBUG] [LOCAL ] DDL: Deleted derivative data file. [2025-10-31T18:15:09.434170] [INFO ] [MAIN ] Update Progress: 600/2365 symbols completed. DDL took 27.9s. Estimated remaining: 3h 40m 52s. Rate: 8.0 symbols/min [2025-10-31T18:15:10.140515] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:10.174767] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:10.197870] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:10.216906] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:10.217321] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-31T18:15:10.217575] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-31T18:15:10.217463] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-31T18:15:10.217738] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-31T18:15:10.217921] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-31T18:15:10.218235] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-31T18:15:10.218161] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-31T18:15:10.218442] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-31T18:15:10.218543] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-31T18:15:10.218662] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-31T18:15:10.218913] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-31T18:15:10.224168] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-31T18:15:10.368509] [DEBUG] [LOCAL ] DDS: Loaded 11868 existing records from primary storage. [2025-10-31T18:15:10.401393] [INFO ] [MAIN ] DDS: Loaded 11868 existing records. [2025-10-31T18:15:10.826324] [DEBUG] [LOCAL ] DE: Loaded 47646 existing records from primary storage. [2025-10-31T18:15:10.948351] [INFO ] [MAIN ] DE: Loaded 47646 existing records. [2025-10-31T18:15:11.077349] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:15:11.150803] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-31T18:15:11.210775] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-31T18:15:11.266999] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-31T18:15:11.359017] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:11.347764] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:11.363089] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-31T18:15:11.359166] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-31T18:15:11.363549] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-31T18:15:11.434457] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:15:11.460807] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-31T18:15:11.475337] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-31T18:15:11.493346] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-31T18:15:11.505298] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-31T18:15:11.952097] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-31T18:15:11.999409] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:12.016435] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-31T18:15:12.010926] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-31T18:15:12.162610] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:12.162990] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-31T18:15:12.329513] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T18:15:12.330528] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-31T18:15:12.609383] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-31T18:15:12.610520] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-31T18:15:12.811987] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-31T18:15:12.815239] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-31T18:15:12.817738] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T18:15:12.827171] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-31T18:15:13.012901] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-31T18:15:13.057607] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-31T18:15:13.367145] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-31T18:15:13.431553] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-31T18:15:13.619493] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T18:15:13.857632] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-31T18:15:14.056256] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T18:15:14.657690] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-31T18:15:14.981848] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-31T18:15:15.246581] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-31T18:15:15.457658] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-31T18:15:15.860440] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-31T18:15:16.257683] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-31T18:15:17.057697] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-31T18:15:17.403790] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T18:15:17.857672] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-31T18:15:18.257411] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T18:15:18.657671] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-31T18:15:19.272102] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T18:15:19.457682] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-31T18:15:19.935477] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T18:15:20.241433] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-31T18:15:20.257729] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-31T18:15:20.660249] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-31T18:15:21.057750] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-31T18:15:21.857695] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-31T18:15:22.571936] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-31T18:15:22.657675] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-31T18:15:23.134823] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T18:15:23.457689] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-31T18:15:24.086858] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-31T18:15:24.257679] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-31T18:15:24.608065] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T18:15:25.057725] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-31T18:15:25.432569] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-31T18:15:25.790111] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-31T18:15:25.857658] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-31T18:15:26.657672] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-31T18:15:27.094951] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-31T18:15:27.096149] [INFO ] [REMOTE ] DDT: Full fetch complete (2826 records). [2025-10-31T18:15:27.096219] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-31T18:15:27.457347] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-31T18:15:27.457517] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-31T18:15:27.457690] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-31T18:15:27.457779] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-31T18:15:27.458017] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-31T18:15:27.459095] [DEBUG] [LOCAL ] DDT: Trimmed 2826 records to 1808 (keeping 200 days of data) [2025-10-31T18:15:27.470463] [DEBUG] [LOCAL ] DDT: Primary data saved (1808 records). [2025-10-31T18:15:27.470699] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-31T18:15:27.470833] [INFO ] [MAIN ] Update Progress: 601/2365 symbols completed. DDT took 18.0s. Estimated remaining: 3h 41m 16s. Rate: 8.0 symbols/min [2025-10-31T18:15:27.604066] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-31T18:15:27.695025] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:27.722793] [DEBUG] [LOCAL ] DEC: Loaded 30013 existing records from primary storage. [2025-10-31T18:15:27.723062] [INFO ] [MAIN ] DEC: Loaded 30013 existing records. [2025-10-31T18:15:27.900959] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:15:27.901190] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-31T18:15:27.901237] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-31T18:15:27.901940] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-31T18:15:27.901999] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-31T18:15:28.258126] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-31T18:15:28.263700] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:28.295681] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-31T18:15:29.057699] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-31T18:15:29.303023] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T18:15:29.857711] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-31T18:15:30.597914] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T18:15:30.657681] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-31T18:15:30.717877] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T18:15:31.457738] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-31T18:15:31.783193] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T18:15:32.106707] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-31T18:15:32.257723] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-31T18:15:32.842179] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-31T18:15:33.057736] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-31T18:15:33.678211] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T18:15:33.689006] [INFO ] [REMOTE ] DE: Full fetch complete (69784 records). [2025-10-31T18:15:33.689125] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-31T18:15:33.866157] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-31T18:15:34.078589] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-31T18:15:34.078689] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-31T18:15:34.079487] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-31T18:15:34.079530] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-31T18:15:34.080801] [DEBUG] [LOCAL ] DE: Trimmed 69784 records to 47962 (keeping 200 days of data) [2025-10-31T18:15:34.371984] [DEBUG] [LOCAL ] DE: Primary data saved (47962 records). [2025-10-31T18:15:34.372126] [INFO ] [MAIN ] DE: Full history saved. [2025-10-31T18:15:34.372811] [INFO ] [MAIN ] Update Progress: 602/2365 symbols completed. DE took 24.9s. Estimated remaining: 3h 41m 7s. Rate: 8.0 symbols/min [2025-10-31T18:15:34.544822] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:34.596417] [DEBUG] [LOCAL ] DECK: Loaded 53693 existing records from primary storage. [2025-10-31T18:15:34.596743] [INFO ] [MAIN ] DECK: Loaded 53693 existing records. [2025-10-31T18:15:34.662779] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-31T18:15:34.773736] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:15:34.773935] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-31T18:15:34.773980] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-31T18:15:34.774976] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-31T18:15:34.775042] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-31T18:15:35.131407] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:35.215140] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T18:15:35.457701] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-31T18:15:35.554754] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-31T18:15:36.257664] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-31T18:15:36.645742] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T18:15:36.655311] [INFO ] [REMOTE ] DEA: Full fetch complete (61367 records). [2025-10-31T18:15:36.655461] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-31T18:15:37.045300] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-31T18:15:37.045375] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-31T18:15:37.046117] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-31T18:15:37.046178] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-31T18:15:37.047297] [DEBUG] [LOCAL ] DEA: Trimmed 61367 records to 40188 (keeping 200 days of data) [2025-10-31T18:15:37.098239] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-31T18:15:37.285717] [DEBUG] [LOCAL ] DEA: Primary data saved (40188 records). [2025-10-31T18:15:37.285839] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-31T18:15:37.285906] [INFO ] [MAIN ] Update Progress: 603/2365 symbols completed. DEA took 27.8s. Estimated remaining: 3h 40m 46s. Rate: 8.0 symbols/min [2025-10-31T18:15:37.465618] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:37.496733] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T18:15:37.545191] [DEBUG] [LOCAL ] DEI: Loaded 48507 existing records from primary storage. [2025-10-31T18:15:37.545553] [INFO ] [MAIN ] DEI: Loaded 48507 existing records. [2025-10-31T18:15:37.737038] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:15:37.740756] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-31T18:15:37.741034] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-31T18:15:37.744132] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-31T18:15:37.745396] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-31T18:15:37.745460] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-31T18:15:37.862795] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-31T18:15:38.101855] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:38.657716] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-31T18:15:39.458297] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-31T18:15:39.461803] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T18:15:40.091756] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T18:15:40.257683] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-31T18:15:40.289815] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T18:15:41.057669] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-31T18:15:41.654148] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T18:15:41.857696] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-31T18:15:42.169760] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T18:15:42.657684] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-31T18:15:42.956338] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T18:15:43.201336] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-31T18:15:43.457639] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-31T18:15:44.257698] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-31T18:15:44.349081] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T18:15:44.887238] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T18:15:44.889685] [INFO ] [REMOTE ] DDS: Full fetch complete (18127 records). [2025-10-31T18:15:44.889773] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-31T18:15:45.063950] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-31T18:15:45.258505] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-31T18:15:45.258577] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-31T18:15:45.258984] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-31T18:15:45.259044] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-31T18:15:45.259573] [DEBUG] [LOCAL ] DDS: Trimmed 18127 records to 11955 (keeping 200 days of data) [2025-10-31T18:15:45.333952] [DEBUG] [LOCAL ] DDS: Primary data saved (11955 records). [2025-10-31T18:15:45.334081] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-31T18:15:45.334156] [INFO ] [MAIN ] Update Progress: 604/2365 symbols completed. DDS took 35.9s. Estimated remaining: 3h 40m 40s. Rate: 8.0 symbols/min [2025-10-31T18:15:45.499775] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:45.549365] [DEBUG] [LOCAL ] DELL: Loaded 54125 existing records from primary storage. [2025-10-31T18:15:45.549744] [INFO ] [MAIN ] DELL: Loaded 54125 existing records. [2025-10-31T18:15:45.726303] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:15:45.726517] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-31T18:15:45.726570] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-31T18:15:45.726890] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-31T18:15:45.726948] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-31T18:15:45.864971] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-31T18:15:46.083242] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:46.657624] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-31T18:15:46.766577] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-31T18:15:47.194821] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T18:15:47.457624] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-31T18:15:47.542078] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T18:15:48.257732] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-31T18:15:49.057685] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-31T18:15:49.687278] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-31T18:15:49.857627] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-31T18:15:49.890525] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-31T18:15:49.921795] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T18:15:50.657637] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-31T18:15:51.162489] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T18:15:51.457678] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-31T18:15:52.260955] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-31T18:15:52.267709] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-31T18:15:52.330066] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-31T18:15:53.057674] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-31T18:15:53.857685] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-31T18:15:54.244501] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-31T18:15:54.342686] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T18:15:54.657689] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-31T18:15:54.953152] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T18:15:55.457701] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-31T18:15:56.257713] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-31T18:15:56.306609] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-31T18:15:56.683717] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T18:15:57.057680] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-31T18:15:57.379510] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T18:15:57.387836] [INFO ] [REMOTE ] DEC: Full fetch complete (44865 records). [2025-10-31T18:15:57.388040] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-31T18:15:57.786430] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-31T18:15:57.786513] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-31T18:15:57.787127] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-31T18:15:57.787189] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-31T18:15:57.788229] [DEBUG] [LOCAL ] DEC: Trimmed 44865 records to 30197 (keeping 200 days of data) [2025-10-31T18:15:57.872582] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-31T18:15:57.972050] [DEBUG] [LOCAL ] DEC: Primary data saved (30197 records). [2025-10-31T18:15:57.972188] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-31T18:15:57.972268] [INFO ] [MAIN ] Update Progress: 605/2365 symbols completed. DEC took 30.5s. Estimated remaining: 3h 40m 47s. Rate: 8.0 symbols/min [2025-10-31T18:15:58.164901] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:15:58.165065] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-31T18:15:58.165104] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-31T18:15:58.165215] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-31T18:15:58.165256] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-31T18:15:58.165299] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-31T18:15:58.165332] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-31T18:15:58.550720] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:15:58.657694] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-31T18:15:58.938717] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-31T18:15:59.073495] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T18:15:59.457685] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-31T18:16:00.051166] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T18:16:00.257639] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-31T18:16:00.999853] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-31T18:16:01.057680] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-31T18:16:01.857631] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-31T18:16:02.008103] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-31T18:16:02.480139] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-31T18:16:02.657704] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-31T18:16:03.457697] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-31T18:16:03.988973] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-31T18:16:04.257174] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T18:16:04.267234] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-31T18:16:04.269366] [INFO ] [REMOTE ] DEI: Full fetch complete (69531 records). [2025-10-31T18:16:04.269472] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-31T18:16:04.270490] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:16:04.270623] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:16:04.270710] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:16:04.270781] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-31T18:16:04.270846] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-31T18:16:04.270882] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-10-31T18:16:04.271018] [DEBUG] [LOCAL ] DEI: Deleted derivative data file. [2025-10-31T18:16:04.272321] [INFO ] [MAIN ] Update Progress: 606/2365 symbols completed. DEI took 27.0s. Estimated remaining: 3h 40m 36s. Rate: 8.0 symbols/min [2025-10-31T18:16:04.449158] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:16:04.480619] [DEBUG] [LOCAL ] DFH: Loaded 31250 existing records from primary storage. [2025-10-31T18:16:04.480925] [INFO ] [MAIN ] DFH: Loaded 31250 existing records. [2025-10-31T18:16:04.673637] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:16:04.673880] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-31T18:16:04.673927] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-31T18:16:04.674530] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-31T18:16:04.674586] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-31T18:16:05.022128] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:16:05.057607] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-31T18:16:05.634490] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-31T18:16:05.787077] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-31T18:16:05.857614] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-31T18:16:06.171189] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:16:06.657637] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-31T18:16:07.457679] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-31T18:16:07.921943] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-31T18:16:08.067477] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T18:16:08.257615] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-31T18:16:08.424721] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T18:16:09.057669] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-31T18:16:09.857624] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-31T18:16:09.904981] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-31T18:16:10.406604] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T18:16:10.657696] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-31T18:16:11.457634] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-31T18:16:11.575938] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-31T18:16:12.128433] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-31T18:16:12.257663] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-31T18:16:13.057696] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-31T18:16:13.615540] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T18:16:13.852104] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-31T18:16:13.864497] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-31T18:16:13.868316] [INFO ] [REMOTE ] DECK: Full fetch complete (77304 records). [2025-10-31T18:16:13.868631] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-31T18:16:14.304948] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-31T18:16:14.305036] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-31T18:16:14.305995] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-31T18:16:14.306076] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-31T18:16:14.307583] [DEBUG] [LOCAL ] DECK: Trimmed 77304 records to 54083 (keeping 200 days of data) [2025-10-31T18:16:14.647381] [DEBUG] [LOCAL ] DECK: Primary data saved (54083 records). [2025-10-31T18:16:14.647540] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-31T18:16:14.648298] [INFO ] [MAIN ] Update Progress: 607/2365 symbols completed. DECK took 40.3s. Estimated remaining: 3h 40m 37s. Rate: 8.0 symbols/min [2025-10-31T18:16:14.662852] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-31T18:16:14.856337] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:16:14.890847] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-31T18:16:14.922574] [DEBUG] [LOCAL ] DFIN: Loaded 22316 existing records from primary storage. [2025-10-31T18:16:14.922843] [INFO ] [MAIN ] DFIN: Loaded 22316 existing records. [2025-10-31T18:16:15.118996] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:16:15.119217] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-31T18:16:15.119265] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-31T18:16:15.119504] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-31T18:16:15.119561] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-31T18:16:15.476699] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:16:15.472959] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-31T18:16:15.513474] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-31T18:16:15.555355] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T18:16:16.257733] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-31T18:16:17.057714] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-31T18:16:17.445624] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T18:16:17.514235] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-31T18:16:17.807144] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T18:16:17.857627] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-31T18:16:18.657694] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-31T18:16:19.220667] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T18:16:19.457701] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-31T18:16:20.257716] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-31T18:16:20.316253] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-31T18:16:20.495115] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-31T18:16:21.057628] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-31T18:16:21.190910] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T18:16:21.857714] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-31T18:16:22.041316] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-31T18:16:22.657683] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-31T18:16:23.232226] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T18:16:23.457695] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-31T18:16:23.576399] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T18:16:24.257683] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-31T18:16:25.057634] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-31T18:16:25.165911] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-31T18:16:25.386602] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-31T18:16:25.397907] [INFO ] [REMOTE ] DEO: Full fetch complete (71384 records). [2025-10-31T18:16:25.398029] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-31T18:16:25.398791] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:16:25.398873] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:16:25.398915] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:16:25.398958] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-31T18:16:25.399012] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-31T18:16:25.399049] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-31T18:16:25.399087] [DEBUG] [LOCAL ] DEO: No derivative data file found to delete. [2025-10-31T18:16:25.399139] [INFO ] [MAIN ] Update Progress: 608/2365 symbols completed. DEO took 27.4s. Estimated remaining: 3h 40m 38s. Rate: 8.0 symbols/min [2025-10-31T18:16:25.567429] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:16:25.567671] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-10-31T18:16:25.567725] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-10-31T18:16:25.567902] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-31T18:16:25.567978] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-31T18:16:25.568023] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-31T18:16:25.568056] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-31T18:16:25.862750] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-31T18:16:25.915608] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:16:26.657706] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-31T18:16:26.703170] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T18:16:27.257534] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-31T18:16:27.271063] [INFO ] [REMOTE ] DELL: Full fetch complete (77914 records). [2025-10-31T18:16:27.271289] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-31T18:16:27.462900] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-31T18:16:27.700453] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-31T18:16:27.700717] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-31T18:16:27.701962] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-31T18:16:27.702036] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-31T18:16:27.704269] [DEBUG] [LOCAL ] DELL: Trimmed 77914 records to 54515 (keeping 200 days of data) [2025-10-31T18:16:27.860600] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T18:16:28.115266] [DEBUG] [LOCAL ] DELL: Primary data saved (54515 records). [2025-10-31T18:16:28.115511] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-31T18:16:28.115630] [INFO ] [MAIN ] Update Progress: 609/2365 symbols completed. DELL took 42.8s. Estimated remaining: 3h 40m 17s. Rate: 8.0 symbols/min [2025-10-31T18:16:28.248870] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T18:16:28.259396] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-31T18:16:28.325587] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:16:28.394198] [DEBUG] [LOCAL ] DG: Loaded 53549 existing records from primary storage. [2025-10-31T18:16:28.394821] [INFO ] [MAIN ] DG: Loaded 53549 existing records. [2025-10-31T18:16:28.588270] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:16:28.588586] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-31T18:16:28.588638] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-31T18:16:28.589544] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-31T18:16:28.589603] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-31T18:16:28.987516] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:16:29.057731] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-31T18:16:29.060551] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T18:16:29.857751] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-31T18:16:30.108265] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T18:16:30.657681] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-31T18:16:31.406106] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T18:16:31.436593] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T18:16:31.457626] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-31T18:16:32.257689] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-31T18:16:33.057635] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-31T18:16:33.090892] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-31T18:16:33.562753] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-31T18:16:33.582785] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-31T18:16:33.589831] [INFO ] [REMOTE ] DFH: Full fetch complete (46932 records). [2025-10-31T18:16:33.590015] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-31T18:16:33.862806] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-31T18:16:33.979871] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-31T18:16:33.979948] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-31T18:16:33.980604] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-31T18:16:33.980665] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-31T18:16:33.981601] [DEBUG] [LOCAL ] DFH: Trimmed 46932 records to 31483 (keeping 200 days of data) [2025-10-31T18:16:34.159906] [DEBUG] [LOCAL ] DFH: Primary data saved (31483 records). [2025-10-31T18:16:34.160032] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-31T18:16:34.160110] [INFO ] [MAIN ] Update Progress: 610/2365 symbols completed. DFH took 29.9s. Estimated remaining: 3h 40m 5s. Rate: 8.0 symbols/min [2025-10-31T18:16:34.330681] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:16:34.330863] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-31T18:16:34.330901] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-31T18:16:34.331055] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-31T18:16:34.331097] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-31T18:16:34.331142] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-31T18:16:34.331184] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-31T18:16:34.660722] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-31T18:16:34.668671] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-31T18:16:34.728442] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:16:35.457678] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-31T18:16:36.062690] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-31T18:16:36.262856] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-31T18:16:36.276213] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-31T18:16:37.057665] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-31T18:16:37.601983] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T18:16:37.618346] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-31T18:16:37.857676] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-31T18:16:38.657674] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-31T18:16:39.105831] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:16:39.457710] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-31T18:16:40.188139] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T18:16:40.252545] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-31T18:16:40.258628] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-31T18:16:41.057684] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-31T18:16:41.851335] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-31T18:16:41.861796] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-31T18:16:41.905717] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-31T18:16:42.657621] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-31T18:16:42.688365] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T18:16:43.457672] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-31T18:16:44.134423] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-31T18:16:44.239490] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T18:16:44.257619] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-31T18:16:45.057621] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-31T18:16:45.212529] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-31T18:16:45.218327] [INFO ] [REMOTE ] DFIN: Full fetch complete (33966 records). [2025-10-31T18:16:45.218447] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-31T18:16:45.589604] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-31T18:16:45.589718] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-31T18:16:45.590281] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-31T18:16:45.590324] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-31T18:16:45.591192] [DEBUG] [LOCAL ] DFIN: Trimmed 33966 records to 22533 (keeping 200 days of data) [2025-10-31T18:16:45.719226] [DEBUG] [LOCAL ] DFIN: Primary data saved (22533 records). [2025-10-31T18:16:45.719355] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-31T18:16:45.719438] [INFO ] [MAIN ] Update Progress: 611/2365 symbols completed. DFIN took 31.1s. Estimated remaining: 3h 40m 9s. Rate: 8.0 symbols/min [2025-10-31T18:16:45.867958] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-31T18:16:45.892698] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:16:45.911068] [DEBUG] [LOCAL ] DHF: Loaded 20408 existing records from primary storage. [2025-10-31T18:16:45.911281] [INFO ] [MAIN ] DHF: Loaded 20408 existing records. [2025-10-31T18:16:46.129566] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:16:46.129798] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-31T18:16:46.129846] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-31T18:16:46.130306] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-31T18:16:46.130364] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-31T18:16:46.472611] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:16:46.623133] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T18:16:46.657605] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-31T18:16:46.715282] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-31T18:16:47.294797] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T18:16:47.457687] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-31T18:16:48.257696] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-31T18:16:48.937502] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-31T18:16:49.057635] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-31T18:16:49.671484] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T18:16:49.857624] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-31T18:16:49.921178] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T18:16:50.657677] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-31T18:16:51.371971] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T18:16:51.421400] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-31T18:16:51.457618] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-31T18:16:52.265960] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-31T18:16:52.267768] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-31T18:16:53.057673] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-31T18:16:53.637515] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T18:16:53.857694] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-31T18:16:54.027282] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T18:16:54.515705] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T18:16:54.657670] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-31T18:16:55.457719] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-31T18:16:56.178423] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T18:16:56.181079] [INFO ] [REMOTE ] DFP: Full fetch complete (15853 records). [2025-10-31T18:16:56.181155] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-31T18:16:56.262008] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-31T18:16:56.580203] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-31T18:16:56.580371] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-31T18:16:56.580783] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-31T18:16:56.580857] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-31T18:16:56.581600] [DEBUG] [LOCAL ] DFP: Trimmed 15853 records to 10808 (keeping 200 days of data) [2025-10-31T18:16:56.681036] [DEBUG] [LOCAL ] DFP: Primary data saved (10808 records). [2025-10-31T18:16:56.681442] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-31T18:16:56.681562] [INFO ] [MAIN ] Update Progress: 612/2365 symbols completed. DFP took 31.3s. Estimated remaining: 3h 40m 12s. Rate: 8.0 symbols/min [2025-10-31T18:16:56.695765] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-31T18:16:56.867967] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:16:56.916599] [DEBUG] [LOCAL ] DHI: Loaded 53730 existing records from primary storage. [2025-10-31T18:16:56.916942] [INFO ] [MAIN ] DHI: Loaded 53730 existing records. [2025-10-31T18:16:57.058428] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-31T18:16:57.102241] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:16:57.102614] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-31T18:16:57.102698] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-31T18:16:57.111034] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-31T18:16:57.118111] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-31T18:16:57.156727] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T18:16:57.562188] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:16:57.857690] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-31T18:16:58.290684] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T18:16:58.657674] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-31T18:16:58.768340] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T18:16:59.457667] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-31T18:17:00.056973] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T18:17:00.257686] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-31T18:17:00.912827] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-31T18:17:01.057740] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-31T18:17:01.857708] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-31T18:17:02.521500] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-31T18:17:02.657638] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-31T18:17:03.358600] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T18:17:03.457627] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-31T18:17:04.257683] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-31T18:17:04.654394] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (3.60 seconds). [2025-10-31T18:17:04.667729] [INFO ] [REMOTE ] DG: Full fetch complete (76855 records). [2025-10-31T18:17:04.667938] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-31T18:17:04.668864] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:17:04.668959] [FATAL] [MAIN ] DG: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:17:04.669005] [WARN ] [MAIN ] DG: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:17:04.669073] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-31T18:17:04.669138] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-31T18:17:04.669177] [INFO ] [LOCAL ] DG: Starting deletion of derivative data. [2025-10-31T18:17:04.669343] [DEBUG] [LOCAL ] DG: Deleted derivative data file. [2025-10-31T18:17:04.669437] [INFO ] [MAIN ] Update Progress: 613/2365 symbols completed. DG took 36.6s. Estimated remaining: 3h 40m 5s. Rate: 8.0 symbols/min [2025-10-31T18:17:04.877769] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:17:04.902542] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T18:17:04.956597] [DEBUG] [LOCAL ] DHR: Loaded 53753 existing records from primary storage. [2025-10-31T18:17:04.957064] [INFO ] [MAIN ] DHR: Loaded 53753 existing records. [2025-10-31T18:17:05.060378] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-31T18:17:05.141551] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:17:05.142005] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-31T18:17:05.142380] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-31T18:17:05.147968] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-31T18:17:05.154672] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-31T18:17:05.189090] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-31T18:17:05.302073] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-31T18:17:05.561910] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:17:05.857673] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-31T18:17:06.657707] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-31T18:17:06.713939] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T18:17:06.724484] [INFO ] [REMOTE ] DGX: Full fetch complete (65845 records). [2025-10-31T18:17:06.724604] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-31T18:17:07.123403] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-31T18:17:07.123477] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-31T18:17:07.124249] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-31T18:17:07.124310] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-31T18:17:07.125484] [DEBUG] [LOCAL ] DGX: Trimmed 65845 records to 45053 (keeping 200 days of data) [2025-10-31T18:17:07.407353] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T18:17:07.422448] [DEBUG] [LOCAL ] DGX: Primary data saved (45053 records). [2025-10-31T18:17:07.427384] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-31T18:17:07.427912] [INFO ] [MAIN ] Update Progress: 614/2365 symbols completed. DGX took 33.3s. Estimated remaining: 3h 39m 44s. Rate: 8.0 symbols/min [2025-10-31T18:17:07.465042] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-31T18:17:07.604158] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:17:07.639376] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-31T18:17:07.685863] [DEBUG] [LOCAL ] DHT: Loaded 48135 existing records from primary storage. [2025-10-31T18:17:07.686156] [INFO ] [MAIN ] DHT: Loaded 48135 existing records. [2025-10-31T18:17:07.862761] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:17:07.862981] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-31T18:17:07.863050] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-31T18:17:07.864146] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-31T18:17:07.864206] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-31T18:17:08.232324] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:17:08.257630] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-31T18:17:08.916399] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T18:17:09.057665] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-31T18:17:09.857673] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-31T18:17:10.154356] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-31T18:17:10.480852] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-31T18:17:10.657668] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-31T18:17:10.914556] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-31T18:17:10.918932] [INFO ] [REMOTE ] DHF: Full fetch complete (29958 records). [2025-10-31T18:17:10.919012] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-31T18:17:11.291719] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-31T18:17:11.291809] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-31T18:17:11.292295] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-31T18:17:11.292336] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-31T18:17:11.293019] [DEBUG] [LOCAL ] DHF: Trimmed 29958 records to 20503 (keeping 200 days of data) [2025-10-31T18:17:11.427794] [DEBUG] [LOCAL ] DHF: Primary data saved (20503 records). [2025-10-31T18:17:11.427944] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-31T18:17:11.428055] [INFO ] [MAIN ] Update Progress: 615/2365 symbols completed. DHF took 25.7s. Estimated remaining: 3h 39m 27s. Rate: 8.0 symbols/min [2025-10-31T18:17:11.465687] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-31T18:17:11.661988] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:17:11.674973] [DEBUG] [LOCAL ] DHX: Loaded 13078 existing records from primary storage. [2025-10-31T18:17:11.675204] [INFO ] [MAIN ] DHX: Loaded 13078 existing records. [2025-10-31T18:17:11.880011] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:17:11.880508] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-31T18:17:11.880890] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-31T18:17:11.881288] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-31T18:17:11.881348] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-31T18:17:12.259132] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-31T18:17:12.323005] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-31T18:17:12.344810] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:17:13.057712] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-31T18:17:13.151146] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-31T18:17:13.844671] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-31T18:17:13.857601] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-31T18:17:14.521524] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T18:17:14.657687] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-31T18:17:15.352703] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T18:17:15.451368] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-31T18:17:15.461961] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-31T18:17:16.257631] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-31T18:17:16.313501] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-31T18:17:17.057682] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-31T18:17:17.686967] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T18:17:17.718829] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T18:17:17.857694] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-31T18:17:18.640000] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-31T18:17:18.657613] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-31T18:17:19.224711] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T18:17:19.457681] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-31T18:17:19.938102] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-31T18:17:20.257667] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-31T18:17:20.762010] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-31T18:17:21.057700] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-31T18:17:21.857629] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-31T18:17:22.501206] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T18:17:22.641184] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T18:17:22.657603] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-31T18:17:23.457694] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-31T18:17:24.070594] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T18:17:24.257624] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-31T18:17:25.057617] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-31T18:17:25.194088] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-31T18:17:25.407385] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T18:17:25.605373] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T18:17:25.857718] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-31T18:17:26.657627] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-31T18:17:26.670479] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T18:17:26.675250] [INFO ] [REMOTE ] DHX: Full fetch complete (21351 records). [2025-10-31T18:17:26.675359] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-31T18:17:26.675934] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:17:26.676018] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:17:26.676085] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:17:26.676133] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-31T18:17:26.676188] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-31T18:17:26.676224] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-31T18:17:26.676353] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-10-31T18:17:26.676423] [INFO ] [MAIN ] Update Progress: 616/2365 symbols completed. DHX took 15.2s. Estimated remaining: 3h 39m 41s. Rate: 8.0 symbols/min [2025-10-31T18:17:26.854689] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:17:26.866814] [DEBUG] [LOCAL ] DIAX: Loaded 12201 existing records from primary storage. [2025-10-31T18:17:26.867009] [INFO ] [MAIN ] DIAX: Loaded 12201 existing records. [2025-10-31T18:17:27.047323] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:17:27.047542] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-31T18:17:27.047587] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-31T18:17:27.047917] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-31T18:17:27.047974] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-31T18:17:27.395710] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:17:27.457618] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-31T18:17:28.182071] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T18:17:28.267975] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-31T18:17:28.273225] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-31T18:17:28.761892] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-31T18:17:29.057704] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-31T18:17:29.857689] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-31T18:17:30.382359] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-31T18:17:30.464574] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T18:17:30.657692] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-31T18:17:31.286526] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-31T18:17:31.457666] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-31T18:17:31.896666] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-31T18:17:32.257695] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-31T18:17:33.057673] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-31T18:17:33.857756] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-31T18:17:34.657695] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-31T18:17:34.868371] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-31T18:17:35.102676] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-10-31T18:17:35.457674] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-31T18:17:36.254679] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-31T18:17:36.265677] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-31T18:17:36.642731] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-31T18:17:36.750397] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-31T18:17:36.920022] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-31T18:17:37.057616] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-31T18:17:37.857687] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-31T18:17:38.657674] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-31T18:17:38.719675] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-31T18:17:39.316253] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-31T18:17:39.457623] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-31T18:17:39.909360] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T18:17:40.020965] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-31T18:17:40.032959] [INFO ] [REMOTE ] DHR: Full fetch complete (77050 records). [2025-10-31T18:17:40.033160] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-31T18:17:40.034103] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:17:40.034205] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:17:40.034270] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:17:40.034342] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-31T18:17:40.034407] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-31T18:17:40.034445] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-10-31T18:17:40.034571] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-10-31T18:17:40.034670] [INFO ] [MAIN ] Update Progress: 617/2365 symbols completed. DHR took 35.4s. Estimated remaining: 3h 39m 50s. Rate: 8.0 symbols/min [2025-10-31T18:17:40.206700] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:17:40.242339] [DEBUG] [LOCAL ] DIN: Loaded 36457 existing records from primary storage. [2025-10-31T18:17:40.242632] [INFO ] [MAIN ] DIN: Loaded 36457 existing records. [2025-10-31T18:17:40.263301] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-31T18:17:40.421165] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:17:40.421375] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-31T18:17:40.421430] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-31T18:17:40.421910] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-31T18:17:40.421968] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-31T18:17:40.782411] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:17:40.981776] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T18:17:41.057673] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-31T18:17:41.715129] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T18:17:41.857704] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-31T18:17:42.612751] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-31T18:17:42.615919] [INFO ] [REMOTE ] DIAX: Full fetch complete (17662 records). [2025-10-31T18:17:42.615991] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-31T18:17:42.667998] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-31T18:17:42.979175] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-31T18:17:42.979265] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-31T18:17:42.979689] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-31T18:17:42.979749] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-31T18:17:42.980297] [DEBUG] [LOCAL ] DIAX: Trimmed 17662 records to 12263 (keeping 200 days of data) [2025-10-31T18:17:43.050504] [DEBUG] [LOCAL ] DIAX: Primary data saved (12263 records). [2025-10-31T18:17:43.050627] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-31T18:17:43.050739] [INFO ] [MAIN ] Update Progress: 618/2365 symbols completed. DIAX took 16.4s. Estimated remaining: 3h 39m 30s. Rate: 8.0 symbols/min [2025-10-31T18:17:43.215281] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:17:43.215458] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-31T18:17:43.215495] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-31T18:17:43.215601] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-31T18:17:43.215666] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-31T18:17:43.215745] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-31T18:17:43.215787] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-31T18:17:43.462825] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-31T18:17:43.567427] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:17:44.195378] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-31T18:17:44.257614] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-31T18:17:44.722229] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:17:45.057674] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-31T18:17:45.573901] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T18:17:45.857711] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-31T18:17:46.657677] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-31T18:17:46.727967] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-31T18:17:46.768537] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T18:17:47.457677] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-31T18:17:48.135802] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T18:17:48.151264] [INFO ] [REMOTE ] DHT: Full fetch complete (70346 records). [2025-10-31T18:17:48.151531] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-31T18:17:48.262847] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-31T18:17:48.568476] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-31T18:17:48.568610] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-31T18:17:48.569611] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-31T18:17:48.569718] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-31T18:17:48.571276] [DEBUG] [LOCAL ] DHT: Trimmed 70346 records to 48510 (keeping 200 days of data) [2025-10-31T18:17:48.594454] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T18:17:48.892190] [DEBUG] [LOCAL ] DHT: Primary data saved (48510 records). [2025-10-31T18:17:48.892323] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-31T18:17:48.893405] [INFO ] [MAIN ] Update Progress: 619/2365 symbols completed. DHT took 41.5s. Estimated remaining: 3h 39m 17s. Rate: 8.0 symbols/min [2025-10-31T18:17:49.062809] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-31T18:17:49.064674] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:17:49.122468] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-10-31T18:17:49.122795] [INFO ] [MAIN ] DIS: Loaded 54178 existing records. [2025-10-31T18:17:49.299612] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:17:49.300384] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-31T18:17:49.300432] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-31T18:17:49.300864] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-31T18:17:49.300926] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-31T18:17:49.664813] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:17:49.705555] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-31T18:17:49.752459] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T18:17:49.764961] [INFO ] [REMOTE ] DHI: Full fetch complete (77400 records). [2025-10-31T18:17:49.765138] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-31T18:17:49.862879] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-31T18:17:50.154015] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-31T18:17:50.154105] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-31T18:17:50.155007] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-31T18:17:50.155070] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-31T18:17:50.156501] [DEBUG] [LOCAL ] DHI: Trimmed 77400 records to 54119 (keeping 200 days of data) [2025-10-31T18:17:50.484308] [DEBUG] [LOCAL ] DHI: Primary data saved (54119 records). [2025-10-31T18:17:50.484439] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-31T18:17:50.484513] [INFO ] [MAIN ] Update Progress: 620/2365 symbols completed. DHI took 53.8s. Estimated remaining: 3h 38m 53s. Rate: 8.0 symbols/min [2025-10-31T18:17:50.650850] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:17:50.651016] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-31T18:17:50.651072] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-31T18:17:50.651227] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-31T18:17:50.651281] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-31T18:17:50.651326] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-31T18:17:50.651359] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-31T18:17:50.662811] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-31T18:17:51.002740] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:17:51.337768] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T18:17:51.457621] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-31T18:17:51.847804] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-31T18:17:52.257674] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-31T18:17:52.625924] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-31T18:17:53.057759] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-31T18:17:53.757600] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T18:17:53.857624] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-31T18:17:54.270438] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T18:17:54.657682] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-31T18:17:54.961027] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-31T18:17:55.244137] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T18:17:55.457669] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-31T18:17:56.257668] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-31T18:17:56.907931] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T18:17:57.057664] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-31T18:17:57.426908] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T18:17:57.857675] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-31T18:17:58.589517] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-31T18:17:58.657616] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-31T18:17:59.457735] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-31T18:17:59.857388] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-31T18:17:59.936376] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T18:18:00.257613] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-31T18:18:01.057615] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-31T18:18:01.131381] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-31T18:18:01.857673] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-31T18:18:02.317451] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T18:18:02.617169] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-31T18:18:02.657718] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-31T18:18:02.953207] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-31T18:18:03.029200] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T18:18:03.457699] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-31T18:18:04.257741] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-31T18:18:05.057699] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-31T18:18:05.327025] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-31T18:18:05.529574] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-31T18:18:05.759593] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T18:18:05.772806] [INFO ] [REMOTE ] DINO: Full fetch complete (76659 records). [2025-10-31T18:18:05.773038] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-31T18:18:05.862862] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-31T18:18:06.205943] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-31T18:18:06.206062] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-31T18:18:06.207448] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-31T18:18:06.207541] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-31T18:18:06.209759] [DEBUG] [LOCAL ] DINO: Trimmed 76659 records to 53527 (keeping 200 days of data) [2025-10-31T18:18:06.556826] [DEBUG] [LOCAL ] DINO: Primary data saved (53527 records). [2025-10-31T18:18:06.557018] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-31T18:18:06.557108] [INFO ] [MAIN ] Update Progress: 621/2365 symbols completed. DINO took 23.5s. Estimated remaining: 3h 39m 9s. Rate: 8.0 symbols/min [2025-10-31T18:18:06.662014] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-31T18:18:06.737495] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:18:06.787312] [DEBUG] [LOCAL ] DK: Loaded 49391 existing records from primary storage. [2025-10-31T18:18:06.787756] [INFO ] [MAIN ] DK: Loaded 49391 existing records. [2025-10-31T18:18:06.933441] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-31T18:18:06.975434] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:18:06.975836] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-31T18:18:06.975890] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-31T18:18:06.977084] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-31T18:18:06.977145] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-31T18:18:07.360132] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:18:07.457743] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-31T18:18:07.818802] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-31T18:18:08.197885] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-31T18:18:08.257623] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-31T18:18:09.057670] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-31T18:18:09.311206] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-31T18:18:09.857731] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-31T18:18:09.994129] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-31T18:18:10.103714] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-31T18:18:10.657670] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-31T18:18:11.457687] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-31T18:18:11.748634] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T18:18:12.257689] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-31T18:18:12.715116] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:18:13.057707] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-31T18:18:13.270556] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T18:18:13.857743] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-31T18:18:14.207267] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T18:18:14.311158] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-31T18:18:14.311974] [INFO ] [REMOTE ] DIVY: Full fetch complete (1643 records). [2025-10-31T18:18:14.312040] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-31T18:18:14.312360] [FATAL] [VALIDATOR ] DIVY: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:18:14.312438] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:18:14.312479] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:18:14.312521] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-31T18:18:14.312599] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-31T18:18:14.312694] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-31T18:18:14.312755] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-31T18:18:14.312914] [INFO ] [MAIN ] Update Progress: 622/2365 symbols completed. DIVY took 23.8s. Estimated remaining: 3h 39m 2s. Rate: 8.0 symbols/min [2025-10-31T18:18:14.493864] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:18:14.510349] [DEBUG] [LOCAL ] DKL: Loaded 15939 existing records from primary storage. [2025-10-31T18:18:14.510561] [INFO ] [MAIN ] DKL: Loaded 15939 existing records. [2025-10-31T18:18:14.663443] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-31T18:18:14.703160] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:18:14.703520] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-31T18:18:14.703568] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-31T18:18:14.703789] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-31T18:18:14.703843] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-31T18:18:15.051075] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:18:15.457708] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-31T18:18:16.257686] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-31T18:18:16.383249] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-31T18:18:16.467466] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-31T18:18:17.057671] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-31T18:18:17.640117] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T18:18:17.838458] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-31T18:18:17.857683] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-31T18:18:18.641383] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-31T18:18:18.657627] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-31T18:18:19.457689] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-31T18:18:20.028815] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T18:18:20.257689] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-31T18:18:20.463692] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T18:18:21.057697] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-31T18:18:21.608762] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-31T18:18:21.617069] [INFO ] [REMOTE ] DIN: Full fetch complete (54128 records). [2025-10-31T18:18:21.617233] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-31T18:18:21.859030] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-31T18:18:22.041263] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-31T18:18:22.041482] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-31T18:18:22.047685] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-31T18:18:22.055543] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-31T18:18:22.055987] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T18:18:22.062577] [DEBUG] [LOCAL ] DIN: Trimmed 54128 records to 36684 (keeping 200 days of data) [2025-10-31T18:18:22.302354] [DEBUG] [LOCAL ] DIN: Primary data saved (36684 records). [2025-10-31T18:18:22.302528] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-31T18:18:22.302615] [INFO ] [MAIN ] Update Progress: 623/2365 symbols completed. DIN took 42.3s. Estimated remaining: 3h 38m 56s. Rate: 8.0 symbols/min [2025-10-31T18:18:22.467051] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:18:22.510408] [DEBUG] [LOCAL ] DKS: Loaded 49202 existing records from primary storage. [2025-10-31T18:18:22.510731] [INFO ] [MAIN ] DKS: Loaded 49202 existing records. [2025-10-31T18:18:22.673906] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-31T18:18:22.724990] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:18:22.725268] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-31T18:18:22.725333] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-31T18:18:22.725532] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-31T18:18:22.725574] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-31T18:18:23.109372] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:18:23.457718] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-31T18:18:23.698429] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-31T18:18:24.216892] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-31T18:18:24.248557] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-31T18:18:24.258767] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-31T18:18:24.923388] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T18:18:25.057716] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-31T18:18:25.719970] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T18:18:25.857671] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-31T18:18:26.643233] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T18:18:26.657605] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-31T18:18:27.439880] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T18:18:27.442906] [INFO ] [REMOTE ] DKL: Full fetch complete (27270 records). [2025-10-31T18:18:27.442979] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-31T18:18:27.443420] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:18:27.443516] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:18:27.443558] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:18:27.443631] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-31T18:18:27.443728] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-31T18:18:27.443770] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-10-31T18:18:27.443884] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-10-31T18:18:27.443951] [INFO ] [MAIN ] Update Progress: 624/2365 symbols completed. DKL took 13.1s. Estimated remaining: 3h 38m 42s. Rate: 8.0 symbols/min [2025-10-31T18:18:27.464007] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-31T18:18:27.611997] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:18:27.642396] [DEBUG] [LOCAL ] DLB: Loaded 32309 existing records from primary storage. [2025-10-31T18:18:27.642670] [INFO ] [MAIN ] DLB: Loaded 32309 existing records. [2025-10-31T18:18:27.817082] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:18:27.817272] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-31T18:18:27.817318] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-31T18:18:27.817546] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-31T18:18:27.817585] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-31T18:18:28.165932] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:18:28.257622] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-31T18:18:29.057713] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-31T18:18:29.372544] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:18:29.585025] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-31T18:18:29.857673] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-31T18:18:30.227451] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T18:18:30.657679] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-31T18:18:31.457611] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-31T18:18:31.597820] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-31T18:18:32.063303] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T18:18:32.257632] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-31T18:18:32.784758] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T18:18:32.904688] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T18:18:32.917231] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-31T18:18:32.917400] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-31T18:18:33.062756] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-31T18:18:33.360669] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-31T18:18:33.360765] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-31T18:18:33.361620] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-31T18:18:33.361700] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-31T18:18:33.363149] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 54568 (keeping 200 days of data) [2025-10-31T18:18:33.709969] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-10-31T18:18:33.710107] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-31T18:18:33.711108] [INFO ] [MAIN ] Update Progress: 625/2365 symbols completed. DIS took 44.8s. Estimated remaining: 3h 38m 31s. Rate: 8.0 symbols/min [2025-10-31T18:18:33.881833] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:18:33.862834] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-31T18:18:33.891502] [DEBUG] [LOCAL ] DLNG: Loaded 5904 existing records from primary storage. [2025-10-31T18:18:33.891742] [INFO ] [MAIN ] DLNG: Loaded 5904 existing records. [2025-10-31T18:18:34.086046] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:18:34.086496] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-31T18:18:34.086569] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-31T18:18:34.086912] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-31T18:18:34.087056] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-31T18:18:34.223573] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T18:18:34.485573] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:18:34.657624] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-31T18:18:35.302360] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-31T18:18:35.322002] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-31T18:18:35.457677] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-31T18:18:36.257735] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-31T18:18:36.516686] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T18:18:36.827881] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T18:18:37.057672] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-31T18:18:37.857671] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-31T18:18:38.239966] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T18:18:38.657672] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-31T18:18:39.060027] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T18:18:39.113245] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-31T18:18:39.457762] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-31T18:18:40.257665] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-31T18:18:40.506019] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T18:18:41.057680] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-31T18:18:41.590345] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-31T18:18:41.601029] [INFO ] [REMOTE ] DK: Full fetch complete (70730 records). [2025-10-31T18:18:41.601190] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-31T18:18:41.862756] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-31T18:18:42.003452] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-31T18:18:42.003550] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-31T18:18:42.004584] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-31T18:18:42.004682] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-31T18:18:42.006447] [DEBUG] [LOCAL ] DK: Trimmed 70730 records to 49706 (keeping 200 days of data) [2025-10-31T18:18:42.118811] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T18:18:42.331435] [DEBUG] [LOCAL ] DK: Primary data saved (49706 records). [2025-10-31T18:18:42.331567] [INFO ] [MAIN ] DK: Full history saved. [2025-10-31T18:18:42.332412] [INFO ] [MAIN ] Update Progress: 626/2365 symbols completed. DK took 35.8s. Estimated remaining: 3h 38m 26s. Rate: 8.0 symbols/min [2025-10-31T18:18:42.499788] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:18:42.554710] [DEBUG] [LOCAL ] DLR: Loaded 50904 existing records from primary storage. [2025-10-31T18:18:42.555082] [INFO ] [MAIN ] DLR: Loaded 50904 existing records. [2025-10-31T18:18:42.659334] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-31T18:18:42.738401] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:18:42.738554] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-31T18:18:42.738600] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-31T18:18:42.739557] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-31T18:18:42.739617] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-31T18:18:43.109987] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:18:43.361043] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-31T18:18:43.457676] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-31T18:18:43.675687] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-31T18:18:44.079627] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-31T18:18:44.257710] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-31T18:18:44.863762] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-31T18:18:45.057675] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-31T18:18:45.857633] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-31T18:18:46.566119] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-31T18:18:46.657621] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-31T18:18:46.915209] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T18:18:47.457711] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-31T18:18:47.841671] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-31T18:18:48.019218] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:18:48.257612] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-31T18:18:49.057746] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-31T18:18:49.474114] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-31T18:18:49.795006] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-31T18:18:49.857620] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-31T18:18:50.323578] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-31T18:18:50.657691] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-31T18:18:51.457696] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-31T18:18:51.992961] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T18:18:52.257717] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-31T18:18:52.693023] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T18:18:52.725129] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T18:18:53.057673] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-31T18:18:53.857686] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-31T18:18:54.011118] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-31T18:18:54.657671] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-31T18:18:55.245839] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T18:18:55.457667] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-31T18:18:55.974283] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T18:18:55.982744] [INFO ] [REMOTE ] DLB: Full fetch complete (47465 records). [2025-10-31T18:18:55.982914] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-31T18:18:56.263784] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-31T18:18:56.363774] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-31T18:18:56.363850] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-31T18:18:56.364550] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-31T18:18:56.364607] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-31T18:18:56.365603] [DEBUG] [LOCAL ] DLB: Trimmed 47465 records to 32616 (keeping 200 days of data) [2025-10-31T18:18:56.558825] [DEBUG] [LOCAL ] DLB: Primary data saved (32616 records). [2025-10-31T18:18:56.558951] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-31T18:18:56.559028] [INFO ] [MAIN ] Update Progress: 627/2365 symbols completed. DLB took 29.1s. Estimated remaining: 3h 38m 37s. Rate: 7.9 symbols/min [2025-10-31T18:18:56.731480] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:18:56.731756] [DEBUG] [LOCAL ] DLX: No existing data file found in primary storage. [2025-10-31T18:18:56.731827] [WARN ] [MAIN ] DLX: No existing data found, performing full refresh instead. [2025-10-31T18:18:56.731977] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-31T18:18:56.732040] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-31T18:18:56.732148] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-31T18:18:56.732243] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-31T18:18:57.059998] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-31T18:18:57.141025] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:18:57.143188] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-31T18:18:57.810969] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-31T18:18:57.812200] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T18:18:57.826724] [INFO ] [REMOTE ] DLNG: Full fetch complete (10657 records). [2025-10-31T18:18:57.827446] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-31T18:18:57.828124] [FATAL] [VALIDATOR ] DLNG: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:18:57.828204] [FATAL] [MAIN ] DLNG: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:18:57.828242] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:18:57.828279] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-31T18:18:57.828332] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-31T18:18:57.828368] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-10-31T18:18:57.828529] [DEBUG] [LOCAL ] DLNG: Deleted derivative data file. [2025-10-31T18:18:57.828630] [INFO ] [MAIN ] Update Progress: 628/2365 symbols completed. DLNG took 24.1s. Estimated remaining: 3h 38m 12s. Rate: 8.0 symbols/min [2025-10-31T18:18:57.862802] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-31T18:18:58.052090] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:18:58.052279] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-10-31T18:18:58.052317] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-10-31T18:18:58.052429] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-31T18:18:58.052492] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-31T18:18:58.052559] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-31T18:18:58.052602] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-31T18:18:58.441378] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:18:58.657674] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-31T18:18:59.311899] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T18:18:59.457674] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-31T18:19:00.068326] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T18:19:00.257682] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-31T18:19:01.057671] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-31T18:19:01.272343] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T18:19:01.648084] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-31T18:19:01.658760] [INFO ] [REMOTE ] DKS: Full fetch complete (71201 records). [2025-10-31T18:19:01.658925] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-31T18:19:01.864820] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-31T18:19:02.067266] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-31T18:19:02.067356] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-31T18:19:02.068294] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-31T18:19:02.068368] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-31T18:19:02.069879] [DEBUG] [LOCAL ] DKS: Trimmed 71201 records to 49535 (keeping 200 days of data) [2025-10-31T18:19:02.393429] [DEBUG] [LOCAL ] DKS: Primary data saved (49535 records). [2025-10-31T18:19:02.393567] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-31T18:19:02.393669] [INFO ] [MAIN ] Update Progress: 629/2365 symbols completed. DKS took 40.1s. Estimated remaining: 3h 37m 57s. Rate: 8.0 symbols/min [2025-10-31T18:19:02.565532] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:19:02.571262] [DEBUG] [LOCAL ] DMA: Loaded 4708 existing records from primary storage. [2025-10-31T18:19:02.571461] [INFO ] [MAIN ] DMA: Loaded 4708 existing records. [2025-10-31T18:19:02.662618] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-31T18:19:02.769075] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:19:02.769411] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-31T18:19:02.769484] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-31T18:19:02.769807] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-31T18:19:02.769873] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-31T18:19:02.958164] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T18:19:03.142674] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:19:03.174025] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-31T18:19:03.457699] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-31T18:19:03.615950] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T18:19:04.126708] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-31T18:19:04.257663] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-31T18:19:04.913346] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T18:19:05.057681] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-31T18:19:05.506348] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-31T18:19:05.857688] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-31T18:19:06.340957] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-31T18:19:06.657680] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-31T18:19:07.054763] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T18:19:07.457667] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-31T18:19:07.797030] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-31T18:19:08.257683] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-31T18:19:09.057674] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-31T18:19:09.652003] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T18:19:09.857693] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-31T18:19:10.218720] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T18:19:10.254607] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-31T18:19:10.657706] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-31T18:19:11.459800] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-31T18:19:11.464946] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T18:19:12.257713] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-31T18:19:12.875050] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-31T18:19:13.052378] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-31T18:19:13.057605] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-31T18:19:13.736405] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T18:19:13.857675] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-31T18:19:14.596337] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T18:19:14.657629] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-31T18:19:15.312714] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T18:19:15.457692] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-31T18:19:16.257696] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-31T18:19:16.288951] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T18:19:17.057696] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-31T18:19:17.696512] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T18:19:17.857730] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-31T18:19:18.127291] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-31T18:19:18.657672] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-31T18:19:18.883961] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-31T18:19:18.890937] [INFO ] [REMOTE ] DLY: Full fetch complete (29153 records). [2025-10-31T18:19:18.891071] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-31T18:19:19.265473] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-31T18:19:19.265568] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-31T18:19:19.266088] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-31T18:19:19.266148] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-31T18:19:19.266863] [DEBUG] [LOCAL ] DLY: Trimmed 29153 records to 21013 (keeping 200 days of data) [2025-10-31T18:19:19.393539] [DEBUG] [LOCAL ] DLY: Primary data saved (21013 records). [2025-10-31T18:19:19.393692] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-31T18:19:19.393775] [INFO ] [MAIN ] Update Progress: 630/2365 symbols completed. DLY took 21.6s. Estimated remaining: 3h 38m 15s. Rate: 7.9 symbols/min [2025-10-31T18:19:19.467052] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-31T18:19:19.569073] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:19:19.569361] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-31T18:19:19.569431] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-31T18:19:19.569788] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-31T18:19:19.569897] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-31T18:19:19.570038] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-31T18:19:19.570126] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-31T18:19:19.787130] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T18:19:19.909621] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-31T18:19:19.989623] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:19:20.257688] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-31T18:19:20.644210] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-31T18:19:21.057685] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-31T18:19:21.513418] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-31T18:19:21.857679] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-31T18:19:22.264384] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T18:19:22.657679] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-31T18:19:23.374220] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T18:19:23.457709] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-31T18:19:23.910531] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-31T18:19:23.912164] [INFO ] [REMOTE ] DMA: Full fetch complete (6426 records). [2025-10-31T18:19:23.912240] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-31T18:19:24.267075] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-31T18:19:24.267238] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-31T18:19:24.267439] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-31T18:19:24.266843] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-31T18:19:24.267543] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-31T18:19:24.268955] [DEBUG] [LOCAL ] DMA: Trimmed 6426 records to 4722 (keeping 200 days of data) [2025-10-31T18:19:24.297065] [DEBUG] [LOCAL ] DMA: Primary data saved (4722 records). [2025-10-31T18:19:24.297154] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-31T18:19:24.297226] [INFO ] [MAIN ] Update Progress: 631/2365 symbols completed. DMA took 21.9s. Estimated remaining: 3h 38m 0s. Rate: 8.0 symbols/min [2025-10-31T18:19:24.464303] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:19:24.473895] [DEBUG] [LOCAL ] DMO: Loaded 9408 existing records from primary storage. [2025-10-31T18:19:24.474074] [INFO ] [MAIN ] DMO: Loaded 9408 existing records. [2025-10-31T18:19:24.645234] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:19:24.645417] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-31T18:19:24.645463] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-31T18:19:24.645777] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-31T18:19:24.645833] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-31T18:19:24.996346] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:19:25.057620] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-31T18:19:25.183586] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-31T18:19:25.857722] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-31T18:19:26.405395] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T18:19:26.657676] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-31T18:19:26.881466] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T18:19:27.457709] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-31T18:19:27.889228] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T18:19:28.257626] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-31T18:19:28.430070] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T18:19:29.057694] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-31T18:19:29.558175] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T18:19:29.857618] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-31T18:19:30.024136] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-31T18:19:30.035605] [INFO ] [REMOTE ] DLR: Full fetch complete (74144 records). [2025-10-31T18:19:30.035742] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-31T18:19:30.419950] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-31T18:19:30.420027] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-31T18:19:30.420879] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-31T18:19:30.420939] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-31T18:19:30.422244] [DEBUG] [LOCAL ] DLR: Trimmed 74144 records to 51258 (keeping 200 days of data) [2025-10-31T18:19:30.657623] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-31T18:19:30.750285] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T18:19:30.763637] [DEBUG] [LOCAL ] DLR: Primary data saved (51258 records). [2025-10-31T18:19:30.763763] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-31T18:19:30.764484] [INFO ] [MAIN ] Update Progress: 632/2365 symbols completed. DLR took 48.4s. Estimated remaining: 3h 37m 50s. Rate: 8.0 symbols/min [2025-10-31T18:19:30.931933] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:19:30.975827] [DEBUG] [LOCAL ] DNA: Loaded 48585 existing records from primary storage. [2025-10-31T18:19:30.976111] [INFO ] [MAIN ] DNA: Loaded 48585 existing records. [2025-10-31T18:19:31.154027] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:19:31.154303] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-31T18:19:31.154352] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-31T18:19:31.155078] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-31T18:19:31.155137] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-31T18:19:31.263478] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-31T18:19:31.462749] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-31T18:19:31.528143] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:19:32.257737] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-31T18:19:32.498485] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T18:19:32.504124] [INFO ] [REMOTE ] DLX: Full fetch complete (41524 records). [2025-10-31T18:19:32.504218] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-31T18:19:32.884613] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-31T18:19:32.884717] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-31T18:19:32.885268] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-31T18:19:32.885312] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-31T18:19:32.886166] [DEBUG] [LOCAL ] DLX: Trimmed 41524 records to 27950 (keeping 200 days of data) [2025-10-31T18:19:33.049825] [DEBUG] [LOCAL ] DLX: Primary data saved (27950 records). [2025-10-31T18:19:33.049989] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-31T18:19:33.050083] [INFO ] [MAIN ] Update Progress: 633/2365 symbols completed. DLX took 36.5s. Estimated remaining: 3h 37m 28s. Rate: 8.0 symbols/min [2025-10-31T18:19:33.063043] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-31T18:19:33.218390] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:19:33.255989] [DEBUG] [LOCAL ] DNOW: Loaded 43945 existing records from primary storage. [2025-10-31T18:19:33.256267] [INFO ] [MAIN ] DNOW: Loaded 43945 existing records. [2025-10-31T18:19:33.428787] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:19:33.428999] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-31T18:19:33.429064] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-31T18:19:33.429836] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-31T18:19:33.429901] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-31T18:19:33.784177] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:19:33.792876] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T18:19:33.828132] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-31T18:19:33.857615] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-31T18:19:34.389929] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T18:19:34.657686] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-31T18:19:35.206520] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T18:19:35.457611] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-31T18:19:36.257667] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-31T18:19:36.529071] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T18:19:36.850855] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-31T18:19:37.057698] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-31T18:19:37.857667] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-31T18:19:38.216945] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T18:19:38.508093] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T18:19:38.657692] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-31T18:19:39.181248] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T18:19:39.457675] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-31T18:19:40.257680] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-31T18:19:41.033371] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T18:19:41.057602] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-31T18:19:41.318008] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-31T18:19:41.551449] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T18:19:41.857685] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-31T18:19:42.657710] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-31T18:19:43.081103] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T18:19:43.370245] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-31T18:19:43.457636] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-31T18:19:44.011443] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-31T18:19:44.257682] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-31T18:19:45.057684] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-31T18:19:45.526313] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-31T18:19:45.772818] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-31T18:19:45.857639] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-31T18:19:46.657686] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-31T18:19:46.982954] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T18:19:47.184093] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T18:19:47.457683] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-31T18:19:48.007755] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T18:19:48.257723] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-31T18:19:49.057736] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-31T18:19:49.742455] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T18:19:49.810159] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T18:19:49.857667] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-31T18:19:50.657679] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-31T18:19:51.245723] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-31T18:19:51.382861] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T18:19:51.457711] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-31T18:19:52.037119] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T18:19:52.039519] [INFO ] [REMOTE ] DMO: Full fetch complete (14212 records). [2025-10-31T18:19:52.039588] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-31T18:19:52.263265] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-31T18:19:52.429074] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-31T18:19:52.429150] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-31T18:19:52.429481] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-31T18:19:52.429519] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-31T18:19:52.429995] [DEBUG] [LOCAL ] DMO: Trimmed 14212 records to 9466 (keeping 200 days of data) [2025-10-31T18:19:52.485719] [DEBUG] [LOCAL ] DMO: Primary data saved (9466 records). [2025-10-31T18:19:52.485850] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-31T18:19:52.485928] [INFO ] [MAIN ] Update Progress: 634/2365 symbols completed. DMO took 28.2s. Estimated remaining: 3h 37m 53s. Rate: 7.9 symbols/min [2025-10-31T18:19:52.668686] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:19:52.699309] [DEBUG] [LOCAL ] DNP: Loaded 33020 existing records from primary storage. [2025-10-31T18:19:52.699574] [INFO ] [MAIN ] DNP: Loaded 33020 existing records. [2025-10-31T18:19:52.872043] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:19:52.872288] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-31T18:19:52.872336] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-31T18:19:52.872537] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-31T18:19:52.872592] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-31T18:19:53.064532] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-31T18:19:53.223212] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:19:53.547689] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T18:19:53.857687] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-31T18:19:54.253764] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T18:19:54.657685] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-31T18:19:54.978990] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T18:19:55.457687] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-31T18:19:56.234684] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-31T18:19:56.257608] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-31T18:19:56.351274] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-31T18:19:57.057736] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-31T18:19:57.664127] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T18:19:57.857622] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-31T18:19:58.000188] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-31T18:19:58.657668] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-31T18:19:59.102096] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T18:19:59.457685] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-31T18:19:59.572677] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T18:20:00.156236] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-31T18:20:00.159024] [INFO ] [REMOTE ] DMB: Full fetch complete (14460 records). [2025-10-31T18:20:00.159103] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-31T18:20:00.262734] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-31T18:20:00.535135] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-31T18:20:00.535265] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-31T18:20:00.535665] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-31T18:20:00.535726] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-31T18:20:00.536441] [DEBUG] [LOCAL ] DMB: Trimmed 14460 records to 10609 (keeping 200 days of data) [2025-10-31T18:20:00.600441] [DEBUG] [LOCAL ] DMB: Primary data saved (10609 records). [2025-10-31T18:20:00.600572] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-31T18:20:00.600664] [INFO ] [MAIN ] Update Progress: 635/2365 symbols completed. DMB took 41.2s. Estimated remaining: 3h 37m 47s. Rate: 7.9 symbols/min [2025-10-31T18:20:00.772830] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:00.825393] [DEBUG] [LOCAL ] DOC: Loaded 53944 existing records from primary storage. [2025-10-31T18:20:00.825705] [INFO ] [MAIN ] DOC: Loaded 53944 existing records. [2025-10-31T18:20:01.005421] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:20:01.005659] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-31T18:20:01.005734] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-31T18:20:01.005949] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-31T18:20:01.006006] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-31T18:20:01.062791] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-31T18:20:01.401917] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:20:01.857684] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-31T18:20:02.432098] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-31T18:20:02.657707] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-31T18:20:02.955540] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-31T18:20:03.152464] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T18:20:03.457670] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-31T18:20:04.257679] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-31T18:20:04.468088] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-31T18:20:04.479121] [INFO ] [REMOTE ] DNA: Full fetch complete (70944 records). [2025-10-31T18:20:04.479234] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-31T18:20:04.882721] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-31T18:20:04.882908] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-31T18:20:04.883951] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-31T18:20:04.884031] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-31T18:20:04.896798] [DEBUG] [LOCAL ] DNA: Trimmed 70944 records to 48923 (keeping 200 days of data) [2025-10-31T18:20:04.919080] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-31T18:20:05.086567] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-31T18:20:05.208536] [DEBUG] [LOCAL ] DNA: Primary data saved (48923 records). [2025-10-31T18:20:05.208706] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-31T18:20:05.209335] [INFO ] [MAIN ] Update Progress: 636/2365 symbols completed. DNA took 34.4s. Estimated remaining: 3h 37m 31s. Rate: 7.9 symbols/min [2025-10-31T18:20:05.377589] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:05.428726] [DEBUG] [LOCAL ] DOCN: Loaded 51480 existing records from primary storage. [2025-10-31T18:20:05.429088] [INFO ] [MAIN ] DOCN: Loaded 51480 existing records. [2025-10-31T18:20:05.611109] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:20:05.611336] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-31T18:20:05.611453] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-31T18:20:05.611872] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-31T18:20:05.611929] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-31T18:20:05.858433] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-31T18:20:05.977161] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:20:06.010964] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-31T18:20:06.461018] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T18:20:06.657677] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-31T18:20:07.153626] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T18:20:07.457676] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-31T18:20:08.079815] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T18:20:08.090162] [INFO ] [REMOTE ] DNOW: Full fetch complete (63959 records). [2025-10-31T18:20:08.090275] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-31T18:20:08.265020] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-31T18:20:08.486795] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-31T18:20:08.486936] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-31T18:20:08.487897] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-31T18:20:08.488055] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-31T18:20:08.509154] [DEBUG] [LOCAL ] DNOW: Trimmed 63959 records to 44276 (keeping 200 days of data) [2025-10-31T18:20:08.511208] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-31T18:20:08.771540] [DEBUG] [LOCAL ] DNOW: Primary data saved (44276 records). [2025-10-31T18:20:08.771706] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-31T18:20:08.771797] [INFO ] [MAIN ] Update Progress: 637/2365 symbols completed. DNOW took 35.7s. Estimated remaining: 3h 37m 13s. Rate: 8.0 symbols/min [2025-10-31T18:20:09.057698] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-31T18:20:09.752561] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-31T18:20:09.857728] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-31T18:20:10.125075] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T18:20:10.657733] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-31T18:20:11.457722] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-31T18:20:11.590698] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-31T18:20:12.161594] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T18:20:12.257683] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-31T18:20:12.483443] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T18:20:13.057726] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-31T18:20:13.505944] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:20:13.857709] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-31T18:20:14.303396] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T18:20:14.311397] [INFO ] [REMOTE ] DNP: Full fetch complete (48254 records). [2025-10-31T18:20:14.311618] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-31T18:20:14.662743] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-31T18:20:14.716274] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-31T18:20:14.716352] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-31T18:20:14.716993] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-31T18:20:14.717055] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-31T18:20:14.718304] [DEBUG] [LOCAL ] DNP: Trimmed 48254 records to 33222 (keeping 200 days of data) [2025-10-31T18:20:14.921431] [DEBUG] [LOCAL ] DNP: Primary data saved (33222 records). [2025-10-31T18:20:14.921568] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-31T18:20:14.921670] [INFO ] [MAIN ] Update Progress: 638/2365 symbols completed. DNP took 22.4s. Estimated remaining: 3h 37m 2s. Rate: 8.0 symbols/min [2025-10-31T18:20:15.159145] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T18:20:15.457747] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-31T18:20:18.275595] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (3.61 seconds). [2025-10-31T18:20:18.287194] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-31T18:20:18.422589] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-10-31T18:20:18.432772] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-31T18:20:19.896152] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-31T18:20:19.908202] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-31T18:20:19.938009] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-31T18:20:19.949061] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-31T18:20:21.448006] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-31T18:20:21.460313] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-31T18:20:21.552359] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-31T18:20:21.563063] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-31T18:20:22.954225] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T18:20:22.966235] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-31T18:20:23.005432] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T18:20:23.016373] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-31T18:20:24.325238] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T18:20:24.336529] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-31T18:20:24.722496] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-31T18:20:24.733981] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-31T18:20:25.595370] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T18:20:25.607343] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-31T18:20:26.239126] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T18:20:26.250395] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-31T18:20:27.630763] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-31T18:20:27.644080] [INFO ] [REMOTE ] DOC: Full fetch complete (77625 records). [2025-10-31T18:20:27.644248] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-31T18:20:28.046424] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-31T18:20:28.046545] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-31T18:20:28.047572] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-31T18:20:28.047729] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-31T18:20:28.049399] [DEBUG] [LOCAL ] DOC: Trimmed 77625 records to 54334 (keeping 200 days of data) [2025-10-31T18:20:28.204611] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-31T18:20:28.276783] [INFO ] [REMOTE ] DOCN: Full fetch complete (73334 records). [2025-10-31T18:20:28.304015] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-31T18:20:28.843685] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-31T18:20:28.843795] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-31T18:20:28.852271] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-31T18:20:28.852927] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-31T18:20:28.859512] [DEBUG] [LOCAL ] DOCN: Trimmed 73334 records to 51853 (keeping 200 days of data) [2025-10-31T18:20:28.866121] [DEBUG] [LOCAL ] DOC: Primary data saved (54334 records). [2025-10-31T18:20:28.866249] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-31T18:20:28.867433] [INFO ] [MAIN ] Update Progress: 639/2365 symbols completed. DOC took 28.3s. Estimated remaining: 3h 37m 12s. Rate: 7.9 symbols/min [2025-10-31T18:20:29.188528] [DEBUG] [LOCAL ] DOCN: Primary data saved (51853 records). [2025-10-31T18:20:29.188683] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-31T18:20:29.189272] [INFO ] [MAIN ] Update Progress: 640/2365 symbols completed. DOCN took 24.0s. Estimated remaining: 3h 36m 44s. Rate: 8.0 symbols/min [2025-10-31T18:20:29.802341] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:29.846212] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:29.873893] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:29.923116] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:29.923708] [DEBUG] [LOCAL ] DOUG: No existing data file found in primary storage. [2025-10-31T18:20:29.923768] [WARN ] [MAIN ] DOUG: No existing data found, performing full refresh instead. [2025-10-31T18:20:29.923951] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-31T18:20:29.924004] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-31T18:20:29.924054] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-10-31T18:20:29.924092] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-31T18:20:30.277227] [DEBUG] [LOCAL ] DOCS: Loaded 50407 existing records from primary storage. [2025-10-31T18:20:30.236583] [DEBUG] [LOCAL ] DOLE: Loaded 39389 existing records from primary storage. [2025-10-31T18:20:30.298169] [INFO ] [MAIN ] DOCS: Loaded 50407 existing records. [2025-10-31T18:20:30.298281] [INFO ] [MAIN ] DOLE: Loaded 39389 existing records. [2025-10-31T18:20:30.448610] [DEBUG] [LOCAL ] DOV: Loaded 45891 existing records from primary storage. [2025-10-31T18:20:30.555258] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:20:30.571051] [INFO ] [MAIN ] DOV: Loaded 45891 existing records. [2025-10-31T18:20:30.588484] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-31T18:20:30.723411] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:20:30.799792] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-31T18:20:30.844013] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:20:30.856297] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-31T18:20:30.844127] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-31T18:20:30.868991] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-31T18:20:30.876985] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-31T18:20:30.877036] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-31T18:20:30.880607] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-31T18:20:30.880710] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-31T18:20:31.140682] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:20:31.166700] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-31T18:20:31.173252] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-31T18:20:31.179093] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-31T18:20:31.194616] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-31T18:20:31.893874] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:20:31.929135] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:20:31.939878] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-31T18:20:31.945336] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-31T18:20:32.083674] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:20:32.084043] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-31T18:20:32.104751] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T18:20:32.112591] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-31T18:20:33.156444] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T18:20:33.167949] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-31T18:20:33.239454] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T18:20:33.250154] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-31T18:20:33.290570] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T18:20:33.299763] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-31T18:20:33.344891] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:20:33.353620] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-31T18:20:34.166857] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T18:20:34.174301] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-31T18:20:34.254451] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T18:20:34.260947] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-31T18:20:34.366384] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T18:20:34.657617] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-31T18:20:34.880103] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-31T18:20:35.133416] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-31T18:20:35.361897] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T18:20:35.457687] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-31T18:20:35.814371] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T18:20:36.257741] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-31T18:20:36.512997] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T18:20:37.057697] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-31T18:20:37.343041] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T18:20:37.857672] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-31T18:20:38.475331] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T18:20:38.657726] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-31T18:20:38.931747] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T18:20:39.457686] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-31T18:20:39.838017] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T18:20:40.257690] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-31T18:20:40.749998] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T18:20:41.057710] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-31T18:20:41.414203] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T18:20:41.857633] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-31T18:20:42.394426] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T18:20:42.597237] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T18:20:42.657632] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-31T18:20:43.457676] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-31T18:20:43.677482] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T18:20:44.257698] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-31T18:20:44.813689] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T18:20:45.057691] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-31T18:20:45.579821] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T18:20:45.857629] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-31T18:20:46.014380] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T18:20:46.657633] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-31T18:20:47.462405] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-31T18:20:47.470814] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-31T18:20:47.736173] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T18:20:47.742978] [INFO ] [REMOTE ] DOUG: Full fetch complete (49205 records). [2025-10-31T18:20:47.743110] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-31T18:20:48.122943] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-31T18:20:48.123042] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-31T18:20:48.123699] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-31T18:20:48.123764] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-31T18:20:48.124925] [DEBUG] [LOCAL ] DOUG: Trimmed 49205 records to 33919 (keeping 200 days of data) [2025-10-31T18:20:48.265694] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-31T18:20:48.318185] [DEBUG] [LOCAL ] DOUG: Primary data saved (33919 records). [2025-10-31T18:20:48.318306] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-31T18:20:48.318378] [INFO ] [MAIN ] Update Progress: 641/2365 symbols completed. DOUG took 19.1s. Estimated remaining: 3h 37m 8s. Rate: 7.9 symbols/min [2025-10-31T18:20:48.484061] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:48.533005] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-31T18:20:48.533315] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-10-31T18:20:48.712319] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:20:48.712665] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-31T18:20:48.712777] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-31T18:20:48.713894] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-31T18:20:48.713949] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-31T18:20:49.077498] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-31T18:20:49.082495] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:20:49.123083] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-31T18:20:49.786079] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-31T18:20:49.857672] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-31T18:20:50.186281] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T18:20:50.657712] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-31T18:20:51.374805] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T18:20:51.457717] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-31T18:20:51.795678] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T18:20:52.257705] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-31T18:20:52.529628] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T18:20:53.057675] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-31T18:20:53.668045] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T18:20:53.857695] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-31T18:20:54.108504] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T18:20:54.657667] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-31T18:20:55.271113] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T18:20:55.457697] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-31T18:20:55.957718] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T18:20:56.257684] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-31T18:20:56.864043] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T18:20:57.057682] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-31T18:20:57.439012] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-31T18:20:57.448420] [INFO ] [REMOTE ] DOLE: Full fetch complete (54835 records). [2025-10-31T18:20:57.448516] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-31T18:20:57.814906] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-31T18:20:57.814978] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-31T18:20:57.815553] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-31T18:20:57.815592] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-31T18:20:57.816570] [DEBUG] [LOCAL ] DOLE: Trimmed 54835 records to 39661 (keeping 200 days of data) [2025-10-31T18:20:57.870076] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-31T18:20:58.048870] [DEBUG] [LOCAL ] DOLE: Primary data saved (39661 records). [2025-10-31T18:20:58.049018] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-31T18:20:58.049108] [INFO ] [MAIN ] Update Progress: 642/2365 symbols completed. DOLE took 28.9s. Estimated remaining: 3h 37m 6s. Rate: 7.9 symbols/min [2025-10-31T18:20:58.213124] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:58.213231] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-10-31T18:20:58.213267] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-10-31T18:20:58.213370] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-31T18:20:58.213409] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-31T18:20:58.213449] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-31T18:20:58.213479] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-31T18:20:58.565136] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:20:58.596219] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-31T18:20:58.606916] [INFO ] [REMOTE ] DOV: Full fetch complete (66467 records). [2025-10-31T18:20:58.607022] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-31T18:20:58.668926] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-31T18:20:58.987733] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-31T18:20:58.987909] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-31T18:20:58.988745] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-31T18:20:58.988824] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-31T18:20:58.990252] [DEBUG] [LOCAL ] DOV: Trimmed 66467 records to 46247 (keeping 200 days of data) [2025-10-31T18:20:59.134082] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T18:20:59.312365] [DEBUG] [LOCAL ] DOV: Primary data saved (46247 records). [2025-10-31T18:20:59.312471] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-31T18:20:59.313211] [INFO ] [MAIN ] Update Progress: 643/2365 symbols completed. DOV took 30.1s. Estimated remaining: 3h 36m 42s. Rate: 7.9 symbols/min [2025-10-31T18:20:59.458830] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-31T18:20:59.481336] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:20:59.482179] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-10-31T18:20:59.482231] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-10-31T18:20:59.482339] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-31T18:20:59.482380] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-31T18:20:59.482420] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-31T18:20:59.482450] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-31T18:20:59.888870] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:21:00.259845] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-31T18:21:00.265546] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-31T18:21:01.057680] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-31T18:21:01.456554] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-31T18:21:01.468328] [INFO ] [REMOTE ] DOCS: Full fetch complete (73501 records). [2025-10-31T18:21:01.468493] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-31T18:21:01.636372] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-31T18:21:01.865449] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-31T18:21:01.913489] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-31T18:21:01.913569] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-31T18:21:01.914412] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-31T18:21:01.914475] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-31T18:21:01.915806] [DEBUG] [LOCAL ] DOCS: Trimmed 73501 records to 50728 (keeping 200 days of data) [2025-10-31T18:21:02.200442] [DEBUG] [LOCAL ] DOCS: Primary data saved (50728 records). [2025-10-31T18:21:02.200562] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-31T18:21:02.200636] [INFO ] [MAIN ] Update Progress: 644/2365 symbols completed. DOCS took 33.0s. Estimated remaining: 3h 36m 22s. Rate: 8.0 symbols/min [2025-10-31T18:21:02.366417] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:21:02.400472] [DEBUG] [LOCAL ] DRD: Loaded 38081 existing records from primary storage. [2025-10-31T18:21:02.400950] [INFO ] [MAIN ] DRD: Loaded 38081 existing records. [2025-10-31T18:21:02.581914] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:21:02.582122] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-31T18:21:02.582196] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-31T18:21:02.583080] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-31T18:21:02.583141] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-31T18:21:02.660616] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-31T18:21:02.964007] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:21:02.990960] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T18:21:03.027994] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-31T18:21:03.457603] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-31T18:21:03.495530] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T18:21:04.257682] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-31T18:21:04.997523] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-31T18:21:05.057629] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-31T18:21:05.282564] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T18:21:05.857672] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-31T18:21:06.598486] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-31T18:21:06.657704] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-31T18:21:06.895853] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T18:21:07.457680] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-31T18:21:07.622589] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T18:21:08.035952] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-31T18:21:08.257618] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-31T18:21:09.057673] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-31T18:21:09.403427] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T18:21:09.857683] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-31T18:21:10.081275] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T18:21:10.657665] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-31T18:21:11.457623] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-31T18:21:11.640674] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-31T18:21:11.816904] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T18:21:12.257709] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-31T18:21:12.622089] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T18:21:13.057752] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-31T18:21:13.711680] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T18:21:13.857716] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-31T18:21:14.007217] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-31T18:21:14.354184] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T18:21:14.657743] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-31T18:21:15.215291] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-31T18:21:15.457714] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-31T18:21:16.091308] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-31T18:21:16.257683] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-31T18:21:17.057739] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-31T18:21:17.508218] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T18:21:17.706746] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-31T18:21:17.857699] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-31T18:21:18.449326] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T18:21:18.657702] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-31T18:21:19.457633] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-31T18:21:19.598776] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T18:21:20.074142] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-31T18:21:20.257684] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-31T18:21:21.057729] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-31T18:21:21.774836] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T18:21:21.777950] [INFO ] [REMOTE ] DPG: Full fetch complete (18886 records). [2025-10-31T18:21:21.778023] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-31T18:21:21.862765] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-31T18:21:22.163261] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-31T18:21:22.255318] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-31T18:21:22.255394] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-31T18:21:22.255841] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-31T18:21:22.255903] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-31T18:21:22.256491] [DEBUG] [LOCAL ] DPG: Trimmed 18886 records to 13212 (keeping 200 days of data) [2025-10-31T18:21:22.343746] [DEBUG] [LOCAL ] DPG: Primary data saved (13212 records). [2025-10-31T18:21:22.343879] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-31T18:21:22.343951] [INFO ] [MAIN ] Update Progress: 645/2365 symbols completed. DPG took 24.3s. Estimated remaining: 3h 36m 48s. Rate: 7.9 symbols/min [2025-10-31T18:21:22.553334] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:21:22.599353] [DEBUG] [LOCAL ] DRH: Loaded 50419 existing records from primary storage. [2025-10-31T18:21:22.599752] [INFO ] [MAIN ] DRH: Loaded 50419 existing records. [2025-10-31T18:21:22.664405] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-31T18:21:22.797963] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:21:22.798169] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-31T18:21:22.798216] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-31T18:21:22.799193] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-31T18:21:22.799250] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-31T18:21:23.149753] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:21:23.170095] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T18:21:23.457684] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-31T18:21:24.023151] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T18:21:24.257674] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-31T18:21:24.638266] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T18:21:25.057684] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-31T18:21:25.361485] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T18:21:25.857727] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-31T18:21:26.657725] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-31T18:21:27.003573] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-31T18:21:27.016095] [INFO ] [REMOTE ] DOW: Full fetch complete (77911 records). [2025-10-31T18:21:27.016269] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-31T18:21:27.422895] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-31T18:21:27.437566] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-31T18:21:27.438609] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-31T18:21:27.438708] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-31T18:21:27.464298] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-31T18:21:27.466229] [DEBUG] [LOCAL ] DOW: Trimmed 77911 records to 54513 (keeping 200 days of data) [2025-10-31T18:21:27.468671] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-31T18:21:27.813622] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-10-31T18:21:27.813844] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-31T18:21:27.814857] [INFO ] [MAIN ] Update Progress: 646/2365 symbols completed. DOW took 39.5s. Estimated remaining: 3h 36m 35s. Rate: 7.9 symbols/min [2025-10-31T18:21:27.961632] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:21:28.019552] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:21:28.063913] [DEBUG] [LOCAL ] DRI: Loaded 47697 existing records from primary storage. [2025-10-31T18:21:28.064223] [INFO ] [MAIN ] DRI: Loaded 47697 existing records. [2025-10-31T18:21:28.235918] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:21:28.236130] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-31T18:21:28.236177] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-31T18:21:28.237154] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-31T18:21:28.237212] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-31T18:21:28.267375] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-31T18:21:28.584850] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:21:28.661405] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T18:21:29.057738] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-31T18:21:29.857663] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-31T18:21:29.900083] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T18:21:29.910958] [INFO ] [REMOTE ] DQ: Full fetch complete (64036 records). [2025-10-31T18:21:29.911107] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-31T18:21:30.305321] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-31T18:21:30.305563] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-31T18:21:30.306440] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-31T18:21:30.306541] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-31T18:21:30.318115] [DEBUG] [LOCAL ] DQ: Trimmed 64036 records to 44406 (keeping 200 days of data) [2025-10-31T18:21:30.338249] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T18:21:30.595104] [DEBUG] [LOCAL ] DQ: Primary data saved (44406 records). [2025-10-31T18:21:30.595264] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-31T18:21:30.595353] [INFO ] [MAIN ] Update Progress: 647/2365 symbols completed. DQ took 31.3s. Estimated remaining: 3h 36m 15s. Rate: 7.9 symbols/min [2025-10-31T18:21:30.662936] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-31T18:21:30.767702] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:21:30.776427] [DEBUG] [LOCAL ] DRLL: Loaded 8460 existing records from primary storage. [2025-10-31T18:21:30.776595] [INFO ] [MAIN ] DRLL: Loaded 8460 existing records. [2025-10-31T18:21:30.960472] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:21:30.960807] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-31T18:21:30.960893] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-31T18:21:30.961428] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-31T18:21:30.961670] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-31T18:21:31.087348] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T18:21:31.345091] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:21:31.457707] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-31T18:21:32.035695] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T18:21:32.257717] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-31T18:21:32.817154] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T18:21:33.057677] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-31T18:21:33.437447] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T18:21:33.857725] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-31T18:21:34.462852] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T18:21:34.472813] [INFO ] [REMOTE ] DRD: Full fetch complete (52815 records). [2025-10-31T18:21:34.472950] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-31T18:21:34.662751] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-31T18:21:34.850150] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-31T18:21:34.850224] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-31T18:21:34.850915] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-31T18:21:34.850977] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-31T18:21:34.851976] [DEBUG] [LOCAL ] DRD: Trimmed 52815 records to 38360 (keeping 200 days of data) [2025-10-31T18:21:35.088925] [DEBUG] [LOCAL ] DRD: Primary data saved (38360 records). [2025-10-31T18:21:35.089040] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-31T18:21:35.089112] [INFO ] [MAIN ] Update Progress: 648/2365 symbols completed. DRD took 32.9s. Estimated remaining: 3h 35m 59s. Rate: 7.9 symbols/min [2025-10-31T18:21:35.257262] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:21:35.308733] [DEBUG] [LOCAL ] DSL: Loaded 28902 existing records from primary storage. [2025-10-31T18:21:35.310243] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T18:21:35.310454] [INFO ] [MAIN ] DSL: Loaded 28902 existing records. [2025-10-31T18:21:35.462721] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-31T18:21:35.497612] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:21:35.497783] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-31T18:21:35.497828] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-31T18:21:35.498395] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-31T18:21:35.498451] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-31T18:21:35.842814] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:21:36.088978] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-31T18:21:36.118052] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T18:21:36.257619] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-31T18:21:37.057741] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-31T18:21:37.554411] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T18:21:37.579196] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T18:21:37.857667] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-31T18:21:38.657742] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-31T18:21:39.311957] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T18:21:39.457671] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-31T18:21:39.889915] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T18:21:40.257669] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-31T18:21:40.306555] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T18:21:41.057672] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-31T18:21:41.531531] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T18:21:41.857722] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-31T18:21:42.201284] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T18:21:42.657699] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-31T18:21:42.763716] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T18:21:43.457703] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-31T18:21:43.854005] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T18:21:44.257665] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-31T18:21:44.761087] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:21:44.837171] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-31T18:21:45.057885] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-31T18:21:45.857630] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-31T18:21:45.917407] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-31T18:21:46.423348] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-31T18:21:46.657938] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-31T18:21:47.457677] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-31T18:21:47.928553] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T18:21:47.993969] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-31T18:21:48.257679] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-31T18:21:48.782601] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T18:21:49.057696] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-31T18:21:49.857677] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-31T18:21:50.384121] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T18:21:50.657681] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-31T18:21:51.177190] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T18:21:51.175766] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-31T18:21:51.457686] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-31T18:21:52.257681] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-31T18:21:52.418350] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-31T18:21:52.843198] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T18:21:52.854531] [INFO ] [REMOTE ] DRI: Full fetch complete (69423 records). [2025-10-31T18:21:52.854683] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-31T18:21:53.067380] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-31T18:21:53.243933] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-31T18:21:53.244024] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-31T18:21:53.244848] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-31T18:21:53.244912] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-31T18:21:53.246327] [DEBUG] [LOCAL ] DRI: Trimmed 69423 records to 48056 (keeping 200 days of data) [2025-10-31T18:21:53.548484] [DEBUG] [LOCAL ] DRI: Primary data saved (48056 records). [2025-10-31T18:21:53.548856] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-31T18:21:53.550179] [INFO ] [MAIN ] Update Progress: 649/2365 symbols completed. DRI took 25.7s. Estimated remaining: 3h 36m 20s. Rate: 7.9 symbols/min [2025-10-31T18:21:53.675441] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-31T18:21:53.735854] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:21:53.750125] [DEBUG] [LOCAL ] DSM: Loaded 14036 existing records from primary storage. [2025-10-31T18:21:53.750337] [INFO ] [MAIN ] DSM: Loaded 14036 existing records. [2025-10-31T18:21:53.862822] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-31T18:21:53.930694] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:21:53.930896] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-31T18:21:53.930942] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-31T18:21:53.931236] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-31T18:21:53.931276] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-31T18:21:54.297102] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:21:54.657691] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-31T18:21:55.104171] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T18:21:55.334846] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-31T18:21:55.457669] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-31T18:21:56.108192] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T18:21:56.110381] [INFO ] [REMOTE ] DRLL: Full fetch complete (14279 records). [2025-10-31T18:21:56.110484] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-31T18:21:56.262728] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-31T18:21:56.495849] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-31T18:21:56.495937] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-31T18:21:56.496295] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-31T18:21:56.496337] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-31T18:21:56.497111] [DEBUG] [LOCAL ] DRLL: Trimmed 14279 records to 8494 (keeping 200 days of data) [2025-10-31T18:21:56.551518] [DEBUG] [LOCAL ] DRLL: Primary data saved (8494 records). [2025-10-31T18:21:56.551669] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-31T18:21:56.551767] [INFO ] [MAIN ] Update Progress: 650/2365 symbols completed. DRLL took 26.0s. Estimated remaining: 3h 36m 1s. Rate: 7.9 symbols/min [2025-10-31T18:21:56.718056] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:21:56.721226] [DEBUG] [LOCAL ] DSMC: Loaded 1743 existing records from primary storage. [2025-10-31T18:21:56.721363] [INFO ] [MAIN ] DSMC: Loaded 1743 existing records. [2025-10-31T18:21:56.896369] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:21:56.896568] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-31T18:21:56.896616] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-31T18:21:56.896958] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-31T18:21:56.897015] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-31T18:21:57.064097] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-31T18:21:57.279251] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:21:57.280926] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T18:21:57.857744] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-31T18:21:58.463484] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T18:21:58.475470] [INFO ] [REMOTE ] DRH: Full fetch complete (72023 records). [2025-10-31T18:21:58.475706] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-31T18:21:58.673059] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T18:21:58.666006] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-31T18:21:58.889920] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-31T18:21:58.890021] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-31T18:21:58.890917] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-31T18:21:58.890980] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-31T18:21:58.892404] [DEBUG] [LOCAL ] DRH: Trimmed 72023 records to 50806 (keeping 200 days of data) [2025-10-31T18:21:59.182880] [DEBUG] [LOCAL ] DRH: Primary data saved (50806 records). [2025-10-31T18:21:59.183013] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-31T18:21:59.183088] [INFO ] [MAIN ] Update Progress: 651/2365 symbols completed. DRH took 36.8s. Estimated remaining: 3h 35m 40s. Rate: 7.9 symbols/min [2025-10-31T18:21:59.347249] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:21:59.368255] [DEBUG] [LOCAL ] DSU: Loaded 22584 existing records from primary storage. [2025-10-31T18:21:59.368485] [INFO ] [MAIN ] DSU: Loaded 22584 existing records. [2025-10-31T18:21:59.464386] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-31T18:21:59.545972] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:21:59.546175] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-31T18:21:59.546221] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-31T18:21:59.546719] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-31T18:21:59.546789] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-31T18:21:59.891428] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T18:21:59.941291] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:22:00.257711] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-31T18:22:00.667461] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T18:22:01.057665] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-31T18:22:01.493397] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T18:22:01.646523] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-31T18:22:01.857716] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-31T18:22:02.184774] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-31T18:22:02.657685] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-31T18:22:03.457706] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-31T18:22:03.619741] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-31T18:22:04.257678] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-31T18:22:04.312929] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T18:22:04.593304] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-31T18:22:05.057673] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-31T18:22:05.402784] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-31T18:22:05.857662] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-31T18:22:06.657681] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-31T18:22:06.756311] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-31T18:22:07.457676] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-31T18:22:07.494202] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T18:22:08.113009] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T18:22:08.257688] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-31T18:22:08.960441] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T18:22:09.057678] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-31T18:22:09.816724] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T18:22:09.857610] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-31T18:22:10.559560] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T18:22:10.657670] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-31T18:22:11.457624] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-31T18:22:11.478109] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-31T18:22:12.257699] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-31T18:22:12.515150] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-31T18:22:12.523203] [INFO ] [REMOTE ] DSL: Full fetch complete (42287 records). [2025-10-31T18:22:12.523296] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-31T18:22:12.704460] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-31T18:22:12.908072] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-31T18:22:12.908145] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-31T18:22:12.908737] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-31T18:22:12.908797] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-31T18:22:12.909667] [DEBUG] [LOCAL ] DSL: Trimmed 42287 records to 29177 (keeping 200 days of data) [2025-10-31T18:22:13.065741] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-31T18:22:13.083371] [DEBUG] [LOCAL ] DSL: Primary data saved (29177 records). [2025-10-31T18:22:13.083463] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-31T18:22:13.083537] [INFO ] [MAIN ] Update Progress: 652/2365 symbols completed. DSL took 38.0s. Estimated remaining: 3h 35m 49s. Rate: 7.9 symbols/min [2025-10-31T18:22:13.256871] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:22:13.278888] [DEBUG] [LOCAL ] DSX: Loaded 23140 existing records from primary storage. [2025-10-31T18:22:13.279124] [INFO ] [MAIN ] DSX: Loaded 23140 existing records. [2025-10-31T18:22:13.456376] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:22:13.456665] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-31T18:22:13.456726] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-31T18:22:13.457004] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-31T18:22:13.457064] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-31T18:22:13.806737] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:22:13.857630] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-31T18:22:14.081006] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T18:22:14.657620] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-31T18:22:14.729712] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T18:22:15.226215] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T18:22:15.457703] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-31T18:22:16.181706] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T18:22:16.257671] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-31T18:22:17.015730] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T18:22:17.057612] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-31T18:22:17.862722] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-31T18:22:17.873399] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T18:22:18.657637] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-31T18:22:18.777331] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T18:22:18.890099] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-31T18:22:19.457676] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-31T18:22:20.264973] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-31T18:22:20.266299] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T18:22:20.796362] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T18:22:21.057672] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-31T18:22:21.667804] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-31T18:22:21.857669] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-31T18:22:22.435857] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-31T18:22:22.657702] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-31T18:22:23.457633] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-31T18:22:23.471186] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T18:22:23.474832] [INFO ] [REMOTE ] DSM: Full fetch complete (24328 records). [2025-10-31T18:22:23.474911] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-31T18:22:23.846862] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-31T18:22:23.846941] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-31T18:22:23.847450] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-31T18:22:23.847563] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-31T18:22:23.848271] [DEBUG] [LOCAL ] DSM: Trimmed 24328 records to 14151 (keeping 200 days of data) [2025-10-31T18:22:23.929272] [DEBUG] [LOCAL ] DSM: Primary data saved (14151 records). [2025-10-31T18:22:23.929440] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-31T18:22:23.929543] [INFO ] [MAIN ] Update Progress: 653/2365 symbols completed. DSM took 30.4s. Estimated remaining: 3h 35m 50s. Rate: 7.9 symbols/min [2025-10-31T18:22:24.106202] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:22:24.158867] [DEBUG] [LOCAL ] DT: Loaded 53286 existing records from primary storage. [2025-10-31T18:22:24.159198] [INFO ] [MAIN ] DT: Loaded 53286 existing records. [2025-10-31T18:22:24.259711] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-31T18:22:24.351789] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:22:24.352270] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-31T18:22:24.352343] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-31T18:22:24.353555] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-31T18:22:24.353615] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-31T18:22:24.479970] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T18:22:24.731370] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:22:24.767227] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-31T18:22:25.057703] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-31T18:22:25.857692] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-31T18:22:26.443242] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T18:22:26.657694] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-31T18:22:26.954958] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-31T18:22:26.971014] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T18:22:26.976476] [INFO ] [REMOTE ] DSU: Full fetch complete (32738 records). [2025-10-31T18:22:26.976561] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-31T18:22:27.340946] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-31T18:22:27.341019] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-31T18:22:27.341536] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-31T18:22:27.341574] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-31T18:22:27.342273] [DEBUG] [LOCAL ] DSU: Trimmed 32738 records to 22716 (keeping 200 days of data) [2025-10-31T18:22:27.458668] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-31T18:22:27.476588] [DEBUG] [LOCAL ] DSU: Primary data saved (22716 records). [2025-10-31T18:22:27.476705] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-31T18:22:27.476791] [INFO ] [MAIN ] Update Progress: 654/2365 symbols completed. DSU took 28.3s. Estimated remaining: 3h 35m 32s. Rate: 7.9 symbols/min [2025-10-31T18:22:27.649924] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:22:27.650093] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-31T18:22:27.650138] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-31T18:22:27.650271] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-31T18:22:27.650335] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-31T18:22:27.650383] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-31T18:22:27.650416] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-31T18:22:27.895872] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-31T18:22:28.009112] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:22:28.257619] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-31T18:22:28.712883] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-31T18:22:29.057637] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-31T18:22:29.453135] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-31T18:22:29.454135] [INFO ] [REMOTE ] DSMC: Full fetch complete (2895 records). [2025-10-31T18:22:29.454202] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-31T18:22:29.454517] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:22:29.454594] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:22:29.454687] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:22:29.454757] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-31T18:22:29.454817] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-31T18:22:29.454851] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-31T18:22:29.455011] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-31T18:22:29.455163] [INFO ] [MAIN ] Update Progress: 655/2365 symbols completed. DSMC took 32.9s. Estimated remaining: 3h 35m 10s. Rate: 7.9 symbols/min [2025-10-31T18:22:29.641221] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:22:29.685072] [DEBUG] [LOCAL ] DTE: Loaded 47224 existing records from primary storage. [2025-10-31T18:22:29.685353] [INFO ] [MAIN ] DTE: Loaded 47224 existing records. [2025-10-31T18:22:29.859910] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-31T18:22:29.859832] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:22:29.860917] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-31T18:22:29.860981] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-31T18:22:29.861412] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-31T18:22:29.861482] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-31T18:22:30.216499] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:22:30.657669] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-31T18:22:30.994054] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-31T18:22:31.193330] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-31T18:22:31.457720] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-31T18:22:31.789549] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-31T18:22:32.257636] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-31T18:22:33.057750] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-31T18:22:33.509042] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T18:22:33.857702] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-31T18:22:34.195862] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T18:22:34.657681] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-31T18:22:35.027924] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T18:22:35.122278] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T18:22:35.457616] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-31T18:22:36.257682] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-31T18:22:36.325627] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-31T18:22:36.622479] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-31T18:22:37.057698] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-31T18:22:37.857697] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-31T18:22:38.409692] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T18:22:38.657688] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-31T18:22:38.870470] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T18:22:39.457666] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-31T18:22:39.874078] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T18:22:40.257716] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-31T18:22:40.760865] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T18:22:41.057701] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-31T18:22:41.405048] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-31T18:22:41.579343] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T18:22:41.857624] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-31T18:22:42.657719] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-31T18:22:43.108911] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T18:22:43.457684] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-31T18:22:43.955870] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T18:22:44.257671] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-31T18:22:44.558705] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T18:22:45.057675] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-31T18:22:45.455596] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T18:22:45.857680] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-31T18:22:46.270806] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T18:22:46.657689] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-31T18:22:46.713815] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-31T18:22:46.725708] [INFO ] [REMOTE ] DT: Full fetch complete (76870 records). [2025-10-31T18:22:46.725838] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-31T18:22:47.134147] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-31T18:22:47.134221] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-31T18:22:47.135085] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-31T18:22:47.135146] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-31T18:22:47.136524] [DEBUG] [LOCAL ] DT: Trimmed 76870 records to 53675 (keeping 200 days of data) [2025-10-31T18:22:47.439788] [DEBUG] [LOCAL ] DT: Primary data saved (53675 records). [2025-10-31T18:22:47.439917] [INFO ] [MAIN ] DT: Full history saved. [2025-10-31T18:22:47.441055] [INFO ] [MAIN ] Update Progress: 656/2365 symbols completed. DT took 23.5s. Estimated remaining: 3h 35m 30s. Rate: 7.9 symbols/min [2025-10-31T18:22:47.462854] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-31T18:22:47.625560] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:22:47.625735] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-31T18:22:47.625780] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-31T18:22:47.625885] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-31T18:22:47.625925] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-31T18:22:47.625966] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-31T18:22:47.625997] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-31T18:22:47.987935] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-31T18:22:47.992243] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:22:48.023746] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T18:22:48.257696] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-31T18:22:49.057731] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-31T18:22:49.622614] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T18:22:49.857687] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-31T18:22:49.882361] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-31T18:22:50.333538] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-31T18:22:50.657712] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-31T18:22:51.457695] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-31T18:22:51.497622] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T18:22:51.736275] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-31T18:22:52.257694] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-31T18:22:53.057740] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-31T18:22:53.088133] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T18:22:53.515083] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-31T18:22:53.857688] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-31T18:22:54.161135] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-31T18:22:54.657669] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-31T18:22:54.956735] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-31T18:22:55.457688] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-31T18:22:56.257669] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-31T18:22:56.714142] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T18:22:56.830700] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-31T18:22:56.832071] [INFO ] [REMOTE ] DTB: Full fetch complete (6439 records). [2025-10-31T18:22:56.832151] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-31T18:22:57.064358] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-31T18:22:57.198523] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-31T18:22:57.198596] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-31T18:22:57.198834] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-31T18:22:57.198880] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-31T18:22:57.199275] [DEBUG] [LOCAL ] DTB: Trimmed 6439 records to 4870 (keeping 200 days of data) [2025-10-31T18:22:57.230468] [DEBUG] [LOCAL ] DTB: Primary data saved (4870 records). [2025-10-31T18:22:57.230604] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-31T18:22:57.230710] [INFO ] [MAIN ] Update Progress: 657/2365 symbols completed. DTB took 29.8s. Estimated remaining: 3h 35m 28s. Rate: 7.9 symbols/min [2025-10-31T18:22:57.406328] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:22:57.406522] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-31T18:22:57.406566] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-31T18:22:57.406710] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-31T18:22:57.406761] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-31T18:22:57.406803] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-31T18:22:57.406833] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-31T18:22:57.760096] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:22:57.857637] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-31T18:22:58.280167] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T18:22:58.369534] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T18:22:58.657712] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-31T18:22:59.457676] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-31T18:23:00.257691] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-31T18:23:01.057741] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-31T18:23:04.878510] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (4.62 seconds). [2025-10-31T18:23:04.880274] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-31T18:23:05.123969] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (5.67 seconds). [2025-10-31T18:23:05.134344] [INFO ] [REMOTE ] DTE: Full fetch complete (68853 records). [2025-10-31T18:23:05.134462] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-31T18:23:05.382101] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (4.32 seconds). [2025-10-31T18:23:05.418241] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-31T18:23:05.546174] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-31T18:23:05.546373] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-31T18:23:05.547510] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-31T18:23:05.547589] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-31T18:23:05.562383] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (6.90 seconds). [2025-10-31T18:23:05.568389] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-31T18:23:05.568508] [DEBUG] [LOCAL ] DTE: Trimmed 68853 records to 47594 (keeping 200 days of data) [2025-10-31T18:23:05.878094] [DEBUG] [LOCAL ] DTE: Primary data saved (47594 records). [2025-10-31T18:23:05.878274] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-31T18:23:05.879200] [INFO ] [MAIN ] Update Progress: 658/2365 symbols completed. DTE took 36.4s. Estimated remaining: 3h 35m 23s. Rate: 7.9 symbols/min [2025-10-31T18:23:06.061952] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:06.062114] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-31T18:23:06.062151] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-31T18:23:06.062262] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-31T18:23:06.062303] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-31T18:23:06.062343] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-31T18:23:06.062375] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-31T18:23:06.430576] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:06.430970] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-31T18:23:06.445297] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-31T18:23:06.451298] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-31T18:23:06.907105] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T18:23:06.907408] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-31T18:23:06.907498] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:23:06.907566] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-31T18:23:06.907671] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:23:06.907775] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-31T18:23:06.907893] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-31T18:23:06.907963] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-31T18:23:06.908037] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-31T18:23:06.908094] [INFO ] [MAIN ] Update Progress: 659/2365 symbols completed. DTK took 1.0s. Estimated remaining: 3h 34m 59s. Rate: 7.9 symbols/min [2025-10-31T18:23:07.019738] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-31T18:23:07.031914] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-31T18:23:07.096511] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:07.142390] [DEBUG] [LOCAL ] DTM: Loaded 43877 existing records from primary storage. [2025-10-31T18:23:07.142814] [INFO ] [MAIN ] DTM: Loaded 43877 existing records. [2025-10-31T18:23:07.264049] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-31T18:23:07.268170] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-31T18:23:07.356072] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:23:07.356257] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-31T18:23:07.356820] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-31T18:23:07.358529] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-31T18:23:07.366163] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-31T18:23:07.376492] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T18:23:07.376003] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-31T18:23:07.438517] [INFO ] [REMOTE ] DSX: Full fetch complete (34906 records). [2025-10-31T18:23:07.469830] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-31T18:23:07.459390] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-31T18:23:07.799140] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-31T18:23:07.917573] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T18:23:08.126036] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:08.201216] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-31T18:23:08.201337] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-31T18:23:08.201941] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-31T18:23:08.202002] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-31T18:23:08.202838] [DEBUG] [LOCAL ] DSX: Trimmed 34906 records to 23243 (keeping 200 days of data) [2025-10-31T18:23:08.283449] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-31T18:23:08.334281] [DEBUG] [LOCAL ] DSX: Primary data saved (23243 records). [2025-10-31T18:23:08.334408] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-31T18:23:08.334484] [INFO ] [MAIN ] Update Progress: 660/2365 symbols completed. DSX took 55.3s. Estimated remaining: 3h 34m 35s. Rate: 7.9 symbols/min [2025-10-31T18:23:08.501507] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:08.507094] [DEBUG] [LOCAL ] DTW: Loaded 4587 existing records from primary storage. [2025-10-31T18:23:08.507239] [INFO ] [MAIN ] DTW: Loaded 4587 existing records. [2025-10-31T18:23:08.683239] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:23:08.683404] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-31T18:23:08.683452] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-31T18:23:08.683679] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-31T18:23:08.683737] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-31T18:23:08.806949] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T18:23:09.043639] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:09.057606] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-31T18:23:09.559973] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-31T18:23:09.857755] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-31T18:23:10.285944] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-31T18:23:10.657680] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-31T18:23:11.457911] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-31T18:23:11.807183] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-31T18:23:11.969812] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T18:23:12.257744] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-31T18:23:12.548046] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-31T18:23:13.057952] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-31T18:23:13.427001] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-31T18:23:13.857689] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-31T18:23:14.235853] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-31T18:23:14.657699] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-31T18:23:15.009331] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-31T18:23:15.010735] [INFO ] [REMOTE ] DTF: Full fetch complete (1737 records). [2025-10-31T18:23:15.010825] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-31T18:23:15.230616] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-31T18:23:15.230852] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:23:15.230922] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:23:15.230995] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-31T18:23:15.231059] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-31T18:23:15.231096] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-31T18:23:15.231137] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-31T18:23:15.231192] [INFO ] [MAIN ] Update Progress: 661/2365 symbols completed. DTF took 27.8s. Estimated remaining: 3h 34m 26s. Rate: 7.9 symbols/min [2025-10-31T18:23:15.439393] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:15.471802] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-31T18:23:15.498688] [DEBUG] [LOCAL ] DUK: Loaded 53807 existing records from primary storage. [2025-10-31T18:23:15.499098] [INFO ] [MAIN ] DUK: Loaded 53807 existing records. [2025-10-31T18:23:15.674599] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:23:15.675031] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-31T18:23:15.675077] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-31T18:23:15.676048] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-31T18:23:15.676105] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-31T18:23:15.979160] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-31T18:23:16.037972] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:16.257703] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-31T18:23:16.682688] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-31T18:23:17.057678] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-31T18:23:17.450262] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T18:23:17.857694] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-31T18:23:18.657669] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-31T18:23:19.192255] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-31T18:23:19.192082] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T18:23:19.457720] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-31T18:23:20.257728] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-31T18:23:20.561397] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T18:23:20.887438] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T18:23:20.889245] [INFO ] [REMOTE ] DTG: Full fetch complete (8331 records). [2025-10-31T18:23:20.889317] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-31T18:23:21.065883] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-31T18:23:21.260220] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-31T18:23:21.260301] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-31T18:23:21.260529] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-31T18:23:21.260569] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-31T18:23:21.261114] [DEBUG] [LOCAL ] DTG: Trimmed 8331 records to 5617 (keeping 200 days of data) [2025-10-31T18:23:21.294662] [DEBUG] [LOCAL ] DTG: Primary data saved (5617 records). [2025-10-31T18:23:21.294801] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-31T18:23:21.294873] [INFO ] [MAIN ] Update Progress: 662/2365 symbols completed. DTG took 24.1s. Estimated remaining: 3h 34m 15s. Rate: 7.9 symbols/min [2025-10-31T18:23:21.462343] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:21.468931] [DEBUG] [LOCAL ] DUKB: Loaded 5906 existing records from primary storage. [2025-10-31T18:23:21.469181] [INFO ] [MAIN ] DUKB: Loaded 5906 existing records. [2025-10-31T18:23:21.649077] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:23:21.649306] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-31T18:23:21.649352] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-31T18:23:21.649573] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-31T18:23:21.649633] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-31T18:23:21.862914] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-31T18:23:22.009777] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:22.428760] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-31T18:23:22.480597] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T18:23:22.657726] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-31T18:23:23.457675] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-31T18:23:24.066396] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T18:23:24.257695] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-31T18:23:24.869923] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-31T18:23:24.873246] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-31T18:23:25.057679] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-31T18:23:25.857718] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-31T18:23:26.305475] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T18:23:26.657722] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-31T18:23:27.457672] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-31T18:23:27.621235] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-31T18:23:27.908422] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T18:23:28.075694] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T18:23:28.257678] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-31T18:23:29.057686] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-31T18:23:29.461465] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T18:23:29.857687] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-31T18:23:30.386292] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T18:23:30.657714] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-31T18:23:30.945690] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T18:23:31.136151] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T18:23:31.457696] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-31T18:23:31.856284] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T18:23:32.257686] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-31T18:23:33.057738] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-31T18:23:33.479776] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-31T18:23:33.481667] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T18:23:33.857713] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-31T18:23:34.320502] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T18:23:34.657720] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-31T18:23:35.161503] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-31T18:23:35.457726] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-31T18:23:36.257713] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-31T18:23:36.664822] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T18:23:37.057709] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-31T18:23:37.636140] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T18:23:37.636885] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T18:23:37.650788] [INFO ] [REMOTE ] DTW: Full fetch complete (6875 records). [2025-10-31T18:23:37.650987] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-31T18:23:37.867323] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-31T18:23:38.020928] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-31T18:23:38.021007] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-31T18:23:38.021203] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-31T18:23:38.021243] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-31T18:23:38.021683] [DEBUG] [LOCAL ] DTW: Trimmed 6875 records to 4644 (keeping 200 days of data) [2025-10-31T18:23:38.051001] [DEBUG] [LOCAL ] DTW: Primary data saved (4644 records). [2025-10-31T18:23:38.051120] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-31T18:23:38.051196] [INFO ] [MAIN ] Update Progress: 663/2365 symbols completed. DTW took 29.7s. Estimated remaining: 3h 34m 31s. Rate: 7.9 symbols/min [2025-10-31T18:23:38.237189] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:38.284897] [DEBUG] [LOCAL ] DV: Loaded 51552 existing records from primary storage. [2025-10-31T18:23:38.285217] [INFO ] [MAIN ] DV: Loaded 51552 existing records. [2025-10-31T18:23:38.476679] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:23:38.476970] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-31T18:23:38.477045] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-31T18:23:38.477945] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-31T18:23:38.478021] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-31T18:23:38.534191] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T18:23:38.662836] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-31T18:23:38.910299] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:39.457677] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-31T18:23:40.257683] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-31T18:23:40.289826] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-31T18:23:40.836235] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-31T18:23:41.057809] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-31T18:23:41.144835] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-31T18:23:41.424790] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T18:23:41.857679] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-31T18:23:42.657666] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-31T18:23:43.089690] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-31T18:23:43.089940] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-31T18:23:43.457670] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-31T18:23:44.257672] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-31T18:23:45.053058] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-31T18:23:45.062385] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-31T18:23:45.857724] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-31T18:23:46.163722] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-31T18:23:46.173981] [INFO ] [REMOTE ] DTM: Full fetch complete (64942 records). [2025-10-31T18:23:46.174136] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-31T18:23:46.174805] [FATAL] [VALIDATOR ] DTM: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:23:46.174895] [FATAL] [MAIN ] DTM: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:23:46.174939] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:23:46.175003] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-31T18:23:46.175066] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-31T18:23:46.175101] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-31T18:23:46.175258] [DEBUG] [LOCAL ] DTM: Deleted derivative data file. [2025-10-31T18:23:46.175347] [INFO ] [MAIN ] Update Progress: 664/2365 symbols completed. DTM took 39.3s. Estimated remaining: 3h 34m 25s. Rate: 7.9 symbols/min [2025-10-31T18:23:46.337369] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-31T18:23:46.361394] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:46.361565] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-10-31T18:23:46.363782] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-10-31T18:23:46.363957] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-31T18:23:46.364027] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-31T18:23:46.364113] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-31T18:23:46.364205] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-31T18:23:46.565905] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-31T18:23:46.659071] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-31T18:23:46.756448] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:47.263258] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T18:23:47.264800] [INFO ] [REMOTE ] DUKB: Full fetch complete (8843 records). [2025-10-31T18:23:47.264880] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-31T18:23:47.265237] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:23:47.265318] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:23:47.265359] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:23:47.265402] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-31T18:23:47.265466] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-31T18:23:47.265522] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-31T18:23:47.265715] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-31T18:23:47.265799] [INFO ] [MAIN ] Update Progress: 665/2365 symbols completed. DUKB took 26.0s. Estimated remaining: 3h 34m 1s. Rate: 7.9 symbols/min [2025-10-31T18:23:47.430371] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:47.457633] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-31T18:23:47.479885] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-31T18:23:47.480180] [INFO ] [MAIN ] DVN: Loaded 54089 existing records. [2025-10-31T18:23:47.653412] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:23:47.653593] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-31T18:23:47.653639] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-31T18:23:47.654009] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-31T18:23:47.654065] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-31T18:23:48.003362] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:48.257704] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-31T18:23:48.785270] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T18:23:49.057677] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-31T18:23:49.620516] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:23:49.678808] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T18:23:49.690893] [INFO ] [REMOTE ] DUK: Full fetch complete (77558 records). [2025-10-31T18:23:49.691036] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-31T18:23:49.880232] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-31T18:23:50.083445] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-31T18:23:50.083553] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-31T18:23:50.084439] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-31T18:23:50.084504] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-31T18:23:50.085987] [DEBUG] [LOCAL ] DUK: Trimmed 77558 records to 54197 (keeping 200 days of data) [2025-10-31T18:23:50.412403] [DEBUG] [LOCAL ] DUK: Primary data saved (54197 records). [2025-10-31T18:23:50.412529] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-31T18:23:50.413521] [INFO ] [MAIN ] Update Progress: 666/2365 symbols completed. DUK took 35.2s. Estimated remaining: 3h 33m 42s. Rate: 8.0 symbols/min [2025-10-31T18:23:50.579576] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:23:50.631165] [DEBUG] [LOCAL ] DX: Loaded 52861 existing records from primary storage. [2025-10-31T18:23:50.631461] [INFO ] [MAIN ] DX: Loaded 52861 existing records. [2025-10-31T18:23:50.662917] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-31T18:23:50.811090] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:23:50.811332] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-31T18:23:50.811379] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-31T18:23:50.812253] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-31T18:23:50.812311] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-31T18:23:51.172379] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:23:51.193056] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T18:23:51.457697] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-31T18:23:52.254023] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-31T18:23:52.263740] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-31T18:23:52.968980] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-31T18:23:53.057638] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-31T18:23:53.685034] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-31T18:23:53.857666] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-31T18:23:54.502034] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-31T18:23:54.657686] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-31T18:23:55.419628] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-31T18:23:55.457635] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-31T18:23:56.088840] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T18:23:56.257687] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-31T18:23:56.909910] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T18:23:57.057674] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-31T18:23:57.722474] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T18:23:57.857718] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-31T18:23:58.274783] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T18:23:58.657664] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-31T18:23:59.403607] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-31T18:23:59.457680] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-31T18:23:59.818003] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T18:24:00.257676] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-31T18:24:01.057709] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-31T18:24:01.152293] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-31T18:24:01.857622] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-31T18:24:01.972986] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-31T18:24:02.657741] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-31T18:24:03.160448] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:24:03.387189] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-31T18:24:03.457612] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-31T18:24:04.216249] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-31T18:24:04.257685] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-31T18:24:04.978624] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T18:24:05.057621] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-31T18:24:05.365239] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T18:24:05.857631] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-31T18:24:06.663296] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-31T18:24:06.689166] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-31T18:24:07.221141] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T18:24:07.457776] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-31T18:24:08.137890] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-31T18:24:08.257670] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-31T18:24:08.667298] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T18:24:09.057719] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-31T18:24:09.725343] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T18:24:09.857634] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-31T18:24:09.912598] [DEBUG] [REMOTE ] DX: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-31T18:24:09.912972] [WARN ] [REMOTE ] DX: No data returned for month 2025-08 [2025-10-31T18:24:09.913063] [FATAL] [REMOTE ] DX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:24:09.913139] [FATAL] [MAIN ] DX: Failed to fetch primary data. [2025-10-31T18:24:09.913203] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:24:09.913274] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-31T18:24:09.913358] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-31T18:24:09.913415] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-31T18:24:09.913554] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-31T18:24:09.914440] [INFO ] [MAIN ] Update Progress: 667/2365 symbols completed. DX took 19.5s. Estimated remaining: 3h 34m 5s. Rate: 7.9 symbols/min [2025-10-31T18:24:10.095163] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:24:10.143637] [DEBUG] [LOCAL ] DXC: Loaded 50191 existing records from primary storage. [2025-10-31T18:24:10.144015] [INFO ] [MAIN ] DXC: Loaded 50191 existing records. [2025-10-31T18:24:10.329985] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:24:10.330280] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-31T18:24:10.330393] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-31T18:24:10.331164] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-31T18:24:10.331222] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-31T18:24:10.523817] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T18:24:10.662717] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-31T18:24:10.737038] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:24:11.457690] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-31T18:24:12.030753] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T18:24:12.257686] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-31T18:24:13.053932] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-31T18:24:13.064482] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-31T18:24:13.602326] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T18:24:13.857686] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-31T18:24:14.067321] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-31T18:24:14.657699] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-31T18:24:15.457710] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-31T18:24:15.651348] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-31T18:24:15.663399] [INFO ] [REMOTE ] DV: Full fetch complete (73914 records). [2025-10-31T18:24:15.663554] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-31T18:24:15.849120] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T18:24:16.085181] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-31T18:24:16.085260] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-31T18:24:16.086102] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-31T18:24:16.086165] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-31T18:24:16.087821] [DEBUG] [LOCAL ] DV: Trimmed 73914 records to 51913 (keeping 200 days of data) [2025-10-31T18:24:16.258692] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-31T18:24:16.386682] [DEBUG] [LOCAL ] DV: Primary data saved (51913 records). [2025-10-31T18:24:16.386826] [INFO ] [MAIN ] DV: Full history saved. [2025-10-31T18:24:16.386906] [INFO ] [MAIN ] Update Progress: 668/2365 symbols completed. DV took 38.3s. Estimated remaining: 3h 33m 54s. Rate: 7.9 symbols/min [2025-10-31T18:24:16.557295] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:24:16.595996] [DEBUG] [LOCAL ] DXYZ: Loaded 36901 existing records from primary storage. [2025-10-31T18:24:16.596326] [INFO ] [MAIN ] DXYZ: Loaded 36901 existing records. [2025-10-31T18:24:16.804060] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:24:16.804407] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-31T18:24:16.804468] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-31T18:24:16.804766] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-31T18:24:16.804822] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-31T18:24:17.063134] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-31T18:24:17.314836] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:24:17.368822] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-31T18:24:17.515378] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T18:24:17.857698] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-31T18:24:18.356330] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-31T18:24:18.365074] [INFO ] [REMOTE ] DVA: Full fetch complete (59388 records). [2025-10-31T18:24:18.365215] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-31T18:24:18.365878] [FATAL] [VALIDATOR ] DVA: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:24:18.365969] [FATAL] [MAIN ] DVA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:24:18.366014] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:24:18.366082] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-31T18:24:18.366146] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-31T18:24:18.366184] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-10-31T18:24:18.366225] [DEBUG] [LOCAL ] DVA: No derivative data file found to delete. [2025-10-31T18:24:18.366282] [INFO ] [MAIN ] Update Progress: 669/2365 symbols completed. DVA took 32.2s. Estimated remaining: 3h 33m 33s. Rate: 7.9 symbols/min [2025-10-31T18:24:18.538203] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:24:18.564801] [DEBUG] [LOCAL ] DY: Loaded 27736 existing records from primary storage. [2025-10-31T18:24:18.565060] [INFO ] [MAIN ] DY: Loaded 27736 existing records. [2025-10-31T18:24:18.662923] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-31T18:24:18.743778] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:24:18.743983] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-31T18:24:18.744029] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-31T18:24:18.744264] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-31T18:24:18.744324] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-31T18:24:19.102825] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:24:19.457747] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-31T18:24:19.860453] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-31T18:24:20.189872] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-31T18:24:20.257710] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-31T18:24:20.582183] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T18:24:20.874835] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T18:24:20.886414] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-31T18:24:20.886545] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-31T18:24:20.887307] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:24:20.887393] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:24:20.887436] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:24:20.887475] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-31T18:24:20.887530] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-31T18:24:20.887563] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-31T18:24:20.887727] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-10-31T18:24:20.887817] [INFO ] [MAIN ] Update Progress: 670/2365 symbols completed. DVN took 33.6s. Estimated remaining: 3h 33m 12s. Rate: 8.0 symbols/min [2025-10-31T18:24:21.058005] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:24:21.058084] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-31T18:24:21.089139] [DEBUG] [LOCAL ] E: Loaded 32809 existing records from primary storage. [2025-10-31T18:24:21.089390] [INFO ] [MAIN ] E: Loaded 32809 existing records. [2025-10-31T18:24:21.284608] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:24:21.284854] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-31T18:24:21.284903] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-31T18:24:21.285711] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-31T18:24:21.285772] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-31T18:24:21.645752] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:24:21.857674] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-31T18:24:22.327517] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-31T18:24:22.657695] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-31T18:24:22.883580] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T18:24:23.457733] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-31T18:24:23.929733] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T18:24:24.257625] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-31T18:24:24.638085] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T18:24:25.057678] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-31T18:24:25.797227] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-31T18:24:25.857689] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-31T18:24:26.226734] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T18:24:26.657740] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-31T18:24:27.457680] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-31T18:24:27.634544] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-31T18:24:27.836867] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T18:24:28.257703] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-31T18:24:28.702172] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T18:24:29.057685] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-31T18:24:29.769047] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T18:24:29.857675] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-31T18:24:30.158467] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T18:24:30.657673] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-31T18:24:31.002973] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T18:24:31.457684] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-31T18:24:32.257675] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-31T18:24:32.317155] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-31T18:24:32.972672] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-31T18:24:32.983891] [INFO ] [REMOTE ] DXC: Full fetch complete (70266 records). [2025-10-31T18:24:32.984048] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-31T18:24:32.985192] [FATAL] [VALIDATOR ] DXC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:24:32.985302] [FATAL] [MAIN ] DXC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:24:32.985372] [WARN ] [MAIN ] DXC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:24:32.985468] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-31T18:24:32.985546] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-31T18:24:32.985583] [INFO ] [LOCAL ] DXC: Starting deletion of derivative data. [2025-10-31T18:24:32.985743] [DEBUG] [LOCAL ] DXC: Deleted derivative data file. [2025-10-31T18:24:32.986469] [INFO ] [MAIN ] Update Progress: 671/2365 symbols completed. DXC took 23.1s. Estimated remaining: 3h 33m 16s. Rate: 7.9 symbols/min [2025-10-31T18:24:33.058966] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-31T18:24:33.174327] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:24:33.202015] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T18:24:33.245405] [DEBUG] [LOCAL ] EAF: Loaded 40611 existing records from primary storage. [2025-10-31T18:24:33.245745] [INFO ] [MAIN ] EAF: Loaded 40611 existing records. [2025-10-31T18:24:33.423525] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:24:33.423742] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-31T18:24:33.423793] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-31T18:24:33.424476] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-31T18:24:33.424532] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-31T18:24:33.790878] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:24:33.857717] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-31T18:24:34.464547] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-31T18:24:34.657731] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-31T18:24:35.119590] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:24:35.457701] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-31T18:24:35.993692] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T18:24:36.257723] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-31T18:24:36.939967] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-31T18:24:37.057692] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-31T18:24:37.349614] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T18:24:37.857718] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-31T18:24:38.193248] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T18:24:38.657691] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-31T18:24:38.845250] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-31T18:24:39.457707] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-31T18:24:40.195864] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-31T18:24:40.257628] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-31T18:24:40.490830] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-31T18:24:41.057697] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-31T18:24:41.401565] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T18:24:41.857693] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-31T18:24:42.239527] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T18:24:42.657677] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-31T18:24:43.021960] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T18:24:43.457686] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-31T18:24:44.257704] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-31T18:24:44.389824] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-31T18:24:44.907513] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T18:24:45.057677] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-31T18:24:45.413193] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T18:24:45.857715] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-31T18:24:46.657624] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-31T18:24:46.741053] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-31T18:24:46.751958] [INFO ] [REMOTE ] DXYZ: Full fetch complete (55685 records). [2025-10-31T18:24:46.752106] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-31T18:24:46.752721] [FATAL] [VALIDATOR ] DXYZ: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:24:46.752837] [FATAL] [MAIN ] DXYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:24:46.752880] [WARN ] [MAIN ] DXYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:24:46.752918] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-31T18:24:46.752973] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-10-31T18:24:46.753011] [INFO ] [LOCAL ] DXYZ: Starting deletion of derivative data. [2025-10-31T18:24:46.753193] [DEBUG] [LOCAL ] DXYZ: Deleted derivative data file. [2025-10-31T18:24:46.753281] [INFO ] [MAIN ] Update Progress: 672/2365 symbols completed. DXYZ took 30.4s. Estimated remaining: 3h 33m 24s. Rate: 7.9 symbols/min [2025-10-31T18:24:46.920871] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:24:46.926782] [DEBUG] [LOCAL ] EAI: Loaded 3784 existing records from primary storage. [2025-10-31T18:24:46.926961] [INFO ] [MAIN ] EAI: Loaded 3784 existing records. [2025-10-31T18:24:47.108744] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:24:47.109059] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-31T18:24:47.109146] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-31T18:24:47.109355] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-31T18:24:47.109400] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-31T18:24:47.468363] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-31T18:24:47.505787] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:24:47.501096] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-31T18:24:47.880052] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T18:24:48.257687] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-31T18:24:48.343418] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T18:24:48.735761] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-31T18:24:49.057639] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-31T18:24:49.857668] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-31T18:24:50.013682] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T18:24:50.657626] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-31T18:24:50.782632] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-31T18:24:51.457630] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-31T18:24:52.084733] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T18:24:52.257672] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-31T18:24:52.690600] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T18:24:52.698069] [INFO ] [REMOTE ] E: Full fetch complete (47560 records). [2025-10-31T18:24:52.698227] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-31T18:24:53.062931] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-31T18:24:53.079448] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-31T18:24:53.079516] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-31T18:24:53.080169] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-31T18:24:53.080229] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-31T18:24:53.081247] [DEBUG] [LOCAL ] E: Trimmed 47560 records to 33048 (keeping 200 days of data) [2025-10-31T18:24:53.300579] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T18:24:53.315281] [DEBUG] [LOCAL ] E: Primary data saved (33048 records). [2025-10-31T18:24:53.315399] [INFO ] [MAIN ] E: Full history saved. [2025-10-31T18:24:53.315470] [INFO ] [MAIN ] Update Progress: 673/2365 symbols completed. E took 32.4s. Estimated remaining: 3h 33m 14s. Rate: 7.9 symbols/min [2025-10-31T18:24:53.540696] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:24:53.566596] [DEBUG] [LOCAL ] EARN: Loaded 27219 existing records from primary storage. [2025-10-31T18:24:53.566875] [INFO ] [MAIN ] EARN: Loaded 27219 existing records. [2025-10-31T18:24:53.756085] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:24:53.756323] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-31T18:24:53.756369] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-31T18:24:53.757110] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-31T18:24:53.757168] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-31T18:24:53.861808] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-31T18:24:54.174533] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:24:54.176392] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T18:24:54.379919] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T18:24:54.657671] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-31T18:24:55.457717] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-31T18:24:55.891143] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-31T18:24:56.257684] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-31T18:24:56.374485] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T18:24:56.659810] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T18:24:57.057686] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-31T18:24:57.448055] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-31T18:24:57.857675] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-31T18:24:58.657999] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-31T18:24:58.860885] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-31T18:24:59.011195] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-31T18:24:59.457663] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-31T18:25:00.257720] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-31T18:25:00.878639] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T18:25:00.884038] [INFO ] [REMOTE ] DY: Full fetch complete (43169 records). [2025-10-31T18:25:00.884126] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-31T18:25:01.060794] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-31T18:25:01.274012] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-31T18:25:01.274109] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-31T18:25:01.274896] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-31T18:25:01.274966] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-31T18:25:01.276435] [DEBUG] [LOCAL ] DY: Trimmed 43169 records to 27877 (keeping 200 days of data) [2025-10-31T18:25:01.450821] [DEBUG] [LOCAL ] DY: Primary data saved (27877 records). [2025-10-31T18:25:01.450999] [INFO ] [MAIN ] DY: Full history saved. [2025-10-31T18:25:01.451137] [INFO ] [MAIN ] Update Progress: 674/2365 symbols completed. DY took 43.1s. Estimated remaining: 3h 33m 8s. Rate: 7.9 symbols/min [2025-10-31T18:25:01.634066] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:25:01.683092] [DEBUG] [LOCAL ] EAT: Loaded 50100 existing records from primary storage. [2025-10-31T18:25:01.683416] [INFO ] [MAIN ] EAT: Loaded 50100 existing records. [2025-10-31T18:25:01.859331] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-31T18:25:01.945476] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:25:01.945898] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-31T18:25:01.946119] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-31T18:25:01.955127] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-31T18:25:01.973416] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-31T18:25:01.971275] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-31T18:25:02.309561] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T18:25:02.377482] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:25:02.657675] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-31T18:25:02.961542] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T18:25:03.206290] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-31T18:25:03.457636] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-31T18:25:04.257681] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-31T18:25:04.790811] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T18:25:05.057696] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-31T18:25:05.428080] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-31T18:25:05.857686] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-31T18:25:05.925871] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-31T18:25:06.273668] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T18:25:06.657633] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-31T18:25:07.294461] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T18:25:07.295881] [INFO ] [REMOTE ] EAI: Full fetch complete (5673 records). [2025-10-31T18:25:07.295954] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-31T18:25:07.470407] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-31T18:25:07.668592] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-31T18:25:07.668696] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-31T18:25:07.668886] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-31T18:25:07.668927] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-31T18:25:07.669324] [DEBUG] [LOCAL ] EAI: Trimmed 5673 records to 3835 (keeping 200 days of data) [2025-10-31T18:25:07.693097] [DEBUG] [LOCAL ] EAI: Primary data saved (3835 records). [2025-10-31T18:25:07.693239] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-31T18:25:07.693517] [INFO ] [MAIN ] Update Progress: 675/2365 symbols completed. EAI took 20.9s. Estimated remaining: 3h 32m 57s. Rate: 7.9 symbols/min [2025-10-31T18:25:07.866783] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:25:07.898936] [DEBUG] [LOCAL ] EB: Loaded 35765 existing records from primary storage. [2025-10-31T18:25:07.899208] [INFO ] [MAIN ] EB: Loaded 35765 existing records. [2025-10-31T18:25:08.074778] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:25:08.075003] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-31T18:25:08.075049] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-31T18:25:08.075300] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-31T18:25:08.075355] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-31T18:25:08.262852] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-31T18:25:08.429706] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:25:08.877204] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T18:25:09.057725] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-31T18:25:09.344896] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T18:25:09.352759] [INFO ] [REMOTE ] EAF: Full fetch complete (61076 records). [2025-10-31T18:25:09.352894] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-31T18:25:09.762533] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-31T18:25:09.762614] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-31T18:25:09.763394] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-31T18:25:09.763458] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-31T18:25:09.764594] [DEBUG] [LOCAL ] EAF: Trimmed 61076 records to 40801 (keeping 200 days of data) [2025-10-31T18:25:09.875765] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-31T18:25:09.991852] [DEBUG] [LOCAL ] EAF: Primary data saved (40801 records). [2025-10-31T18:25:09.992000] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-31T18:25:09.993022] [INFO ] [MAIN ] Update Progress: 676/2365 symbols completed. EAF took 37.0s. Estimated remaining: 3h 32m 37s. Rate: 7.9 symbols/min [2025-10-31T18:25:10.158637] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:25:10.158841] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-31T18:25:10.158878] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-31T18:25:10.158983] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-31T18:25:10.159023] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-31T18:25:10.159062] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-31T18:25:10.159093] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-31T18:25:10.523788] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:25:10.551254] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-31T18:25:10.657688] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-31T18:25:10.983607] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T18:25:11.457724] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-31T18:25:12.031784] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T18:25:12.219814] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-31T18:25:12.257613] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-31T18:25:13.057626] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-31T18:25:13.087010] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T18:25:13.857658] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-31T18:25:14.633529] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T18:25:14.657613] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-31T18:25:14.966506] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:25:15.457674] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-31T18:25:16.178768] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T18:25:16.257621] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-31T18:25:16.485375] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T18:25:17.057694] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-31T18:25:17.479522] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T18:25:17.857675] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-31T18:25:18.274208] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T18:25:18.657630] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-31T18:25:19.256218] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T18:25:19.280511] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T18:25:19.457703] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-31T18:25:20.257703] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-31T18:25:20.738290] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T18:25:20.975750] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T18:25:21.057639] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-31T18:25:21.857720] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-31T18:25:22.198110] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T18:25:22.657707] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-31T18:25:22.820607] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T18:25:23.282965] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T18:25:23.457673] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-31T18:25:24.257689] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-31T18:25:24.286421] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-31T18:25:25.057669] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-31T18:25:25.504366] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T18:25:25.857722] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-31T18:25:26.441872] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-31T18:25:26.657714] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-31T18:25:26.866186] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T18:25:27.457734] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-31T18:25:28.193256] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-31T18:25:28.257612] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-31T18:25:28.395084] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-31T18:25:28.406417] [INFO ] [REMOTE ] EAT: Full fetch complete (72557 records). [2025-10-31T18:25:28.406561] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-31T18:25:28.787154] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-31T18:25:28.787248] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-31T18:25:28.788117] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-31T18:25:28.788180] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-31T18:25:28.789449] [DEBUG] [LOCAL ] EAT: Trimmed 72557 records to 50464 (keeping 200 days of data) [2025-10-31T18:25:29.028581] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-31T18:25:29.073561] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-31T18:25:29.111374] [DEBUG] [LOCAL ] EAT: Primary data saved (50464 records). [2025-10-31T18:25:29.111548] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-31T18:25:29.112514] [INFO ] [MAIN ] Update Progress: 677/2365 symbols completed. EAT took 27.7s. Estimated remaining: 3h 32m 58s. Rate: 7.9 symbols/min [2025-10-31T18:25:29.857696] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-31T18:25:30.172284] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-31T18:25:30.179237] [INFO ] [REMOTE ] EARN: Full fetch complete (44932 records). [2025-10-31T18:25:30.179393] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-31T18:25:30.564340] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-31T18:25:30.564422] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-31T18:25:30.565057] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-31T18:25:30.565121] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-31T18:25:30.566125] [DEBUG] [LOCAL ] EARN: Trimmed 44932 records to 27446 (keeping 200 days of data) [2025-10-31T18:25:30.657826] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-31T18:25:30.722964] [DEBUG] [LOCAL ] EARN: Primary data saved (27446 records). [2025-10-31T18:25:30.723056] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-31T18:25:30.723130] [INFO ] [MAIN ] Update Progress: 678/2365 symbols completed. EARN took 37.4s. Estimated remaining: 3h 32m 35s. Rate: 7.9 symbols/min [2025-10-31T18:25:30.833403] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T18:25:31.457707] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-31T18:25:31.469422] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-31T18:25:32.257731] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-31T18:25:32.487177] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T18:25:33.046081] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-31T18:25:33.057620] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-31T18:25:33.761481] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T18:25:33.857687] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-31T18:25:34.486613] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T18:25:34.657676] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-31T18:25:35.457623] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-31T18:25:35.613055] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-31T18:25:35.618861] [INFO ] [REMOTE ] EBF: Full fetch complete (28696 records). [2025-10-31T18:25:35.618944] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-31T18:25:35.987821] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-31T18:25:35.987946] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-31T18:25:35.988561] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-31T18:25:35.988624] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-31T18:25:35.989566] [DEBUG] [LOCAL ] EBF: Trimmed 28696 records to 19668 (keeping 200 days of data) [2025-10-31T18:25:36.107838] [DEBUG] [LOCAL ] EBF: Primary data saved (19668 records). [2025-10-31T18:25:36.111173] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-31T18:25:36.111247] [INFO ] [MAIN ] Update Progress: 679/2365 symbols completed. EBF took 26.1s. Estimated remaining: 3h 32m 23s. Rate: 7.9 symbols/min [2025-10-31T18:25:36.370960] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T18:25:36.378123] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-31T18:25:37.427226] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-31T18:25:37.434567] [INFO ] [REMOTE ] EB: Full fetch complete (54036 records). [2025-10-31T18:25:37.434758] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-31T18:25:37.435406] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:25:37.435485] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:25:37.435552] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:25:37.435624] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-31T18:25:37.435729] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-31T18:25:37.435800] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-31T18:25:37.435965] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-10-31T18:25:37.436056] [INFO ] [MAIN ] Update Progress: 680/2365 symbols completed. EB took 29.7s. Estimated remaining: 3h 31m 60s. Rate: 7.9 symbols/min [2025-10-31T18:25:38.171839] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:25:38.152918] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:25:38.174540] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:25:38.195209] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:25:38.242096] [DEBUG] [LOCAL ] ECAT: Loaded 29095 existing records from primary storage. [2025-10-31T18:25:38.242634] [INFO ] [MAIN ] ECAT: Loaded 29095 existing records. [2025-10-31T18:25:38.339811] [DEBUG] [LOCAL ] EBR: Loaded 43489 existing records from primary storage. [2025-10-31T18:25:38.369198] [INFO ] [MAIN ] EBR: Loaded 43489 existing records. [2025-10-31T18:25:38.416914] [DEBUG] [LOCAL ] EBS: Loaded 46884 existing records from primary storage. [2025-10-31T18:25:38.487771] [INFO ] [MAIN ] EBS: Loaded 46884 existing records. [2025-10-31T18:25:38.530328] [DEBUG] [LOCAL ] EC: Loaded 49037 existing records from primary storage. [2025-10-31T18:25:38.616900] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:25:38.601387] [INFO ] [MAIN ] EC: Loaded 49037 existing records. [2025-10-31T18:25:38.631166] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-31T18:25:38.644272] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-31T18:25:38.697798] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-31T18:25:38.777224] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-31T18:25:38.904183] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:25:39.043924] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-31T18:25:39.118954] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:25:39.147778] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-31T18:25:39.149346] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-31T18:25:39.158219] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:25:39.173938] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-31T18:25:39.174324] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-31T18:25:39.174220] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-31T18:25:39.174452] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-31T18:25:39.184868] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-31T18:25:39.203861] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-31T18:25:39.209181] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-31T18:25:39.198676] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-31T18:25:39.252623] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-31T18:25:40.170250] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:25:40.339093] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-31T18:25:40.564546] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:25:40.531710] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:25:40.565596] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-31T18:25:40.566636] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-31T18:25:40.593396] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:25:40.594140] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-31T18:25:41.458510] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T18:25:41.464375] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-31T18:25:41.873597] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T18:25:41.882570] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-31T18:25:42.001950] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T18:25:42.012068] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-31T18:25:42.172038] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-31T18:25:42.346152] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T18:25:42.657679] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-31T18:25:43.120460] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T18:25:43.278613] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T18:25:43.420011] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T18:25:43.457612] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-31T18:25:44.257686] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-31T18:25:44.509739] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T18:25:45.057684] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-31T18:25:45.626106] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T18:25:45.857698] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-31T18:25:45.998270] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-31T18:25:46.657702] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-31T18:25:46.916432] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T18:25:47.457631] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-31T18:25:47.622124] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T18:25:48.257676] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-31T18:25:48.702329] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T18:25:49.057673] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-31T18:25:49.316425] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T18:25:49.857637] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-31T18:25:50.330147] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-31T18:25:50.657679] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-31T18:25:51.225227] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T18:25:51.457731] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-31T18:25:51.716043] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T18:25:52.257665] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-31T18:25:52.544495] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T18:25:53.057706] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-31T18:25:53.665692] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T18:25:53.857669] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-31T18:25:54.209194] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T18:25:54.657669] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-31T18:25:55.084295] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T18:25:55.457709] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-31T18:25:55.777636] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T18:25:56.257708] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-31T18:25:56.289562] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T18:25:57.057677] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-31T18:25:57.461857] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T18:25:57.857678] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-31T18:25:58.273823] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T18:25:58.657633] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-31T18:25:59.087932] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T18:25:59.457672] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-31T18:25:59.893862] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T18:26:00.257666] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-31T18:26:01.057765] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-31T18:26:01.206677] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-31T18:26:01.857614] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-31T18:26:02.059965] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T18:26:02.102989] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-31T18:26:02.657707] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-31T18:26:03.310297] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T18:26:03.457726] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-31T18:26:03.814058] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T18:26:04.257736] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-31T18:26:04.906848] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T18:26:04.919948] [INFO ] [REMOTE ] EC: Full fetch complete (71786 records). [2025-10-31T18:26:04.920122] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-31T18:26:05.062037] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-31T18:26:05.373590] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T18:26:05.406532] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-31T18:26:05.406875] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-31T18:26:05.407888] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-31T18:26:05.408691] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-31T18:26:05.410308] [DEBUG] [LOCAL ] EC: Trimmed 71786 records to 49387 (keeping 200 days of data) [2025-10-31T18:26:05.703543] [DEBUG] [LOCAL ] EC: Primary data saved (49387 records). [2025-10-31T18:26:05.703715] [INFO ] [MAIN ] EC: Full history saved. [2025-10-31T18:26:05.703808] [INFO ] [MAIN ] Update Progress: 681/2365 symbols completed. EC took 28.3s. Estimated remaining: 3h 32m 43s. Rate: 7.9 symbols/min [2025-10-31T18:26:05.861164] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-31T18:26:05.871758] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:26:05.873126] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-10-31T18:26:05.873176] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-10-31T18:26:05.873296] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-31T18:26:05.873337] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-31T18:26:05.873432] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-31T18:26:05.873483] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-31T18:26:06.232021] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:26:06.662755] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-31T18:26:06.680355] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T18:26:06.691264] [INFO ] [REMOTE ] EBS: Full fetch complete (67517 records). [2025-10-31T18:26:06.691383] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-31T18:26:07.105006] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-31T18:26:07.107363] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T18:26:07.107448] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-31T18:26:07.108468] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-31T18:26:07.108542] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-31T18:26:07.118459] [DEBUG] [LOCAL ] EBS: Trimmed 67517 records to 47249 (keeping 200 days of data) [2025-10-31T18:26:07.379357] [DEBUG] [LOCAL ] EBS: Primary data saved (47249 records). [2025-10-31T18:26:07.379489] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-31T18:26:07.379567] [INFO ] [MAIN ] Update Progress: 682/2365 symbols completed. EBS took 29.9s. Estimated remaining: 3h 32m 21s. Rate: 7.9 symbols/min [2025-10-31T18:26:07.462883] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-31T18:26:07.551139] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:26:07.551279] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-31T18:26:07.551315] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-31T18:26:07.551417] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-31T18:26:07.551457] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-31T18:26:07.551497] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-31T18:26:07.551528] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-31T18:26:07.902595] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:26:07.922355] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:26:08.257714] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-31T18:26:08.482667] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-31T18:26:08.649600] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T18:26:08.656546] [INFO ] [REMOTE ] ECAT: Full fetch complete (42839 records). [2025-10-31T18:26:08.656711] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-31T18:26:09.033052] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-31T18:26:09.033151] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-31T18:26:09.033797] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-31T18:26:09.033857] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-31T18:26:09.034727] [DEBUG] [LOCAL ] ECAT: Trimmed 42839 records to 29347 (keeping 200 days of data) [2025-10-31T18:26:09.086054] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-31T18:26:09.211848] [DEBUG] [LOCAL ] ECAT: Primary data saved (29347 records). [2025-10-31T18:26:09.211986] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-31T18:26:09.212073] [INFO ] [MAIN ] Update Progress: 683/2365 symbols completed. ECAT took 31.8s. Estimated remaining: 3h 31m 59s. Rate: 7.9 symbols/min [2025-10-31T18:26:09.377541] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:26:09.381985] [DEBUG] [LOCAL ] ECCU: Loaded 2074 existing records from primary storage. [2025-10-31T18:26:09.382131] [INFO ] [MAIN ] ECCU: Loaded 2074 existing records. [2025-10-31T18:26:09.557725] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:26:09.557948] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-31T18:26:09.557999] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-31T18:26:09.558126] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-31T18:26:09.558164] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-31T18:26:09.870449] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-31T18:26:09.909162] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:26:10.491745] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T18:26:10.657667] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-31T18:26:10.934684] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-31T18:26:10.958693] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T18:26:11.457720] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-31T18:26:12.257714] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-31T18:26:12.714555] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T18:26:12.820266] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-31T18:26:13.057667] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-31T18:26:13.857736] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-31T18:26:14.178868] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-31T18:26:14.467265] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T18:26:14.657660] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-31T18:26:15.457687] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-31T18:26:15.675006] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-10-31T18:26:15.802859] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-31T18:26:16.257686] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-31T18:26:16.578851] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-31T18:26:17.057687] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-31T18:26:17.464242] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-31T18:26:17.857721] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-31T18:26:18.102088] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-31T18:26:18.657674] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-31T18:26:19.046014] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-31T18:26:19.457723] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-31T18:26:19.825255] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T18:26:20.257694] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-31T18:26:21.057682] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-31T18:26:21.787079] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-31T18:26:21.797414] [INFO ] [REMOTE ] EBR: Full fetch complete (62397 records). [2025-10-31T18:26:21.797572] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-31T18:26:21.862738] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-31T18:26:22.172785] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-31T18:26:22.207594] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-31T18:26:22.207694] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-31T18:26:22.208548] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-31T18:26:22.208612] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-31T18:26:22.209816] [DEBUG] [LOCAL ] EBR: Trimmed 62397 records to 43814 (keeping 200 days of data) [2025-10-31T18:26:22.476933] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-31T18:26:22.497514] [DEBUG] [LOCAL ] EBR: Primary data saved (43814 records). [2025-10-31T18:26:22.498113] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-31T18:26:22.498889] [INFO ] [MAIN ] Update Progress: 684/2365 symbols completed. EBR took 45.1s. Estimated remaining: 3h 32m 6s. Rate: 7.9 symbols/min [2025-10-31T18:26:22.663217] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-31T18:26:22.685282] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:26:22.685468] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-31T18:26:22.685514] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-31T18:26:22.685620] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-31T18:26:22.685695] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-31T18:26:22.685753] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-31T18:26:22.685786] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-31T18:26:23.051081] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:26:23.078144] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-31T18:26:23.457692] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-31T18:26:24.257700] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-31T18:26:24.557984] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-31T18:26:24.642198] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T18:26:25.057692] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-31T18:26:25.410621] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-31T18:26:25.857633] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-31T18:26:26.085691] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-31T18:26:26.657688] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-31T18:26:26.869638] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-31T18:26:27.457693] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-31T18:26:27.694162] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-31T18:26:28.257676] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-31T18:26:28.689693] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-31T18:26:28.690784] [INFO ] [REMOTE ] ECCC: Full fetch complete (1299 records). [2025-10-31T18:26:28.690868] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-31T18:26:28.899474] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-31T18:26:28.899712] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:26:28.899802] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:26:28.899876] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-31T18:26:28.899939] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-31T18:26:28.899974] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-31T18:26:28.900012] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-31T18:26:28.900065] [INFO ] [MAIN ] Update Progress: 685/2365 symbols completed. ECCC took 21.5s. Estimated remaining: 3h 31m 55s. Rate: 7.9 symbols/min [2025-10-31T18:26:29.064308] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-31T18:26:29.066879] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:26:29.068475] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-31T18:26:29.068532] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-31T18:26:29.068671] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-31T18:26:29.068728] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-31T18:26:29.068773] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-31T18:26:29.068806] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-31T18:26:29.416059] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:26:29.518922] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-31T18:26:29.857722] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-31T18:26:30.149521] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-31T18:26:30.657684] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-31T18:26:30.935390] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-31T18:26:31.457669] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-31T18:26:31.735273] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-31T18:26:32.257682] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-31T18:26:33.057681] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-31T18:26:33.345243] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-31T18:26:33.725852] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T18:26:33.857627] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-31T18:26:34.657745] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-31T18:26:35.216582] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-31T18:26:35.217630] [INFO ] [REMOTE ] ECCU: Full fetch complete (3925 records). [2025-10-31T18:26:35.217724] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-31T18:26:35.462728] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-31T18:26:35.568094] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-31T18:26:35.639959] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-31T18:26:35.640040] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-31T18:26:35.640171] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-31T18:26:35.640208] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-31T18:26:35.640547] [DEBUG] [LOCAL ] ECCU: Trimmed 3925 records to 2087 (keeping 200 days of data) [2025-10-31T18:26:35.653380] [DEBUG] [LOCAL ] ECCU: Primary data saved (2087 records). [2025-10-31T18:26:35.653476] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-31T18:26:35.653577] [INFO ] [MAIN ] Update Progress: 686/2365 symbols completed. ECCU took 26.4s. Estimated remaining: 3h 31m 46s. Rate: 7.9 symbols/min [2025-10-31T18:26:35.821438] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:26:35.850366] [DEBUG] [LOCAL ] ECG: Loaded 32474 existing records from primary storage. [2025-10-31T18:26:35.850672] [INFO ] [MAIN ] ECG: Loaded 32474 existing records. [2025-10-31T18:26:36.013814] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-31T18:26:36.034724] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:26:36.036046] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-31T18:26:36.036095] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-31T18:26:36.036761] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-31T18:26:36.036818] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-31T18:26:36.262854] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-31T18:26:36.395446] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:26:37.057669] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-31T18:26:37.324950] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-31T18:26:37.857687] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-31T18:26:37.908397] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T18:26:37.918396] [INFO ] [REMOTE ] ECC: Full fetch complete (61692 records). [2025-10-31T18:26:37.918516] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-31T18:26:38.210503] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-31T18:26:38.300382] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-31T18:26:38.300464] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-31T18:26:38.301259] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-31T18:26:38.301323] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-31T18:26:38.303002] [DEBUG] [LOCAL ] ECC: Trimmed 61692 records to 43589 (keeping 200 days of data) [2025-10-31T18:26:38.555384] [DEBUG] [LOCAL ] ECC: Primary data saved (43589 records). [2025-10-31T18:26:38.555512] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-31T18:26:38.555581] [INFO ] [MAIN ] Update Progress: 687/2365 symbols completed. ECC took 32.9s. Estimated remaining: 3h 31m 27s. Rate: 7.9 symbols/min [2025-10-31T18:26:38.662703] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-31T18:26:38.737553] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:26:38.737737] [DEBUG] [LOCAL ] ECL: No existing data file found in primary storage. [2025-10-31T18:26:38.737784] [WARN ] [MAIN ] ECL: No existing data found, performing full refresh instead. [2025-10-31T18:26:38.737942] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-31T18:26:38.737992] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-31T18:26:38.738034] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-10-31T18:26:38.738066] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-31T18:26:39.001940] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-31T18:26:39.099711] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:26:39.457688] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-31T18:26:40.257619] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-31T18:26:40.480609] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-31T18:26:40.855626] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T18:26:41.057666] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-31T18:26:41.857673] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-31T18:26:42.112240] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T18:26:42.657680] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-31T18:26:42.994725] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-31T18:26:43.039988] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T18:26:43.457682] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-31T18:26:44.257690] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-31T18:26:44.641864] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T18:26:45.057686] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-31T18:26:45.455192] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T18:26:45.857708] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-31T18:26:46.055003] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T18:26:46.182153] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-31T18:26:46.657666] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-31T18:26:47.457624] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-31T18:26:47.623010] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T18:26:48.257672] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-31T18:26:48.803065] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T18:26:49.057686] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-31T18:26:49.322102] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T18:26:49.857639] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-31T18:26:50.166632] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-31T18:26:50.167413] [INFO ] [REMOTE ] ECCW: Full fetch complete (1419 records). [2025-10-31T18:26:50.167479] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-31T18:26:50.167834] [FATAL] [VALIDATOR ] ECCW: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:26:50.167964] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:26:50.168007] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:26:50.168043] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-31T18:26:50.168096] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-31T18:26:50.168131] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-31T18:26:50.168170] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-31T18:26:50.168221] [INFO ] [MAIN ] Update Progress: 688/2365 symbols completed. ECCW took 27.7s. Estimated remaining: 3h 31m 29s. Rate: 7.9 symbols/min [2025-10-31T18:26:50.341343] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:26:50.374956] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-31T18:26:50.391541] [DEBUG] [LOCAL ] ECO: Loaded 18271 existing records from primary storage. [2025-10-31T18:26:50.391792] [INFO ] [MAIN ] ECO: Loaded 18271 existing records. [2025-10-31T18:26:50.567451] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:26:50.567677] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-31T18:26:50.567736] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-31T18:26:50.568129] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-31T18:26:50.568186] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-31T18:26:50.662734] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-31T18:26:50.929937] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:26:51.457632] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-31T18:26:51.581578] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-31T18:26:52.257671] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-31T18:26:52.752281] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T18:26:52.785869] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:26:53.057671] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-31T18:26:53.287817] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-31T18:26:53.857745] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-31T18:26:54.657686] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-31T18:26:54.874661] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-31T18:26:54.892800] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T18:26:55.457712] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-31T18:26:56.257675] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-31T18:26:56.321393] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-31T18:26:57.057685] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-31T18:26:57.295500] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-31T18:26:57.546281] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T18:26:57.857679] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-31T18:26:58.657688] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-31T18:26:58.934958] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-31T18:26:59.118830] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T18:26:59.457674] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-31T18:27:00.257731] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-31T18:27:00.681168] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T18:27:00.913184] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T18:27:01.057673] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-31T18:27:01.857701] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-31T18:27:02.090967] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T18:27:02.657684] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-31T18:27:03.457725] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-31T18:27:03.644473] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T18:27:03.705627] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-31T18:27:04.226319] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T18:27:04.257605] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-31T18:27:05.057686] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-31T18:27:05.099622] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T18:27:05.857721] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-31T18:27:06.548675] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T18:27:06.566084] [INFO ] [REMOTE ] ECL: Full fetch complete (68457 records). [2025-10-31T18:27:06.566272] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-31T18:27:06.658220] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-31T18:27:06.906488] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-31T18:27:07.142080] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-31T18:27:07.143715] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-31T18:27:07.143810] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-31T18:27:07.144982] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-31T18:27:07.145112] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-31T18:27:07.146723] [DEBUG] [LOCAL ] ECL: Trimmed 68457 records to 47399 (keeping 200 days of data) [2025-10-31T18:27:07.461085] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-31T18:27:07.477028] [DEBUG] [LOCAL ] ECL: Primary data saved (47399 records). [2025-10-31T18:27:07.477180] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-31T18:27:07.477292] [INFO ] [MAIN ] Update Progress: 689/2365 symbols completed. ECL took 28.9s. Estimated remaining: 3h 31m 45s. Rate: 7.9 symbols/min [2025-10-31T18:27:07.677259] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:27:07.717093] [DEBUG] [LOCAL ] ECVT: Loaded 42880 existing records from primary storage. [2025-10-31T18:27:07.717384] [INFO ] [MAIN ] ECVT: Loaded 42880 existing records. [2025-10-31T18:27:07.820426] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-31T18:27:07.842317] [INFO ] [REMOTE ] ECCX: Full fetch complete (1431 records). [2025-10-31T18:27:07.860076] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-31T18:27:08.002424] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:27:08.002612] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-31T18:27:08.008242] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-31T18:27:08.019277] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-31T18:27:08.024468] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-31T18:27:08.207228] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-31T18:27:08.222822] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:27:08.239245] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:27:08.244949] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-31T18:27:08.253488] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-31T18:27:08.254150] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-31T18:27:08.254873] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-31T18:27:08.269732] [INFO ] [MAIN ] Update Progress: 690/2365 symbols completed. ECCX took 39.4s. Estimated remaining: 3h 31m 21s. Rate: 7.9 symbols/min [2025-10-31T18:27:08.269624] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-31T18:27:08.657712] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:27:08.661863] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:27:08.713301] [DEBUG] [LOCAL ] ED: Loaded 52854 existing records from primary storage. [2025-10-31T18:27:08.713633] [INFO ] [MAIN ] ED: Loaded 52854 existing records. [2025-10-31T18:27:08.950380] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:27:08.950615] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-31T18:27:08.950693] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-31T18:27:08.951601] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-31T18:27:08.951702] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-31T18:27:09.057889] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-31T18:27:09.362034] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T18:27:09.387820] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:27:09.857619] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-31T18:27:10.059234] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T18:27:10.560377] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T18:27:10.657691] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-31T18:27:11.457632] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-31T18:27:11.503362] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-31T18:27:12.257671] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-31T18:27:12.630758] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T18:27:12.639164] [INFO ] [REMOTE ] ECG: Full fetch complete (50778 records). [2025-10-31T18:27:12.639346] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-31T18:27:13.032006] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-31T18:27:13.032087] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-31T18:27:13.032831] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-31T18:27:13.032902] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-31T18:27:13.034041] [DEBUG] [LOCAL ] ECG: Trimmed 50778 records to 32704 (keeping 200 days of data) [2025-10-31T18:27:13.081625] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-31T18:27:13.230043] [DEBUG] [LOCAL ] ECG: Primary data saved (32704 records). [2025-10-31T18:27:13.230217] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-31T18:27:13.230307] [INFO ] [MAIN ] Update Progress: 691/2365 symbols completed. ECG took 37.6s. Estimated remaining: 3h 31m 7s. Rate: 7.9 symbols/min [2025-10-31T18:27:13.407551] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:27:13.407975] [DEBUG] [LOCAL ] EDD: No existing data file found in primary storage. [2025-10-31T18:27:13.408077] [WARN ] [MAIN ] EDD: No existing data found, performing full refresh instead. [2025-10-31T18:27:13.408351] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-31T18:27:13.408458] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-31T18:27:13.408545] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-31T18:27:13.408592] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-31T18:27:13.540615] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T18:27:13.800909] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:27:13.857619] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-31T18:27:13.896027] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T18:27:14.657620] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-31T18:27:14.779666] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T18:27:15.457709] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-31T18:27:15.623006] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T18:27:16.265542] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-31T18:27:16.267360] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-31T18:27:17.057667] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-31T18:27:17.360684] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T18:27:17.850621] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T18:27:17.857614] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-31T18:27:18.657624] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-31T18:27:18.676002] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T18:27:19.457676] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-31T18:27:20.073088] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T18:27:20.225730] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T18:27:20.257604] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-31T18:27:21.022492] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-31T18:27:21.057618] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-31T18:27:21.854355] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T18:27:21.859572] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-31T18:27:22.657668] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-31T18:27:22.908172] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T18:27:23.457673] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-31T18:27:24.028844] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T18:27:24.257624] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-31T18:27:24.324614] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T18:27:24.329230] [INFO ] [REMOTE ] ECO: Full fetch complete (28127 records). [2025-10-31T18:27:24.329304] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-31T18:27:24.329793] [FATAL] [VALIDATOR ] ECO: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:27:24.329874] [FATAL] [MAIN ] ECO: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:27:24.329915] [WARN ] [MAIN ] ECO: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:27:24.329979] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-31T18:27:24.330039] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-10-31T18:27:24.330074] [INFO ] [LOCAL ] ECO: Starting deletion of derivative data. [2025-10-31T18:27:24.330224] [DEBUG] [LOCAL ] ECO: Deleted derivative data file. [2025-10-31T18:27:24.330308] [INFO ] [MAIN ] Update Progress: 692/2365 symbols completed. ECO took 34.2s. Estimated remaining: 3h 31m 8s. Rate: 7.9 symbols/min [2025-10-31T18:27:24.504208] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:27:24.516431] [DEBUG] [LOCAL ] EDF: Loaded 12737 existing records from primary storage. [2025-10-31T18:27:24.516663] [INFO ] [MAIN ] EDF: Loaded 12737 existing records. [2025-10-31T18:27:24.692085] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:27:24.692284] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-31T18:27:24.692332] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-31T18:27:24.692701] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-31T18:27:24.692770] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-31T18:27:25.056745] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:27:25.057608] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-31T18:27:25.276936] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T18:27:25.857710] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-31T18:27:26.075107] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T18:27:26.657677] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-31T18:27:27.118601] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-31T18:27:27.272096] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-31T18:27:27.457683] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-31T18:27:28.257627] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-31T18:27:28.325171] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-31T18:27:28.846718] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T18:27:29.057684] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-31T18:27:29.857697] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-31T18:27:30.189082] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T18:27:30.657700] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-31T18:27:30.713457] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T18:27:31.296467] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T18:27:31.457638] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-31T18:27:32.100489] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T18:27:32.257692] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-31T18:27:33.057667] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-31T18:27:33.833514] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T18:27:33.834277] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T18:27:33.853463] [INFO ] [REMOTE ] EDD: Full fetch complete (38895 records). [2025-10-31T18:27:33.853600] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-31T18:27:33.865254] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-31T18:27:34.224442] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-31T18:27:34.224515] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-31T18:27:34.225135] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-31T18:27:34.225195] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-31T18:27:34.226019] [DEBUG] [LOCAL ] EDD: Trimmed 38895 records to 27148 (keeping 200 days of data) [2025-10-31T18:27:34.373912] [DEBUG] [LOCAL ] EDD: Primary data saved (27148 records). [2025-10-31T18:27:34.374044] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-31T18:27:34.374113] [INFO ] [MAIN ] Update Progress: 693/2365 symbols completed. EDD took 21.1s. Estimated remaining: 3h 31m 7s. Rate: 7.9 symbols/min [2025-10-31T18:27:34.552857] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:27:34.560500] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-31T18:27:34.579313] [DEBUG] [LOCAL ] EDN: Loaded 20089 existing records from primary storage. [2025-10-31T18:27:34.579524] [INFO ] [MAIN ] EDN: Loaded 20089 existing records. [2025-10-31T18:27:34.662714] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-31T18:27:34.760975] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:27:34.761156] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-31T18:27:34.761202] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-31T18:27:34.761584] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-31T18:27:34.761639] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-31T18:27:35.125521] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:27:35.362164] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T18:27:35.457625] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-31T18:27:36.257669] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-31T18:27:36.704896] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T18:27:37.057701] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-31T18:27:37.598664] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T18:27:37.857629] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-31T18:27:37.988823] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-31T18:27:38.657695] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-31T18:27:39.027966] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T18:27:39.036868] [INFO ] [REMOTE ] ECVT: Full fetch complete (60522 records). [2025-10-31T18:27:39.036971] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-31T18:27:39.364219] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T18:27:39.437892] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-31T18:27:39.437977] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-31T18:27:39.438795] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-31T18:27:39.438858] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-31T18:27:39.440050] [DEBUG] [LOCAL ] ECVT: Trimmed 60522 records to 43158 (keeping 200 days of data) [2025-10-31T18:27:39.484316] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-31T18:27:39.681409] [DEBUG] [LOCAL ] ECVT: Primary data saved (43158 records). [2025-10-31T18:27:39.681550] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-31T18:27:39.682886] [INFO ] [MAIN ] Update Progress: 694/2365 symbols completed. ECVT took 32.2s. Estimated remaining: 3h 30m 54s. Rate: 7.9 symbols/min [2025-10-31T18:27:39.851901] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:27:39.893025] [DEBUG] [LOCAL ] EDU: Loaded 44960 existing records from primary storage. [2025-10-31T18:27:39.893337] [INFO ] [MAIN ] EDU: Loaded 44960 existing records. [2025-10-31T18:27:40.074399] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:27:40.074680] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-31T18:27:40.074747] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-31T18:27:40.074931] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-31T18:27:40.074972] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-31T18:27:40.262742] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-31T18:27:40.375594] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-31T18:27:40.399870] [INFO ] [REMOTE ] EDF: Full fetch complete (19696 records). [2025-10-31T18:27:40.422724] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-31T18:27:40.437278] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:27:40.460490] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:27:40.457003] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:27:40.460894] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:27:40.460983] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-31T18:27:40.461053] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-31T18:27:40.461091] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-10-31T18:27:40.461244] [DEBUG] [LOCAL ] EDF: Deleted derivative data file. [2025-10-31T18:27:40.461337] [INFO ] [MAIN ] Update Progress: 695/2365 symbols completed. EDF took 16.1s. Estimated remaining: 3h 30m 30s. Rate: 7.9 symbols/min [2025-10-31T18:27:40.631731] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:27:40.663532] [DEBUG] [LOCAL ] EE: Loaded 32636 existing records from primary storage. [2025-10-31T18:27:40.663828] [INFO ] [MAIN ] EE: Loaded 32636 existing records. [2025-10-31T18:27:40.836980] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:27:40.837174] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-31T18:27:40.837218] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-31T18:27:40.837907] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-31T18:27:40.837963] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-31T18:27:41.064597] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-31T18:27:41.190587] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:27:41.633487] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T18:27:41.857677] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-31T18:27:42.507956] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T18:27:42.655373] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-31T18:27:42.662716] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-31T18:27:43.457675] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-31T18:27:43.924485] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T18:27:44.257678] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-31T18:27:44.470341] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T18:27:45.057703] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-31T18:27:45.586966] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:27:45.857637] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-31T18:27:46.464360] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T18:27:46.487071] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T18:27:46.657674] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-31T18:27:47.462748] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-31T18:27:47.476969] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T18:27:48.257630] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-31T18:27:48.321565] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-31T18:27:49.057671] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-31T18:27:49.609725] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T18:27:49.785472] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-31T18:27:49.857687] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-31T18:27:50.657669] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-31T18:27:51.126432] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T18:27:51.390949] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-31T18:27:51.457694] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-31T18:27:52.257671] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-31T18:27:52.667992] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T18:27:53.057678] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-31T18:27:53.292692] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T18:27:53.857729] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-31T18:27:54.381969] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T18:27:54.657701] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-31T18:27:54.772577] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T18:27:54.790060] [INFO ] [REMOTE ] ED: Full fetch complete (76314 records). [2025-10-31T18:27:54.790274] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-31T18:27:55.199319] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-31T18:27:55.199400] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-31T18:27:55.200272] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-31T18:27:55.200335] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-31T18:27:55.201696] [DEBUG] [LOCAL ] ED: Trimmed 76314 records to 53237 (keeping 200 days of data) [2025-10-31T18:27:55.483590] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-31T18:27:55.531840] [DEBUG] [LOCAL ] ED: Primary data saved (53237 records). [2025-10-31T18:27:55.531947] [INFO ] [MAIN ] ED: Full history saved. [2025-10-31T18:27:55.532023] [INFO ] [MAIN ] Update Progress: 696/2365 symbols completed. ED took 47.2s. Estimated remaining: 3h 30m 40s. Rate: 7.9 symbols/min [2025-10-31T18:27:55.708045] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:27:55.724266] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-31T18:27:55.727079] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-31T18:27:55.727803] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-31T18:27:55.729154] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-31T18:27:55.729360] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-31T18:27:55.739434] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-31T18:27:55.739935] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-31T18:27:56.085696] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:27:56.257695] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-31T18:27:56.584018] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T18:27:57.057626] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-31T18:27:57.070943] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-31T18:27:57.460410] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-31T18:27:57.857687] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-31T18:27:58.456138] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-31T18:27:58.657676] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-31T18:27:58.901831] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-31T18:27:59.457677] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-31T18:27:59.845846] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-31T18:28:00.257677] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-31T18:28:01.057727] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-31T18:28:01.315894] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T18:28:01.560699] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T18:28:01.857683] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-31T18:28:02.194591] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-31T18:28:02.657715] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-31T18:28:02.961617] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-31T18:28:03.457685] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-31T18:28:03.902863] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-31T18:28:04.257666] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-31T18:28:05.057673] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-31T18:28:05.343978] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-31T18:28:05.448264] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T18:28:05.857665] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-31T18:28:06.150228] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-31T18:28:06.657677] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-31T18:28:07.126898] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-31T18:28:07.128301] [INFO ] [REMOTE ] EEA: Full fetch complete (3706 records). [2025-10-31T18:28:07.128390] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-31T18:28:07.336352] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-31T18:28:07.336584] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:28:07.336674] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:28:07.336746] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-31T18:28:07.336823] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-31T18:28:07.336876] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-31T18:28:07.336936] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-31T18:28:07.336992] [INFO ] [MAIN ] Update Progress: 697/2365 symbols completed. EEA took 11.8s. Estimated remaining: 3h 30m 43s. Rate: 7.9 symbols/min [2025-10-31T18:28:07.462753] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-31T18:28:07.504595] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:28:07.504743] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-10-31T18:28:07.504786] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-10-31T18:28:07.504888] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-31T18:28:07.504927] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-31T18:28:07.504972] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-31T18:28:07.505003] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-31T18:28:07.857214] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:28:08.257636] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-31T18:28:08.305576] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T18:28:09.019055] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-31T18:28:09.057720] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-31T18:28:09.846094] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T18:28:09.857628] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-31T18:28:10.657705] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-31T18:28:10.974869] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T18:28:10.981496] [INFO ] [REMOTE ] EDN: Full fetch complete (29831 records). [2025-10-31T18:28:10.981599] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-31T18:28:11.352156] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-31T18:28:11.352262] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-31T18:28:11.352867] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-31T18:28:11.352928] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-31T18:28:11.353737] [DEBUG] [LOCAL ] EDN: Trimmed 29831 records to 20347 (keeping 200 days of data) [2025-10-31T18:28:11.457905] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-31T18:28:11.474068] [DEBUG] [LOCAL ] EDN: Primary data saved (20347 records). [2025-10-31T18:28:11.474180] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-31T18:28:11.474252] [INFO ] [MAIN ] Update Progress: 698/2365 symbols completed. EDN took 37.1s. Estimated remaining: 3h 30m 27s. Rate: 7.9 symbols/min [2025-10-31T18:28:11.668832] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:28:11.710959] [DEBUG] [LOCAL ] EFC: Loaded 46468 existing records from primary storage. [2025-10-31T18:28:11.711245] [INFO ] [MAIN ] EFC: Loaded 46468 existing records. [2025-10-31T18:28:11.892007] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:28:11.892350] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-31T18:28:11.892451] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-31T18:28:11.893484] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-31T18:28:11.893544] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-31T18:28:12.130091] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T18:28:12.248024] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T18:28:12.258544] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-31T18:28:12.320937] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:28:13.057684] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-31T18:28:13.407194] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T18:28:13.857618] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-31T18:28:14.161479] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-31T18:28:14.657618] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-31T18:28:14.886923] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T18:28:15.359586] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T18:28:15.457675] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-31T18:28:16.257665] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-31T18:28:16.381903] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T18:28:17.057704] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-31T18:28:17.670038] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T18:28:17.857672] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-31T18:28:17.877147] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-31T18:28:18.657670] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-31T18:28:18.991451] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T18:28:19.457670] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-31T18:28:19.799885] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T18:28:19.807961] [INFO ] [REMOTE ] EE: Full fetch complete (44807 records). [2025-10-31T18:28:19.808089] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-31T18:28:20.189009] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-31T18:28:20.189086] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-31T18:28:20.189716] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-31T18:28:20.189778] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-31T18:28:20.190748] [DEBUG] [LOCAL ] EE: Trimmed 44807 records to 32866 (keeping 200 days of data) [2025-10-31T18:28:20.277357] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-31T18:28:20.384607] [DEBUG] [LOCAL ] EE: Primary data saved (32866 records). [2025-10-31T18:28:20.384768] [INFO ] [MAIN ] EE: Full history saved. [2025-10-31T18:28:20.385572] [INFO ] [MAIN ] Update Progress: 699/2365 symbols completed. EE took 39.9s. Estimated remaining: 3h 30m 23s. Rate: 7.9 symbols/min [2025-10-31T18:28:20.553230] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:28:20.553380] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-10-31T18:28:20.553419] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-10-31T18:28:20.553557] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-31T18:28:20.553629] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-31T18:28:20.553722] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-10-31T18:28:20.553763] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-31T18:28:20.961441] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:28:20.966128] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-31T18:28:21.024028] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T18:28:21.057610] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-31T18:28:21.615587] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-31T18:28:21.857708] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-31T18:28:22.657717] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-31T18:28:23.180313] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T18:28:23.457686] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-31T18:28:23.811933] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T18:28:23.996658] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-31T18:28:24.257682] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-31T18:28:24.751364] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-31T18:28:25.057681] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-31T18:28:25.509516] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-31T18:28:25.857636] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-31T18:28:26.657690] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-31T18:28:27.110616] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-31T18:28:27.222105] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T18:28:27.457617] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-31T18:28:28.007553] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-31T18:28:28.010198] [INFO ] [REMOTE ] EEX: Full fetch complete (17891 records). [2025-10-31T18:28:28.010281] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-31T18:28:28.262903] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-31T18:28:28.404862] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-31T18:28:28.404963] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-31T18:28:28.405765] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-31T18:28:28.405829] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-31T18:28:28.406455] [DEBUG] [LOCAL ] EEX: Trimmed 17891 records to 9377 (keeping 200 days of data) [2025-10-31T18:28:28.471073] [DEBUG] [LOCAL ] EEX: Primary data saved (9377 records). [2025-10-31T18:28:28.471240] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-31T18:28:28.471323] [INFO ] [MAIN ] Update Progress: 700/2365 symbols completed. EEX took 21.1s. Estimated remaining: 3h 30m 16s. Rate: 7.9 symbols/min [2025-10-31T18:28:28.643232] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:28:28.643421] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-10-31T18:28:28.643472] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-10-31T18:28:28.643581] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-31T18:28:28.643622] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-31T18:28:28.643703] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-31T18:28:28.643747] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-31T18:28:28.959157] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T18:28:29.016676] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:28:29.057622] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-31T18:28:29.732913] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T18:28:29.857710] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-31T18:28:30.353101] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T18:28:30.657686] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-31T18:28:31.144116] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T18:28:31.457673] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-31T18:28:32.207027] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T18:28:32.257614] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-31T18:28:32.775018] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T18:28:33.057684] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-31T18:28:33.857733] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-31T18:28:34.194530] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T18:28:34.489355] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-31T18:28:34.657678] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-31T18:28:35.404549] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T18:28:35.457688] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-31T18:28:36.004942] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-31T18:28:36.257667] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-31T18:28:37.057688] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-31T18:28:37.588724] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T18:28:37.857675] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-31T18:28:38.387136] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-31T18:28:38.496713] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-31T18:28:38.509985] [INFO ] [REMOTE ] EDU: Full fetch complete (67176 records). [2025-10-31T18:28:38.510133] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-31T18:28:38.665252] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-31T18:28:38.928048] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-31T18:28:38.928167] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-31T18:28:38.929078] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-31T18:28:38.929148] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-31T18:28:38.930517] [DEBUG] [LOCAL ] EDU: Trimmed 67176 records to 45310 (keeping 200 days of data) [2025-10-31T18:28:39.194435] [DEBUG] [LOCAL ] EDU: Primary data saved (45310 records). [2025-10-31T18:28:39.194564] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-31T18:28:39.194662] [INFO ] [MAIN ] Update Progress: 701/2365 symbols completed. EDU took 59.5s. Estimated remaining: 3h 30m 16s. Rate: 7.9 symbols/min [2025-10-31T18:28:39.358897] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:28:39.397503] [DEBUG] [LOCAL ] EFX: Loaded 44790 existing records from primary storage. [2025-10-31T18:28:39.397825] [INFO ] [MAIN ] EFX: Loaded 44790 existing records. [2025-10-31T18:28:39.460237] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-31T18:28:39.585432] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T18:28:39.589583] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:28:39.592725] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-31T18:28:39.592800] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-31T18:28:39.593671] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-31T18:28:39.593732] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-31T18:28:39.941927] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:28:40.257699] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-31T18:28:40.893221] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T18:28:40.914609] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-31T18:28:41.057627] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-31T18:28:41.857664] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-31T18:28:42.458821] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-31T18:28:42.466841] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-31T18:28:42.657708] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-31T18:28:43.457685] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-31T18:28:44.115439] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T18:28:44.125997] [INFO ] [REMOTE ] EFC: Full fetch complete (66585 records). [2025-10-31T18:28:44.126123] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-31T18:28:44.126894] [FATAL] [VALIDATOR ] EFC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:28:44.126980] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:28:44.127035] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:28:44.127119] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-31T18:28:44.127195] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-31T18:28:44.127243] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-10-31T18:28:44.127442] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-10-31T18:28:44.127550] [INFO ] [MAIN ] Update Progress: 702/2365 symbols completed. EFC took 32.7s. Estimated remaining: 3h 30m 2s. Rate: 7.9 symbols/min [2025-10-31T18:28:44.216061] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-31T18:28:44.262738] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-31T18:28:44.312061] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:28:44.338746] [DEBUG] [LOCAL ] EFXT: Loaded 29717 existing records from primary storage. [2025-10-31T18:28:44.339006] [INFO ] [MAIN ] EFXT: Loaded 29717 existing records. [2025-10-31T18:28:44.509513] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:28:44.509780] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-31T18:28:44.509844] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-31T18:28:44.510425] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-31T18:28:44.510482] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-31T18:28:44.852101] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:28:45.057629] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-31T18:28:45.424456] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T18:28:45.857735] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-31T18:28:46.082372] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T18:28:46.657670] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-31T18:28:47.022933] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T18:28:47.377341] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T18:28:47.381333] [INFO ] [REMOTE ] EFT: Full fetch complete (17982 records). [2025-10-31T18:28:47.381454] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-31T18:28:47.462887] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-31T18:28:47.830913] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-31T18:28:47.830995] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-31T18:28:47.831404] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-31T18:28:47.831465] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-31T18:28:47.832033] [DEBUG] [LOCAL ] EFT: Trimmed 17982 records to 12887 (keeping 200 days of data) [2025-10-31T18:28:47.914846] [DEBUG] [LOCAL ] EFT: Primary data saved (12887 records). [2025-10-31T18:28:47.914986] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-31T18:28:47.915062] [INFO ] [MAIN ] Update Progress: 703/2365 symbols completed. EFT took 19.4s. Estimated remaining: 3h 29m 46s. Rate: 7.9 symbols/min [2025-10-31T18:28:48.090026] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:28:48.116512] [DEBUG] [LOCAL ] EG: Loaded 27650 existing records from primary storage. [2025-10-31T18:28:48.116814] [INFO ] [MAIN ] EG: Loaded 27650 existing records. [2025-10-31T18:28:48.272495] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-31T18:28:48.295282] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:28:48.295852] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-31T18:28:48.295968] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-31T18:28:48.296710] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-31T18:28:48.296766] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-31T18:28:48.564323] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T18:28:48.680717] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:28:49.057700] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-31T18:28:49.655795] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T18:28:49.664312] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-31T18:28:49.857618] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-31T18:28:50.657741] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-31T18:28:51.284526] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-31T18:28:51.457669] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-31T18:28:52.068798] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T18:28:52.257683] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-31T18:28:52.554134] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T18:28:53.057679] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-31T18:28:53.400161] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T18:28:53.857685] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-31T18:28:54.140423] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T18:28:54.433701] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-31T18:28:54.657669] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-31T18:28:55.457715] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-31T18:28:55.604003] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T18:28:56.257639] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-31T18:28:56.560732] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T18:28:56.996917] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-31T18:28:57.057608] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-31T18:28:57.857615] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-31T18:28:57.908482] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-31T18:28:58.657619] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-31T18:28:58.800514] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-31T18:28:59.457677] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-31T18:28:59.935817] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T18:29:00.172179] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T18:29:00.257695] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-31T18:29:01.057613] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-31T18:29:01.202600] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T18:29:01.857674] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-31T18:29:02.657610] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-31T18:29:02.743250] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-31T18:29:02.747376] [INFO ] [REMOTE ] EFR: Full fetch complete (19802 records). [2025-10-31T18:29:02.747447] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-31T18:29:03.135381] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-31T18:29:03.135514] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-31T18:29:03.136011] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-31T18:29:03.136150] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-31T18:29:03.159082] [DEBUG] [LOCAL ] EFR: Trimmed 19802 records to 14783 (keeping 200 days of data) [2025-10-31T18:29:03.160741] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-31T18:29:03.257804] [DEBUG] [LOCAL ] EFR: Primary data saved (14783 records). [2025-10-31T18:29:03.257955] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-31T18:29:03.258031] [INFO ] [MAIN ] Update Progress: 704/2365 symbols completed. EFR took 42.9s. Estimated remaining: 3h 29m 57s. Rate: 7.9 symbols/min [2025-10-31T18:29:03.431706] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:29:03.431857] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-10-31T18:29:03.431895] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-10-31T18:29:03.432028] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-31T18:29:03.432070] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-31T18:29:03.432112] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-31T18:29:03.432145] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-31T18:29:03.464134] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-31T18:29:03.851618] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:29:03.868945] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T18:29:04.257705] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-31T18:29:04.726364] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T18:29:05.060749] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-31T18:29:05.066724] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T18:29:05.857776] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-31T18:29:06.159773] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T18:29:06.657721] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-31T18:29:07.291811] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-31T18:29:07.302733] [INFO ] [REMOTE ] EFX: Full fetch complete (65115 records). [2025-10-31T18:29:07.302875] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-31T18:29:07.463702] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-31T18:29:07.703883] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-31T18:29:07.703971] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-31T18:29:07.704836] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-31T18:29:07.704900] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-31T18:29:07.706176] [DEBUG] [LOCAL ] EFX: Trimmed 65115 records to 45125 (keeping 200 days of data) [2025-10-31T18:29:07.987456] [DEBUG] [LOCAL ] EFX: Primary data saved (45125 records). [2025-10-31T18:29:07.987664] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-31T18:29:07.988597] [INFO ] [MAIN ] Update Progress: 705/2365 symbols completed. EFX took 28.8s. Estimated remaining: 3h 29m 42s. Rate: 7.9 symbols/min [2025-10-31T18:29:08.182445] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T18:29:08.190530] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:29:08.202033] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-10-31T18:29:08.202081] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-10-31T18:29:08.202189] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-31T18:29:08.202229] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-31T18:29:08.202269] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-31T18:29:08.202302] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-31T18:29:08.264381] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-31T18:29:08.587993] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:29:08.608242] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T18:29:09.057727] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-31T18:29:09.386616] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T18:29:09.857668] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-31T18:29:10.273894] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T18:29:10.657620] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-31T18:29:10.727626] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-31T18:29:11.457770] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-31T18:29:11.673899] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T18:29:12.257710] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-31T18:29:12.287424] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T18:29:13.057663] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-31T18:29:13.216285] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T18:29:13.857619] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-31T18:29:13.952098] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T18:29:14.657625] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-31T18:29:14.761819] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-31T18:29:15.457702] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-31T18:29:15.649994] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T18:29:16.257676] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-31T18:29:16.382982] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T18:29:16.391189] [INFO ] [REMOTE ] EFXT: Full fetch complete (44355 records). [2025-10-31T18:29:16.391309] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-31T18:29:16.764458] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-31T18:29:16.764533] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-31T18:29:16.765168] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-31T18:29:16.765229] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-31T18:29:16.766102] [DEBUG] [LOCAL ] EFXT: Trimmed 44355 records to 29972 (keeping 200 days of data) [2025-10-31T18:29:16.934920] [DEBUG] [LOCAL ] EFXT: Primary data saved (29972 records). [2025-10-31T18:29:16.935042] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-31T18:29:16.935117] [INFO ] [MAIN ] Update Progress: 706/2365 symbols completed. EFXT took 32.8s. Estimated remaining: 3h 29m 38s. Rate: 7.9 symbols/min [2025-10-31T18:29:17.062740] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-31T18:29:17.116418] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:29:17.116611] [DEBUG] [LOCAL ] EGY: No existing data file found in primary storage. [2025-10-31T18:29:17.116685] [WARN ] [MAIN ] EGY: No existing data found, performing full refresh instead. [2025-10-31T18:29:17.116797] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-31T18:29:17.116839] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-31T18:29:17.116883] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-31T18:29:17.116916] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-31T18:29:17.496290] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:29:17.540049] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T18:29:17.857716] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-31T18:29:18.135716] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T18:29:18.141737] [INFO ] [REMOTE ] EG: Full fetch complete (42827 records). [2025-10-31T18:29:18.141828] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-31T18:29:18.509228] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-31T18:29:18.509305] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-31T18:29:18.509915] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-31T18:29:18.509976] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-31T18:29:18.510798] [DEBUG] [LOCAL ] EG: Trimmed 42827 records to 27940 (keeping 200 days of data) [2025-10-31T18:29:18.665052] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-31T18:29:18.679618] [DEBUG] [LOCAL ] EG: Primary data saved (27940 records). [2025-10-31T18:29:18.679744] [INFO ] [MAIN ] EG: Full history saved. [2025-10-31T18:29:18.679831] [INFO ] [MAIN ] Update Progress: 707/2365 symbols completed. EG took 30.8s. Estimated remaining: 3h 29m 17s. Rate: 7.9 symbols/min [2025-10-31T18:29:18.844753] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:29:18.869738] [DEBUG] [LOCAL ] EHAB: Loaded 29129 existing records from primary storage. [2025-10-31T18:29:18.869982] [INFO ] [MAIN ] EHAB: Loaded 29129 existing records. [2025-10-31T18:29:19.046815] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:29:19.047037] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-31T18:29:19.047113] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-31T18:29:19.047813] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-31T18:29:19.047891] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-31T18:29:19.410218] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:29:19.438693] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T18:29:19.457610] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-31T18:29:19.879494] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T18:29:20.257722] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-31T18:29:20.681518] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T18:29:21.057678] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-31T18:29:21.278284] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T18:29:21.857697] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-31T18:29:22.334491] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T18:29:22.657663] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-31T18:29:23.098111] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T18:29:23.457637] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-31T18:29:23.865023] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T18:29:24.257638] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-31T18:29:24.368294] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T18:29:25.057672] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-31T18:29:25.354280] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T18:29:25.741039] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-31T18:29:25.857633] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-31T18:29:26.657744] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-31T18:29:26.709150] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-31T18:29:27.457675] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-31T18:29:27.951954] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T18:29:28.257664] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-31T18:29:28.748399] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T18:29:29.057713] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-31T18:29:29.416505] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T18:29:29.857663] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-31T18:29:29.937407] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T18:29:30.657694] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-31T18:29:30.923157] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-31T18:29:31.457678] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-31T18:29:32.047105] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-31T18:29:32.254250] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-31T18:29:32.260202] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-31T18:29:33.057671] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-31T18:29:33.421354] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T18:29:33.857622] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-31T18:29:34.002202] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T18:29:34.657689] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-31T18:29:35.127001] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T18:29:35.457666] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-31T18:29:35.744185] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T18:29:36.257624] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-31T18:29:36.421770] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T18:29:37.057674] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-31T18:29:37.495371] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T18:29:37.857671] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-31T18:29:38.032486] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-31T18:29:38.657674] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-31T18:29:39.457626] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-31T18:29:39.565120] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T18:29:39.669897] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-31T18:29:39.682069] [INFO ] [REMOTE ] EGO: Full fetch complete (74804 records). [2025-10-31T18:29:39.682237] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-31T18:29:40.065747] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-31T18:29:40.065823] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-31T18:29:40.066687] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-31T18:29:40.066750] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-31T18:29:40.068104] [DEBUG] [LOCAL ] EGO: Trimmed 74804 records to 52452 (keeping 200 days of data) [2025-10-31T18:29:40.264076] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-31T18:29:40.371260] [DEBUG] [LOCAL ] EGO: Primary data saved (52452 records). [2025-10-31T18:29:40.371380] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-31T18:29:40.371447] [INFO ] [MAIN ] Update Progress: 708/2365 symbols completed. EGO took 37.1s. Estimated remaining: 3h 29m 42s. Rate: 7.9 symbols/min [2025-10-31T18:29:40.543405] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:29:40.567147] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T18:29:40.609038] [DEBUG] [LOCAL ] EHC: Loaded 40933 existing records from primary storage. [2025-10-31T18:29:40.609306] [INFO ] [MAIN ] EHC: Loaded 40933 existing records. [2025-10-31T18:29:40.786224] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:29:40.786489] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-31T18:29:40.786542] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-31T18:29:40.787282] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-31T18:29:40.787341] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-31T18:29:41.059978] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-31T18:29:41.139139] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:29:41.169065] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-31T18:29:41.857709] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-31T18:29:42.323523] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T18:29:42.336475] [INFO ] [REMOTE ] EGY: Full fetch complete (60346 records). [2025-10-31T18:29:42.336664] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-31T18:29:42.662784] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-31T18:29:42.749916] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-31T18:29:42.750035] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-31T18:29:42.750849] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-31T18:29:42.750943] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-31T18:29:42.752466] [DEBUG] [LOCAL ] EGY: Trimmed 60346 records to 41265 (keeping 200 days of data) [2025-10-31T18:29:43.001218] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T18:29:43.010594] [DEBUG] [LOCAL ] EGY: Primary data saved (41265 records). [2025-10-31T18:29:43.010749] [INFO ] [REMOTE ] EGP: Full fetch complete (45593 records). [2025-10-31T18:29:43.010961] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-31T18:29:43.011047] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-31T18:29:43.011212] [INFO ] [MAIN ] Update Progress: 709/2365 symbols completed. EGY took 26.1s. Estimated remaining: 3h 29m 23s. Rate: 7.9 symbols/min [2025-10-31T18:29:43.321624] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:29:43.460781] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-31T18:29:43.499049] [DEBUG] [LOCAL ] EHI: Loaded 10710 existing records from primary storage. [2025-10-31T18:29:43.504942] [INFO ] [MAIN ] EHI: Loaded 10710 existing records. [2025-10-31T18:29:43.693056] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-31T18:29:43.693254] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-31T18:29:43.693928] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-31T18:29:43.694007] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-31T18:29:43.746963] [DEBUG] [LOCAL ] EGP: Trimmed 45593 records to 30241 (keeping 200 days of data) [2025-10-31T18:29:43.773292] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:29:43.774439] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-31T18:29:43.774539] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-31T18:29:43.774929] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-31T18:29:43.774986] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-31T18:29:44.264180] [DEBUG] [LOCAL ] EGP: Primary data saved (30241 records). [2025-10-31T18:29:44.285050] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-31T18:29:44.303912] [INFO ] [MAIN ] Update Progress: 710/2365 symbols completed. EGP took 36.3s. Estimated remaining: 3h 29m 1s. Rate: 7.9 symbols/min [2025-10-31T18:29:44.378695] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:29:44.379030] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-31T18:29:44.411416] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-31T18:29:44.574118] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:29:44.575818] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T18:29:44.602532] [DEBUG] [LOCAL ] EIC: Loaded 21909 existing records from primary storage. [2025-10-31T18:29:44.602812] [INFO ] [MAIN ] EIC: Loaded 21909 existing records. [2025-10-31T18:29:44.782056] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:29:44.782291] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-31T18:29:44.782342] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-31T18:29:44.783059] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-31T18:29:44.783118] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-31T18:29:45.062805] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-31T18:29:45.099301] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T18:29:45.170244] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:29:45.857620] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-31T18:29:46.001751] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T18:29:46.657631] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-31T18:29:46.810183] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T18:29:47.457618] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-31T18:29:47.527884] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T18:29:47.533688] [INFO ] [REMOTE ] EHAB: Full fetch complete (41082 records). [2025-10-31T18:29:47.533772] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-31T18:29:47.910557] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-31T18:29:47.910668] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-31T18:29:47.911358] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-31T18:29:47.911433] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-31T18:29:47.912470] [DEBUG] [LOCAL ] EHAB: Trimmed 41082 records to 29287 (keeping 200 days of data) [2025-10-31T18:29:48.071702] [DEBUG] [LOCAL ] EHAB: Primary data saved (29287 records). [2025-10-31T18:29:48.071827] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-31T18:29:48.071902] [INFO ] [MAIN ] Update Progress: 711/2365 symbols completed. EHAB took 29.4s. Estimated remaining: 3h 28m 44s. Rate: 7.9 symbols/min [2025-10-31T18:29:48.269360] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-31T18:29:48.271873] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:29:48.272928] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-31T18:29:48.272999] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-31T18:29:48.273141] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-31T18:29:48.273243] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-31T18:29:48.273398] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-31T18:29:48.273461] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-31T18:29:48.413108] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T18:29:48.651009] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:29:48.927597] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T18:29:49.057636] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-31T18:29:49.567750] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-31T18:29:49.857621] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-31T18:29:50.308976] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-31T18:29:50.657633] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-31T18:29:51.174089] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T18:29:51.457703] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-31T18:29:52.257689] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-31T18:29:52.475997] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T18:29:53.057730] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-31T18:29:53.220581] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T18:29:53.506234] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-31T18:29:53.857718] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-31T18:29:54.256428] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-31T18:29:54.657699] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-31T18:29:54.882368] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-31T18:29:55.457704] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-31T18:29:55.688194] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-31T18:29:56.257697] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-31T18:29:57.057617] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-31T18:29:57.170067] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-31T18:29:57.857715] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-31T18:29:58.233747] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T18:29:58.546078] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-31T18:29:58.657741] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-31T18:29:59.171309] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-31T18:29:59.457716] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-31T18:30:00.258874] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-31T18:30:00.260946] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-31T18:30:01.057714] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-31T18:30:01.814374] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-31T18:30:01.857688] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-31T18:30:02.430856] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T18:30:02.657700] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-31T18:30:03.207317] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T18:30:03.457682] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-31T18:30:03.766872] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T18:30:04.257681] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-31T18:30:04.544371] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T18:30:05.057681] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-31T18:30:05.315480] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T18:30:05.857686] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-31T18:30:06.462422] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T18:30:06.664059] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-31T18:30:06.666305] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-31T18:30:06.983227] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-31T18:30:07.457773] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-31T18:30:08.257634] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-31T18:30:08.961542] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T18:30:09.057709] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-31T18:30:09.116945] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T18:30:09.839781] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T18:30:09.843108] [INFO ] [REMOTE ] EHI: Full fetch complete (15795 records). [2025-10-31T18:30:09.843182] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-31T18:30:09.864219] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-31T18:30:10.205580] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-31T18:30:10.205682] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-31T18:30:10.205992] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-31T18:30:10.206033] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-31T18:30:10.206497] [DEBUG] [LOCAL ] EHI: Trimmed 15795 records to 10849 (keeping 200 days of data) [2025-10-31T18:30:10.266832] [DEBUG] [LOCAL ] EHI: Primary data saved (10849 records). [2025-10-31T18:30:10.266964] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-31T18:30:10.267043] [INFO ] [MAIN ] Update Progress: 712/2365 symbols completed. EHI took 27.3s. Estimated remaining: 3h 29m 11s. Rate: 7.9 symbols/min [2025-10-31T18:30:10.434177] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:10.434332] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-31T18:30:10.434387] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-31T18:30:10.434497] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-31T18:30:10.434538] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-31T18:30:10.434578] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-31T18:30:10.434609] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-31T18:30:10.668741] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-31T18:30:10.786299] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:30:10.976357] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-31T18:30:11.091217] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T18:30:11.457699] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-31T18:30:12.257753] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-31T18:30:12.918854] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T18:30:13.057674] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-31T18:30:13.845904] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T18:30:13.850174] [INFO ] [REMOTE ] EIC: Full fetch complete (33605 records). [2025-10-31T18:30:13.850260] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-31T18:30:13.863688] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-31T18:30:14.245394] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-31T18:30:14.245231] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-31T18:30:14.245565] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-31T18:30:14.247815] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-31T18:30:14.247917] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-31T18:30:14.248738] [DEBUG] [LOCAL ] EIC: Trimmed 33605 records to 22038 (keeping 200 days of data) [2025-10-31T18:30:14.382826] [DEBUG] [LOCAL ] EIC: Primary data saved (22038 records). [2025-10-31T18:30:14.382945] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-31T18:30:14.383021] [INFO ] [MAIN ] Update Progress: 713/2365 symbols completed. EIC took 30.0s. Estimated remaining: 3h 28m 55s. Rate: 7.9 symbols/min [2025-10-31T18:30:14.556558] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:14.556777] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-31T18:30:14.556820] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-31T18:30:14.556934] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-31T18:30:14.556976] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-31T18:30:14.557017] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-31T18:30:14.557050] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-31T18:30:14.662733] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-31T18:30:14.944434] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:30:14.947854] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-31T18:30:15.228625] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-31T18:30:15.237596] [INFO ] [REMOTE ] EHC: Full fetch complete (58698 records). [2025-10-31T18:30:15.237751] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-31T18:30:15.238396] [FATAL] [VALIDATOR ] EHC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:30:15.238482] [FATAL] [MAIN ] EHC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:30:15.238525] [WARN ] [MAIN ] EHC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:30:15.238606] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-31T18:30:15.238714] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-31T18:30:15.238763] [INFO ] [LOCAL ] EHC: Starting deletion of derivative data. [2025-10-31T18:30:15.238939] [DEBUG] [LOCAL ] EHC: Deleted derivative data file. [2025-10-31T18:30:15.239698] [INFO ] [MAIN ] Update Progress: 714/2365 symbols completed. EHC took 34.9s. Estimated remaining: 3h 28m 32s. Rate: 7.9 symbols/min [2025-10-31T18:30:15.409126] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:15.430161] [DEBUG] [LOCAL ] EIG: Loaded 19862 existing records from primary storage. [2025-10-31T18:30:15.430434] [INFO ] [MAIN ] EIG: Loaded 19862 existing records. [2025-10-31T18:30:15.463169] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-31T18:30:15.622752] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:30:15.623012] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-31T18:30:15.623068] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-31T18:30:15.623566] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-31T18:30:15.623624] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-31T18:30:15.839258] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-31T18:30:16.066716] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:30:16.257690] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-31T18:30:17.057688] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-31T18:30:17.330851] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-31T18:30:17.370244] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:30:17.857685] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-31T18:30:18.313876] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T18:30:18.657768] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-31T18:30:19.360533] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T18:30:19.457681] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-31T18:30:19.735979] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-31T18:30:20.257675] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-31T18:30:20.519609] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-31T18:30:21.057664] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-31T18:30:21.453827] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T18:30:21.857673] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-31T18:30:22.619137] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T18:30:22.657614] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-31T18:30:23.370185] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T18:30:23.457625] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-31T18:30:23.840066] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-31T18:30:24.257668] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-31T18:30:24.689471] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T18:30:25.057688] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-31T18:30:25.357057] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-31T18:30:25.857672] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-31T18:30:26.271399] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-31T18:30:26.657737] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-31T18:30:27.032492] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T18:30:27.457634] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-31T18:30:27.908083] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-31T18:30:28.257670] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-31T18:30:28.730806] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T18:30:29.057679] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-31T18:30:29.360846] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-31T18:30:29.857708] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-31T18:30:30.269268] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-31T18:30:30.271151] [INFO ] [REMOTE ] EICC: Full fetch complete (8478 records). [2025-10-31T18:30:30.271218] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-31T18:30:30.271579] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:30:30.271681] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:30:30.271734] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:30:30.271774] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-31T18:30:30.271827] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-31T18:30:30.271863] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-31T18:30:30.271901] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-31T18:30:30.271952] [INFO ] [MAIN ] Update Progress: 715/2365 symbols completed. EICC took 15.9s. Estimated remaining: 3h 28m 41s. Rate: 7.9 symbols/min [2025-10-31T18:30:30.442417] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:30.489720] [DEBUG] [LOCAL ] EIX: Loaded 53726 existing records from primary storage. [2025-10-31T18:30:30.490049] [INFO ] [MAIN ] EIX: Loaded 53726 existing records. [2025-10-31T18:30:30.659075] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-31T18:30:30.679864] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:30:30.680735] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-31T18:30:30.680782] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-31T18:30:30.681826] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-31T18:30:30.681883] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-31T18:30:31.032893] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:30:31.204303] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-31T18:30:31.457738] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-31T18:30:32.257688] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-31T18:30:32.328928] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-31T18:30:32.646542] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-31T18:30:33.057704] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-31T18:30:33.289594] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-31T18:30:33.857683] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-31T18:30:34.657710] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-31T18:30:35.008473] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-31T18:30:35.009288] [INFO ] [REMOTE ] EICA: Full fetch complete (1170 records). [2025-10-31T18:30:35.009354] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-31T18:30:35.193588] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-31T18:30:35.193857] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:30:35.193943] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:30:35.194174] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-31T18:30:35.194393] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-31T18:30:35.194490] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-31T18:30:35.194549] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-31T18:30:35.194605] [INFO ] [MAIN ] Update Progress: 716/2365 symbols completed. EICA took 47.1s. Estimated remaining: 3h 28m 28s. Rate: 7.9 symbols/min [2025-10-31T18:30:35.369602] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:35.400769] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-31T18:30:35.451631] [DEBUG] [LOCAL ] EL: Loaded 53758 existing records from primary storage. [2025-10-31T18:30:35.451947] [INFO ] [MAIN ] EL: Loaded 53758 existing records. [2025-10-31T18:30:35.463040] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-31T18:30:35.627189] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:30:35.627372] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-31T18:30:35.627418] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-31T18:30:35.627631] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-31T18:30:35.627720] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-31T18:30:35.972742] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:30:36.194810] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T18:30:36.257675] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-31T18:30:37.057716] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-31T18:30:37.590324] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T18:30:37.610849] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-31T18:30:37.857716] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-31T18:30:38.657705] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-31T18:30:39.457623] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-31T18:30:39.889145] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T18:30:40.267180] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-31T18:30:40.268419] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T18:30:40.382992] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-31T18:30:40.570307] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-31T18:30:41.057678] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-31T18:30:41.857620] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-31T18:30:41.912523] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-31T18:30:42.657724] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-31T18:30:43.394017] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T18:30:43.466871] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-31T18:30:43.486517] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-31T18:30:44.247209] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T18:30:44.252411] [INFO ] [REMOTE ] EIG: Full fetch complete (27501 records). [2025-10-31T18:30:44.252573] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-31T18:30:44.265876] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-31T18:30:44.644080] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-31T18:30:44.644174] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-31T18:30:44.644792] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-31T18:30:44.644855] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-31T18:30:44.645511] [DEBUG] [LOCAL ] EIG: Trimmed 27501 records to 20069 (keeping 200 days of data) [2025-10-31T18:30:44.768468] [DEBUG] [LOCAL ] EIG: Primary data saved (20069 records). [2025-10-31T18:30:44.768598] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-31T18:30:44.768698] [INFO ] [MAIN ] Update Progress: 717/2365 symbols completed. EIG took 29.5s. Estimated remaining: 3h 28m 25s. Rate: 7.9 symbols/min [2025-10-31T18:30:45.057708] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-31T18:30:45.848303] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T18:30:45.860208] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-31T18:30:46.348501] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-31T18:30:46.350022] [INFO ] [REMOTE ] EICB: Full fetch complete (2621 records). [2025-10-31T18:30:46.350114] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-31T18:30:46.350616] [FATAL] [VALIDATOR ] EICB: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:30:46.350738] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:30:46.350798] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:30:46.350859] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-31T18:30:46.350942] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-31T18:30:46.350996] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-31T18:30:46.351111] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-31T18:30:46.351197] [INFO ] [MAIN ] Update Progress: 718/2365 symbols completed. EICB took 36.1s. Estimated remaining: 3h 28m 3s. Rate: 7.9 symbols/min [2025-10-31T18:30:46.657683] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-31T18:30:46.731967] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-31T18:30:47.457675] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-31T18:30:48.049664] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T18:30:48.257669] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-31T18:30:48.987493] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T18:30:49.057696] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-31T18:30:49.786163] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T18:30:49.857708] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-31T18:30:50.497049] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T18:30:50.657699] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-31T18:30:51.966622] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-31T18:30:51.978498] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-31T18:30:52.190117] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T18:30:52.257684] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-31T18:30:53.433622] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-31T18:30:53.445691] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-31T18:30:53.780104] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T18:30:53.857690] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-31T18:30:55.106441] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-31T18:30:55.118249] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-31T18:30:55.367040] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-31T18:30:55.457690] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-31T18:30:55.741910] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T18:30:55.754344] [INFO ] [REMOTE ] EIX: Full fetch complete (77444 records). [2025-10-31T18:30:55.754483] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-31T18:30:56.162797] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-31T18:30:56.162879] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-31T18:30:56.163757] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-31T18:30:56.163820] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-31T18:30:56.165249] [DEBUG] [LOCAL ] EIX: Trimmed 77444 records to 54113 (keeping 200 days of data) [2025-10-31T18:30:56.492323] [DEBUG] [LOCAL ] EIX: Primary data saved (54113 records). [2025-10-31T18:30:56.492447] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-31T18:30:56.492521] [INFO ] [MAIN ] Update Progress: 719/2365 symbols completed. EIX took 26.2s. Estimated remaining: 3h 28m 2s. Rate: 7.9 symbols/min [2025-10-31T18:30:56.918430] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T18:30:56.929536] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-31T18:30:57.614199] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T18:30:57.626167] [INFO ] [REMOTE ] EL: Full fetch complete (77452 records). [2025-10-31T18:30:57.626299] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-31T18:30:58.010434] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-31T18:30:58.010525] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-31T18:30:58.011421] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-31T18:30:58.011483] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-31T18:30:58.012948] [DEBUG] [LOCAL ] EL: Trimmed 77452 records to 54147 (keeping 200 days of data) [2025-10-31T18:30:58.339280] [DEBUG] [LOCAL ] EL: Primary data saved (54147 records). [2025-10-31T18:30:58.339420] [INFO ] [MAIN ] EL: Full history saved. [2025-10-31T18:30:58.339500] [INFO ] [MAIN ] Update Progress: 720/2365 symbols completed. EL took 23.1s. Estimated remaining: 3h 27m 41s. Rate: 7.9 symbols/min [2025-10-31T18:30:58.953435] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:59.027708] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:59.089824] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:59.092168] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:30:59.100399] [DEBUG] [LOCAL ] ELC: Loaded 3461 existing records from primary storage. [2025-10-31T18:30:59.101035] [INFO ] [MAIN ] ELC: Loaded 3461 existing records. [2025-10-31T18:30:59.358502] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:30:59.373776] [DEBUG] [LOCAL ] ELAN: Loaded 53689 existing records from primary storage. [2025-10-31T18:30:59.374127] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-31T18:30:59.375490] [DEBUG] [LOCAL ] ELF: Loaded 52015 existing records from primary storage. [2025-10-31T18:30:59.375670] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-31T18:30:59.374675] [DEBUG] [LOCAL ] ELME: Loaded 39631 existing records from primary storage. [2025-10-31T18:30:59.376282] [INFO ] [MAIN ] ELF: Loaded 52015 existing records. [2025-10-31T18:30:59.376175] [INFO ] [MAIN ] ELAN: Loaded 53689 existing records. [2025-10-31T18:30:59.381877] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-31T18:30:59.376413] [INFO ] [MAIN ] ELME: Loaded 39631 existing records. [2025-10-31T18:30:59.456587] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-31T18:30:59.967686] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:31:00.007589] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-31T18:31:00.013202] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-31T18:31:00.032916] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:31:00.043339] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-31T18:31:00.053726] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-31T18:31:00.043130] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:31:00.091734] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-31T18:31:00.144355] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-31T18:31:00.179360] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-31T18:31:00.179430] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-31T18:31:00.205404] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-31T18:31:00.225398] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-31T18:31:00.370334] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-31T18:31:00.408879] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-31T18:31:00.777928] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:00.822486] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-31T18:31:01.204985] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:01.240620] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-31T18:31:01.296858] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:01.315031] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-31T18:31:01.423905] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:01.424244] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-31T18:31:03.279616] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-31T18:31:03.281045] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-31T18:31:03.619702] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-31T18:31:03.621047] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-31T18:31:04.234702] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-31T18:31:04.236068] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-31T18:31:04.285467] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (2.97 seconds). [2025-10-31T18:31:04.296631] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-31T18:31:04.315871] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (3.08 seconds). [2025-10-31T18:31:04.322874] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-31T18:31:04.592109] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (3.17 seconds). [2025-10-31T18:31:04.602125] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-31T18:31:04.609296] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T18:31:05.057734] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-31T18:31:05.410821] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T18:31:05.489479] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T18:31:05.857718] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-31T18:31:06.372455] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-31T18:31:06.657679] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-31T18:31:07.137312] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T18:31:07.457711] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-31T18:31:08.257722] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-31T18:31:08.747370] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T18:31:08.839045] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-31T18:31:08.997162] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (3.94 seconds). [2025-10-31T18:31:09.057676] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-31T18:31:09.407472] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T18:31:09.427765] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-31T18:31:09.857677] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-31T18:31:10.229767] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T18:31:10.657693] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-31T18:31:11.172511] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-31T18:31:11.457734] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-31T18:31:11.837666] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-31T18:31:12.257688] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-31T18:31:12.313610] [DEBUG] [REMOTE ] ELF: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-31T18:31:12.313987] [WARN ] [REMOTE ] ELF: No data returned for month 2025-04 [2025-10-31T18:31:12.314097] [FATAL] [REMOTE ] ELF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:31:12.314218] [FATAL] [MAIN ] ELF: Failed to fetch primary data. [2025-10-31T18:31:12.314300] [WARN ] [MAIN ] ELF: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:31:12.314389] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-31T18:31:12.314470] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-31T18:31:12.314537] [INFO ] [LOCAL ] ELF: Starting deletion of derivative data. [2025-10-31T18:31:12.314784] [DEBUG] [LOCAL ] ELF: Deleted derivative data file. [2025-10-31T18:31:12.316101] [INFO ] [MAIN ] Update Progress: 721/2365 symbols completed. ELF took 14.0s. Estimated remaining: 3h 27m 48s. Rate: 7.9 symbols/min [2025-10-31T18:31:12.490836] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:31:12.517063] [DEBUG] [LOCAL ] ELP: Loaded 25313 existing records from primary storage. [2025-10-31T18:31:12.517352] [INFO ] [MAIN ] ELP: Loaded 25313 existing records. [2025-10-31T18:31:12.700869] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:31:12.701120] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-31T18:31:12.701172] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-31T18:31:12.701372] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-31T18:31:12.701429] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-31T18:31:13.072591] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-31T18:31:13.078321] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:13.614946] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-31T18:31:13.616285] [INFO ] [REMOTE ] ELC: Full fetch complete (4904 records). [2025-10-31T18:31:13.616354] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-31T18:31:13.616737] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:31:13.616851] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:31:13.616893] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:31:13.616930] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-31T18:31:13.616997] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-31T18:31:13.617050] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-10-31T18:31:13.617528] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-10-31T18:31:13.617614] [INFO ] [MAIN ] Update Progress: 722/2365 symbols completed. ELC took 15.3s. Estimated remaining: 3h 27m 26s. Rate: 7.9 symbols/min [2025-10-31T18:31:13.796598] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:31:13.796782] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-31T18:31:13.796827] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-31T18:31:13.796939] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-31T18:31:13.797003] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-31T18:31:13.797066] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-31T18:31:13.797108] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-31T18:31:13.862711] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-31T18:31:14.199869] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:14.657715] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-31T18:31:14.846234] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:31:15.019093] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-31T18:31:15.457728] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-31T18:31:15.777906] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T18:31:16.257707] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-31T18:31:16.513349] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-31T18:31:17.057672] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-31T18:31:17.857673] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-31T18:31:18.178299] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T18:31:18.598808] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T18:31:18.657633] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-31T18:31:19.395631] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T18:31:19.457618] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-31T18:31:20.257631] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-31T18:31:20.343804] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-31T18:31:21.057702] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-31T18:31:21.352312] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-31T18:31:21.741216] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-31T18:31:21.857616] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-31T18:31:22.657681] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-31T18:31:22.912233] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-31T18:31:23.080222] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T18:31:23.457637] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-31T18:31:24.257681] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-31T18:31:24.511822] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T18:31:25.057682] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-31T18:31:25.845603] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T18:31:25.857959] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-31T18:31:26.065699] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T18:31:26.196757] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-31T18:31:26.657715] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-31T18:31:27.457684] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-31T18:31:28.257689] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-31T18:31:28.413276] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-31T18:31:28.478271] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T18:31:28.478408] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-10-31T18:31:29.057697] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-31T18:31:29.282091] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-31T18:31:29.857683] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-31T18:31:30.657719] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-31T18:31:30.977408] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T18:31:31.324964] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T18:31:31.457675] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-31T18:31:32.257717] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-31T18:31:32.287304] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T18:31:33.057682] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-31T18:31:33.424362] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-31T18:31:33.857719] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-31T18:31:33.914488] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-31T18:31:34.657688] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-31T18:31:34.952459] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-31T18:31:35.222763] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-31T18:31:35.457685] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-31T18:31:35.637146] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-10-31T18:31:36.257669] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-31T18:31:37.057737] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-31T18:31:37.577376] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T18:31:37.591069] [INFO ] [REMOTE ] ELME: Full fetch complete (56480 records). [2025-10-31T18:31:37.591268] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-31T18:31:37.869236] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-31T18:31:37.999595] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-31T18:31:37.999720] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-31T18:31:38.000465] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-31T18:31:38.000509] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-31T18:31:38.001743] [DEBUG] [LOCAL ] ELME: Trimmed 56480 records to 39972 (keeping 200 days of data) [2025-10-31T18:31:38.241929] [DEBUG] [LOCAL ] ELME: Primary data saved (39972 records). [2025-10-31T18:31:38.242112] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-31T18:31:38.242216] [INFO ] [MAIN ] Update Progress: 723/2365 symbols completed. ELME took 39.9s. Estimated remaining: 3h 27m 57s. Rate: 7.9 symbols/min [2025-10-31T18:31:38.322142] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-31T18:31:38.336468] [INFO ] [REMOTE ] ELPC: Full fetch complete (1235 records). [2025-10-31T18:31:38.336566] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-31T18:31:38.538522] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:31:38.572057] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-10-31T18:31:38.620950] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-10-31T18:31:38.636206] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-31T18:31:38.636317] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-31T18:31:38.646015] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-31T18:31:38.669335] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-31T18:31:38.669227] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-31T18:31:38.690851] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:31:38.705174] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:31:38.690706] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-31T18:31:38.710680] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-31T18:31:38.725206] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-31T18:31:38.734356] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-31T18:31:38.755371] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-31T18:31:38.765901] [INFO ] [MAIN ] Update Progress: 724/2365 symbols completed. ELPC took 25.1s. Estimated remaining: 3h 27m 34s. Rate: 7.9 symbols/min [2025-10-31T18:31:39.128054] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:31:39.182546] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-31T18:31:39.255899] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:39.293636] [DEBUG] [LOCAL ] ELV: Loaded 51021 existing records from primary storage. [2025-10-31T18:31:39.293958] [INFO ] [MAIN ] ELV: Loaded 51021 existing records. [2025-10-31T18:31:39.471682] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-31T18:31:39.493981] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:31:39.494341] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-31T18:31:39.494407] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-31T18:31:39.495422] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-31T18:31:39.495482] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-31T18:31:39.864173] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:39.879381] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T18:31:39.885011] [INFO ] [REMOTE ] ELP: Full fetch complete (36675 records). [2025-10-31T18:31:39.885098] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-31T18:31:40.255123] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-31T18:31:40.255198] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-31T18:31:40.255788] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-31T18:31:40.255848] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-31T18:31:40.256627] [DEBUG] [LOCAL ] ELP: Trimmed 36675 records to 25521 (keeping 200 days of data) [2025-10-31T18:31:40.257678] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-31T18:31:40.397331] [DEBUG] [LOCAL ] ELP: Primary data saved (25521 records). [2025-10-31T18:31:40.397453] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-31T18:31:40.397530] [INFO ] [MAIN ] Update Progress: 725/2365 symbols completed. ELP took 28.1s. Estimated remaining: 3h 27m 12s. Rate: 7.9 symbols/min [2025-10-31T18:31:40.562938] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:31:40.563097] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-31T18:31:40.563132] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-31T18:31:40.563239] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-31T18:31:40.563279] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-31T18:31:40.563320] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-31T18:31:40.563351] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-31T18:31:40.915516] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:40.968082] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T18:31:40.980239] [INFO ] [REMOTE ] ELAN: Full fetch complete (77102 records). [2025-10-31T18:31:40.980403] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-31T18:31:41.062819] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-31T18:31:41.430734] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-31T18:31:41.430824] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-31T18:31:41.431813] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-31T18:31:41.431877] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-31T18:31:41.433430] [DEBUG] [LOCAL ] ELAN: Trimmed 77102 records to 54079 (keeping 200 days of data) [2025-10-31T18:31:41.759873] [DEBUG] [LOCAL ] ELAN: Primary data saved (54079 records). [2025-10-31T18:31:41.760094] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-31T18:31:41.761118] [INFO ] [MAIN ] Update Progress: 726/2365 symbols completed. ELAN took 43.4s. Estimated remaining: 3h 26m 51s. Rate: 7.9 symbols/min [2025-10-31T18:31:41.860607] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-31T18:31:41.922992] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-31T18:31:41.986544] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:31:42.007614] [DEBUG] [LOCAL ] EMD: Loaded 20579 existing records from primary storage. [2025-10-31T18:31:42.007914] [INFO ] [MAIN ] EMD: Loaded 20579 existing records. [2025-10-31T18:31:42.165448] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T18:31:42.183667] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-31T18:31:42.187505] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:31:42.187829] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:31:42.188048] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-31T18:31:42.188166] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:31:42.188216] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-31T18:31:42.188271] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-31T18:31:42.188308] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-31T18:31:42.191129] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-31T18:31:42.191033] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-31T18:31:42.191305] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-31T18:31:42.191251] [INFO ] [MAIN ] Update Progress: 727/2365 symbols completed. EMA took 1.8s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min [2025-10-31T18:31:42.221761] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-31T18:31:42.245777] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-31T18:31:42.526806] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:31:42.664599] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-31T18:31:42.792044] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:42.794893] [DEBUG] [LOCAL ] EME: Loaded 30760 existing records from primary storage. [2025-10-31T18:31:42.805516] [INFO ] [MAIN ] EME: Loaded 30760 existing records. [2025-10-31T18:31:42.847919] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-31T18:31:43.054457] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:31:43.054696] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-31T18:31:43.054756] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-31T18:31:43.055403] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-31T18:31:43.055463] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-31T18:31:43.406457] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:31:43.457607] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-31T18:31:44.097822] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-31T18:31:44.257635] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-31T18:31:44.550339] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T18:31:45.057694] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-31T18:31:45.569111] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T18:31:45.857685] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-31T18:31:46.198342] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T18:31:46.657710] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-31T18:31:46.963768] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T18:31:47.457686] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-31T18:31:48.203757] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T18:31:48.257635] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-31T18:31:48.713572] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T18:31:49.057679] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-31T18:31:49.692363] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T18:31:49.857634] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-31T18:31:49.945093] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T18:31:50.657676] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-31T18:31:51.050426] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T18:31:51.457626] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-31T18:31:52.179511] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-31T18:31:52.257674] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-31T18:31:52.890495] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-31T18:31:53.057680] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-31T18:31:53.458843] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T18:31:53.857668] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-31T18:31:54.288104] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T18:31:54.657699] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-31T18:31:55.109257] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T18:31:55.457687] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-31T18:31:56.257740] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-31T18:31:56.369424] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-31T18:31:56.425477] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T18:31:57.057711] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-31T18:31:57.433272] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T18:31:57.858337] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-31T18:31:58.071985] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T18:31:58.657678] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-31T18:31:58.977003] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T18:31:59.457685] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-31T18:32:00.203823] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-31T18:32:00.257679] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-31T18:32:00.789316] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T18:32:01.057712] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-31T18:32:01.854774] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-31T18:32:01.866226] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-31T18:32:02.590040] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-31T18:32:02.657701] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-31T18:32:03.270200] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-31T18:32:03.457687] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-31T18:32:03.486254] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-31T18:32:04.257710] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-31T18:32:04.699303] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T18:32:05.057724] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-31T18:32:05.372084] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T18:32:05.857634] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-31T18:32:06.657689] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-31T18:32:06.992623] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-31T18:32:07.003824] [INFO ] [REMOTE ] ELV: Full fetch complete (72917 records). [2025-10-31T18:32:07.003981] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-31T18:32:07.004601] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:32:07.004710] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:32:07.004771] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:32:07.004854] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-31T18:32:07.004931] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-31T18:32:07.004980] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-31T18:32:07.005166] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-10-31T18:32:07.005262] [INFO ] [MAIN ] Update Progress: 728/2365 symbols completed. ELV took 28.2s. Estimated remaining: 3h 26m 58s. Rate: 7.9 symbols/min [2025-10-31T18:32:07.185024] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:32:07.193731] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T18:32:07.203997] [DEBUG] [LOCAL ] EMF: Loaded 3054 existing records from primary storage. [2025-10-31T18:32:07.204295] [INFO ] [MAIN ] EMF: Loaded 3054 existing records. [2025-10-31T18:32:07.204134] [INFO ] [REMOTE ] EME: Full fetch complete (46875 records). [2025-10-31T18:32:07.235363] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-31T18:32:07.273525] [FATAL] [VALIDATOR ] EME: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:32:07.295329] [FATAL] [MAIN ] EME: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:32:07.303318] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:32:07.305681] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-31T18:32:07.306004] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-31T18:32:07.316491] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-10-31T18:32:07.344312] [DEBUG] [LOCAL ] EME: Deleted derivative data file. [2025-10-31T18:32:07.354718] [INFO ] [MAIN ] Update Progress: 729/2365 symbols completed. EME took 25.2s. Estimated remaining: 3h 26m 35s. Rate: 7.9 symbols/min [2025-10-31T18:32:07.418660] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:32:07.451404] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-31T18:32:07.457604] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-31T18:32:07.463240] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-31T18:32:07.479781] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-31T18:32:07.490979] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-31T18:32:07.673950] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:32:07.968063] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:32:07.988171] [DEBUG] [LOCAL ] EMN: Loaded 51187 existing records from primary storage. [2025-10-31T18:32:07.988780] [INFO ] [MAIN ] EMN: Loaded 51187 existing records. [2025-10-31T18:32:08.174510] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:32:08.174815] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-31T18:32:08.175016] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-31T18:32:08.186247] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-31T18:32:08.203691] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-31T18:32:08.236882] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T18:32:08.260616] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-31T18:32:08.332872] [INFO ] [REMOTE ] ELS: Full fetch complete (71156 records). [2025-10-31T18:32:08.361304] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-31T18:32:08.381316] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:32:08.439596] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:32:08.472389] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:32:08.489498] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-31T18:32:08.495303] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-31T18:32:08.506137] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-10-31T18:32:08.567967] [DEBUG] [LOCAL ] ELS: No derivative data file found to delete. [2025-10-31T18:32:08.593198] [INFO ] [MAIN ] Update Progress: 730/2365 symbols completed. ELS took 30.4s. Estimated remaining: 3h 26m 13s. Rate: 7.9 symbols/min [2025-10-31T18:32:08.603776] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T18:32:08.601851] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:32:08.779635] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:32:08.795676] [DEBUG] [LOCAL ] EMO: Loaded 13434 existing records from primary storage. [2025-10-31T18:32:08.795910] [INFO ] [MAIN ] EMO: Loaded 13434 existing records. [2025-10-31T18:32:08.972958] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:32:08.973330] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-31T18:32:08.973411] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-31T18:32:08.973740] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-31T18:32:08.973801] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-31T18:32:09.062823] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-31T18:32:09.125023] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T18:32:09.419090] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:32:09.857680] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-31T18:32:10.411261] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-31T18:32:10.465761] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T18:32:10.657724] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-31T18:32:11.457683] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-31T18:32:11.870357] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T18:32:12.257628] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-31T18:32:12.286001] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T18:32:13.057720] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-31T18:32:13.476607] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-31T18:32:13.478356] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T18:32:13.857678] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-31T18:32:14.657678] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-31T18:32:14.690843] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T18:32:15.457754] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-31T18:32:15.899708] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T18:32:16.257683] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-31T18:32:16.532108] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T18:32:17.057700] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-31T18:32:17.526439] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-31T18:32:17.724793] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-31T18:32:17.857680] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-31T18:32:18.633401] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-31T18:32:18.657622] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-31T18:32:19.254577] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-31T18:32:19.457701] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-31T18:32:20.209227] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T18:32:20.257615] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-31T18:32:21.010167] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T18:32:21.015018] [INFO ] [REMOTE ] EMD: Full fetch complete (31667 records). [2025-10-31T18:32:21.015112] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-31T18:32:21.015587] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:32:21.015690] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:32:21.015740] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:32:21.015850] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-31T18:32:21.015954] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-31T18:32:21.015996] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-10-31T18:32:21.016136] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-10-31T18:32:21.016244] [INFO ] [MAIN ] Update Progress: 731/2365 symbols completed. EMD took 39.3s. Estimated remaining: 3h 26m 16s. Rate: 7.9 symbols/min [2025-10-31T18:32:21.062786] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-31T18:32:21.196441] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:32:21.196617] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-31T18:32:21.196687] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-31T18:32:21.196810] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-31T18:32:21.196851] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-31T18:32:21.196891] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-31T18:32:21.196922] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-31T18:32:21.567474] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:32:21.857632] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-31T18:32:22.296107] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-31T18:32:22.402607] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T18:32:22.657668] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-31T18:32:23.169999] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-31T18:32:23.457713] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-31T18:32:24.037173] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-31T18:32:24.257675] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-31T18:32:24.672223] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-31T18:32:25.057679] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-31T18:32:25.618005] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-31T18:32:25.857686] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-31T18:32:26.381329] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T18:32:26.657750] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-31T18:32:26.963863] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T18:32:27.457667] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-31T18:32:28.112162] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-31T18:32:28.257719] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-31T18:32:29.057663] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-31T18:32:29.490754] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T18:32:29.753142] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T18:32:29.857673] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-31T18:32:30.499122] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T18:32:30.657612] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-31T18:32:30.971015] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-31T18:32:31.457686] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-31T18:32:31.791346] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-31T18:32:32.257671] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-31T18:32:32.675111] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-31T18:32:33.057681] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-31T18:32:33.466107] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-31T18:32:33.857635] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-31T18:32:34.530460] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T18:32:34.657683] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-31T18:32:35.457731] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-31T18:32:35.954383] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T18:32:36.124696] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T18:32:36.257678] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-31T18:32:36.656685] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-31T18:32:37.057694] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-31T18:32:37.530426] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-31T18:32:37.531837] [INFO ] [REMOTE ] EMF: Full fetch complete (5974 records). [2025-10-31T18:32:37.531905] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-31T18:32:37.864691] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-31T18:32:37.906075] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-31T18:32:37.906153] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-31T18:32:37.906314] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-31T18:32:37.906351] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-31T18:32:37.906746] [DEBUG] [LOCAL ] EMF: Trimmed 5974 records to 3088 (keeping 200 days of data) [2025-10-31T18:32:37.925742] [DEBUG] [LOCAL ] EMF: Primary data saved (3088 records). [2025-10-31T18:32:37.925810] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-31T18:32:37.925876] [INFO ] [MAIN ] Update Progress: 732/2365 symbols completed. EMF took 30.9s. Estimated remaining: 3h 26m 29s. Rate: 7.9 symbols/min [2025-10-31T18:32:38.096255] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:32:38.096414] [DEBUG] [LOCAL ] EMR: No existing data file found in primary storage. [2025-10-31T18:32:38.096451] [WARN ] [MAIN ] EMR: No existing data found, performing full refresh instead. [2025-10-31T18:32:38.096558] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-31T18:32:38.096607] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-31T18:32:38.096701] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-31T18:32:38.096761] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-31T18:32:38.464097] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:32:38.657637] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-31T18:32:38.768307] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-31T18:32:38.772745] [INFO ] [REMOTE ] EMO: Full fetch complete (17806 records). [2025-10-31T18:32:38.772829] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-31T18:32:39.201562] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-31T18:32:39.201720] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-31T18:32:39.202361] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-31T18:32:39.202428] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-31T18:32:39.203626] [DEBUG] [LOCAL ] EMO: Trimmed 17806 records to 13516 (keeping 200 days of data) [2025-10-31T18:32:39.299882] [DEBUG] [LOCAL ] EMO: Primary data saved (13516 records). [2025-10-31T18:32:39.300095] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-31T18:32:39.300199] [INFO ] [MAIN ] Update Progress: 733/2365 symbols completed. EMO took 30.7s. Estimated remaining: 3h 26m 8s. Rate: 7.9 symbols/min [2025-10-31T18:32:39.465595] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-31T18:32:39.488009] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:32:39.545692] [DEBUG] [LOCAL ] ENB: Loaded 53901 existing records from primary storage. [2025-10-31T18:32:39.546124] [INFO ] [MAIN ] ENB: Loaded 53901 existing records. [2025-10-31T18:32:39.739672] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:32:39.740012] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-31T18:32:39.740065] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-31T18:32:39.741208] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-31T18:32:39.741270] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-31T18:32:40.127600] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:32:40.163945] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-31T18:32:40.257684] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-31T18:32:40.740989] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T18:32:41.057713] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-31T18:32:41.400828] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-31T18:32:41.609029] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T18:32:41.857712] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-31T18:32:42.166590] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-31T18:32:42.657704] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-31T18:32:43.457699] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-31T18:32:44.239055] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T18:32:44.250973] [INFO ] [REMOTE ] EMN: Full fetch complete (72582 records). [2025-10-31T18:32:44.251257] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-31T18:32:44.263373] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-31T18:32:44.651257] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-31T18:32:44.651356] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-31T18:32:44.652313] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-31T18:32:44.652433] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-31T18:32:44.653926] [DEBUG] [LOCAL ] EMN: Trimmed 72582 records to 51576 (keeping 200 days of data) [2025-10-31T18:32:44.774009] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T18:32:45.004245] [DEBUG] [LOCAL ] EMN: Primary data saved (51576 records). [2025-10-31T18:32:45.004396] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-31T18:32:45.004477] [INFO ] [MAIN ] Update Progress: 734/2365 symbols completed. EMN took 37.6s. Estimated remaining: 3h 25m 56s. Rate: 7.9 symbols/min [2025-10-31T18:32:45.066736] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-31T18:32:45.173945] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:32:45.207323] [DEBUG] [LOCAL ] ENIC: Loaded 36274 existing records from primary storage. [2025-10-31T18:32:45.207592] [INFO ] [MAIN ] ENIC: Loaded 36274 existing records. [2025-10-31T18:32:45.388296] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:32:45.388497] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-31T18:32:45.388544] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-31T18:32:45.388779] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-31T18:32:45.388836] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-31T18:32:45.784625] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:32:45.862767] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-31T18:32:45.883459] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-31T18:32:46.376765] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-31T18:32:46.406422] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T18:32:46.657669] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-31T18:32:47.457696] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-31T18:32:47.850707] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-31T18:32:48.031745] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T18:32:48.257673] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-31T18:32:49.057713] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-31T18:32:49.681044] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T18:32:49.857632] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-31T18:32:50.582712] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-31T18:32:50.657621] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-31T18:32:51.396559] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-31T18:32:51.457620] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-31T18:32:52.257689] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-31T18:32:52.522005] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-31T18:32:52.741868] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-31T18:32:53.057638] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-31T18:32:53.511723] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-31T18:32:53.857701] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-31T18:32:54.067983] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T18:32:54.069095] [INFO ] [REMOTE ] EMP: Full fetch complete (4055 records). [2025-10-31T18:32:54.069166] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-31T18:32:54.421724] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-31T18:32:54.421831] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-31T18:32:54.422042] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-31T18:32:54.422114] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-31T18:32:54.422575] [DEBUG] [LOCAL ] EMP: Trimmed 4055 records to 2856 (keeping 200 days of data) [2025-10-31T18:32:54.440918] [DEBUG] [LOCAL ] EMP: Primary data saved (2856 records). [2025-10-31T18:32:54.441041] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-31T18:32:54.441111] [INFO ] [MAIN ] Update Progress: 735/2365 symbols completed. EMP took 33.4s. Estimated remaining: 3h 25m 53s. Rate: 7.9 symbols/min [2025-10-31T18:32:54.607281] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:32:54.611120] [DEBUG] [LOCAL ] ENO: Loaded 1555 existing records from primary storage. [2025-10-31T18:32:54.611286] [INFO ] [MAIN ] ENO: Loaded 1555 existing records. [2025-10-31T18:32:54.664585] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-31T18:32:54.790589] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:32:54.790838] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-31T18:32:54.790890] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-31T18:32:54.791038] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-31T18:32:54.791099] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-31T18:32:55.152308] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:32:55.457689] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-31T18:32:55.864494] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-31T18:32:56.085549] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T18:32:56.257667] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-31T18:32:56.571802] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T18:32:57.057693] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-31T18:32:57.326583] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (3.47 seconds). [2025-10-31T18:32:57.857675] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-31T18:32:58.530291] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T18:32:58.657630] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-31T18:32:58.800513] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T18:32:59.457685] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-31T18:33:00.022122] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-31T18:33:00.034315] [INFO ] [REMOTE ] EMR: Full fetch complete (77180 records). [2025-10-31T18:33:00.034442] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-31T18:33:00.261858] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-31T18:33:00.366872] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-31T18:33:00.473817] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-31T18:33:00.473902] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-31T18:33:00.474849] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-31T18:33:00.474911] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-31T18:33:00.476339] [DEBUG] [LOCAL ] EMR: Trimmed 77180 records to 53898 (keeping 200 days of data) [2025-10-31T18:33:00.812573] [DEBUG] [LOCAL ] EMR: Primary data saved (53898 records). [2025-10-31T18:33:00.812960] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-31T18:33:00.813042] [INFO ] [MAIN ] Update Progress: 736/2365 symbols completed. EMR took 22.9s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-10-31T18:33:00.862165] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-31T18:33:00.993078] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:33:01.031708] [DEBUG] [LOCAL ] ENOV: Loaded 44696 existing records from primary storage. [2025-10-31T18:33:01.031992] [INFO ] [MAIN ] ENOV: Loaded 44696 existing records. [2025-10-31T18:33:01.062722] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-31T18:33:01.212771] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:33:01.212983] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-31T18:33:01.213030] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-31T18:33:01.213842] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-31T18:33:01.213898] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-31T18:33:01.576458] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:33:01.857736] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-31T18:33:02.117887] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T18:33:02.657678] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-31T18:33:02.944142] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T18:33:03.016928] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-31T18:33:03.457688] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-31T18:33:04.257683] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-31T18:33:04.551709] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-31T18:33:04.554305] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T18:33:05.057718] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-31T18:33:05.857667] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-31T18:33:06.196882] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T18:33:06.657673] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-31T18:33:07.457698] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-31T18:33:07.512341] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-31T18:33:07.828480] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-31T18:33:07.922993] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T18:33:08.257685] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-31T18:33:08.632829] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-31T18:33:09.057638] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-31T18:33:09.857702] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-31T18:33:10.271781] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T18:33:10.657733] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-31T18:33:11.083633] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T18:33:11.457635] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-31T18:33:11.747139] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-31T18:33:11.916817] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T18:33:12.257674] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-31T18:33:13.057695] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-31T18:33:13.340535] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-31T18:33:13.670585] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T18:33:13.857685] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-31T18:33:14.304479] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-31T18:33:14.305440] [INFO ] [REMOTE ] ENO: Full fetch complete (2934 records). [2025-10-31T18:33:14.305518] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-31T18:33:14.673956] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-31T18:33:14.680740] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-31T18:33:14.681345] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-31T18:33:14.681485] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-31T18:33:14.681555] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-31T18:33:14.682206] [DEBUG] [LOCAL ] ENO: Trimmed 2934 records to 1575 (keeping 200 days of data) [2025-10-31T18:33:14.692958] [DEBUG] [LOCAL ] ENO: Primary data saved (1575 records). [2025-10-31T18:33:14.693016] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-31T18:33:14.693083] [INFO ] [MAIN ] Update Progress: 737/2365 symbols completed. ENO took 20.3s. Estimated remaining: 3h 25m 49s. Rate: 7.9 symbols/min [2025-10-31T18:33:14.863482] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:33:14.903666] [DEBUG] [LOCAL ] ENR: Loaded 43879 existing records from primary storage. [2025-10-31T18:33:14.903980] [INFO ] [MAIN ] ENR: Loaded 43879 existing records. [2025-10-31T18:33:15.110011] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:33:15.110382] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-31T18:33:15.110436] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-31T18:33:15.111258] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-31T18:33:15.111315] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-31T18:33:15.462764] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-31T18:33:15.497802] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:33:16.257623] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-31T18:33:16.432551] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-31T18:33:16.821978] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T18:33:17.057701] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-31T18:33:17.679487] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T18:33:17.857624] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-31T18:33:18.667711] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-31T18:33:18.689939] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-31T18:33:19.075319] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T18:33:19.457685] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-31T18:33:19.741957] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T18:33:20.257716] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-31T18:33:21.013414] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-31T18:33:21.057704] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-31T18:33:21.537344] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T18:33:21.545971] [INFO ] [REMOTE ] ENOV: Full fetch complete (62765 records). [2025-10-31T18:33:21.546096] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-31T18:33:21.546788] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:33:21.546923] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:33:21.546979] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:33:21.547047] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-31T18:33:21.547110] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-31T18:33:21.547144] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-31T18:33:21.547317] [DEBUG] [LOCAL ] ENOV: Deleted derivative data file. [2025-10-31T18:33:21.547414] [INFO ] [MAIN ] Update Progress: 738/2365 symbols completed. ENOV took 20.7s. Estimated remaining: 3h 25m 40s. Rate: 7.9 symbols/min [2025-10-31T18:33:21.717058] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:33:21.744587] [DEBUG] [LOCAL ] ENS: Loaded 29754 existing records from primary storage. [2025-10-31T18:33:21.744863] [INFO ] [MAIN ] ENS: Loaded 29754 existing records. [2025-10-31T18:33:21.862744] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-31T18:33:21.928999] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:33:21.929236] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-31T18:33:21.929287] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-31T18:33:21.929833] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-31T18:33:21.929890] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-31T18:33:22.303731] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:33:22.316698] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:33:22.657685] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-31T18:33:23.115863] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-31T18:33:23.457630] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-31T18:33:23.677546] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T18:33:24.257673] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-31T18:33:24.691351] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T18:33:25.057659] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-31T18:33:25.330926] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T18:33:25.857674] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-31T18:33:26.199541] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T18:33:26.657704] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-31T18:33:26.886861] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T18:33:27.457707] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-31T18:33:27.964636] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T18:33:28.257738] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-31T18:33:28.395845] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T18:33:29.057715] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-31T18:33:29.688808] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T18:33:29.857697] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-31T18:33:30.077300] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T18:33:30.657697] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-31T18:33:31.055404] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T18:33:31.457690] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-31T18:33:32.257704] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-31T18:33:32.482485] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T18:33:32.743080] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-31T18:33:32.757098] [INFO ] [REMOTE ] ENB: Full fetch complete (77665 records). [2025-10-31T18:33:32.757268] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-31T18:33:33.063270] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-31T18:33:33.195206] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-31T18:33:33.195294] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-31T18:33:33.196493] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-31T18:33:33.196562] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-31T18:33:33.198111] [DEBUG] [LOCAL ] ENB: Trimmed 77665 records to 54291 (keeping 200 days of data) [2025-10-31T18:33:33.529716] [DEBUG] [LOCAL ] ENB: Primary data saved (54291 records). [2025-10-31T18:33:33.529844] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-31T18:33:33.529936] [INFO ] [MAIN ] Update Progress: 739/2365 symbols completed. ENB took 54.2s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-10-31T18:33:33.701836] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:33:33.733920] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-31T18:33:33.762288] [DEBUG] [LOCAL ] ENVA: Loaded 25142 existing records from primary storage. [2025-10-31T18:33:33.762534] [INFO ] [MAIN ] ENVA: Loaded 25142 existing records. [2025-10-31T18:33:33.863515] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-31T18:33:33.945683] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:33:33.945937] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-31T18:33:33.945984] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-31T18:33:33.946689] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-31T18:33:33.946748] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-31T18:33:34.315273] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:33:34.384181] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T18:33:34.392001] [INFO ] [REMOTE ] ENIC: Full fetch complete (50725 records). [2025-10-31T18:33:34.392135] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-31T18:33:34.392795] [FATAL] [VALIDATOR ] ENIC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:33:34.392884] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:33:34.392933] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:33:34.392997] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-31T18:33:34.393061] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-31T18:33:34.393098] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-10-31T18:33:34.393267] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-10-31T18:33:34.393398] [INFO ] [MAIN ] Update Progress: 740/2365 symbols completed. ENIC took 49.4s. Estimated remaining: 3h 25m 19s. Rate: 7.9 symbols/min [2025-10-31T18:33:34.578778] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:33:34.593087] [DEBUG] [LOCAL ] EOD: Loaded 14855 existing records from primary storage. [2025-10-31T18:33:34.593289] [INFO ] [MAIN ] EOD: Loaded 14855 existing records. [2025-10-31T18:33:34.662794] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-31T18:33:34.772813] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:33:34.773051] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-31T18:33:34.773102] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-31T18:33:34.773480] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-31T18:33:34.773537] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-31T18:33:35.137855] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:33:35.171600] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T18:33:35.457685] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-31T18:33:35.780946] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-31T18:33:36.257679] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-31T18:33:36.636413] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T18:33:37.057708] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-31T18:33:37.297066] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T18:33:37.864708] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-31T18:33:37.869801] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T18:33:38.657700] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-31T18:33:38.775200] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T18:33:39.457680] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-31T18:33:40.138829] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T18:33:40.148676] [INFO ] [REMOTE ] ENR: Full fetch complete (60017 records). [2025-10-31T18:33:40.148802] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-31T18:33:40.257720] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-31T18:33:40.246048] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T18:33:40.563363] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-31T18:33:40.563448] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-31T18:33:40.564302] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-31T18:33:40.564366] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-31T18:33:40.565635] [DEBUG] [LOCAL ] ENR: Trimmed 60017 records to 44187 (keeping 200 days of data) [2025-10-31T18:33:40.829359] [DEBUG] [LOCAL ] ENR: Primary data saved (44187 records). [2025-10-31T18:33:40.829484] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-31T18:33:40.830392] [INFO ] [MAIN ] Update Progress: 741/2365 symbols completed. ENR took 26.1s. Estimated remaining: 3h 25m 9s. Rate: 7.9 symbols/min [2025-10-31T18:33:41.005049] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:33:41.060972] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-31T18:33:41.063564] [DEBUG] [LOCAL ] EOG: Loaded 53777 existing records from primary storage. [2025-10-31T18:33:41.064022] [INFO ] [MAIN ] EOG: Loaded 53777 existing records. [2025-10-31T18:33:41.273786] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:33:41.274025] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-31T18:33:41.274073] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-31T18:33:41.274693] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-31T18:33:41.274752] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-31T18:33:41.576758] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T18:33:41.666691] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:33:41.675208] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-31T18:33:41.857684] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-31T18:33:42.657677] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-31T18:33:42.874234] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T18:33:43.457667] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-31T18:33:43.586570] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T18:33:44.257686] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-31T18:33:45.057697] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-31T18:33:45.252144] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T18:33:45.340882] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-31T18:33:45.857686] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-31T18:33:45.963932] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-31T18:33:46.657730] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-31T18:33:47.457682] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-31T18:33:47.489817] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T18:33:47.497326] [INFO ] [REMOTE ] ENS: Full fetch complete (42986 records). [2025-10-31T18:33:47.497441] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-31T18:33:47.894427] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-31T18:33:47.894667] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-31T18:33:47.895414] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-31T18:33:47.895501] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-31T18:33:47.914221] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T18:33:47.921800] [DEBUG] [LOCAL ] ENS: Trimmed 42986 records to 29944 (keeping 200 days of data) [2025-10-31T18:33:48.109508] [DEBUG] [LOCAL ] ENS: Primary data saved (29944 records). [2025-10-31T18:33:48.109668] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-31T18:33:48.109764] [INFO ] [MAIN ] Update Progress: 742/2365 symbols completed. ENS took 26.6s. Estimated remaining: 3h 25m 1s. Rate: 7.9 symbols/min [2025-10-31T18:33:48.237073] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-31T18:33:48.262727] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-31T18:33:48.307107] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:33:48.317345] [DEBUG] [LOCAL ] EOI: Loaded 10008 existing records from primary storage. [2025-10-31T18:33:48.317525] [INFO ] [MAIN ] EOI: Loaded 10008 existing records. [2025-10-31T18:33:48.500550] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:33:48.500804] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-31T18:33:48.500853] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-31T18:33:48.501216] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-31T18:33:48.501273] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-31T18:33:48.858238] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:33:49.057711] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-31T18:33:49.219783] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-31T18:33:49.602503] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-31T18:33:49.857710] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-31T18:33:50.657727] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-31T18:33:50.870132] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T18:33:51.388263] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T18:33:51.457690] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-31T18:33:52.257623] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-31T18:33:52.272892] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-31T18:33:53.057664] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-31T18:33:53.617589] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-31T18:33:53.857621] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-31T18:33:53.934018] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T18:33:54.657712] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-31T18:33:55.345441] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-31T18:33:55.403761] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-31T18:33:55.457669] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-31T18:33:56.257733] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-31T18:33:56.865583] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-31T18:33:57.057617] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-31T18:33:57.098077] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T18:33:57.857624] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-31T18:33:57.956309] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-31T18:33:57.962804] [INFO ] [REMOTE ] EOD: Full fetch complete (21092 records). [2025-10-31T18:33:57.962910] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-31T18:33:58.331482] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-31T18:33:58.331595] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-31T18:33:58.332120] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-31T18:33:58.332179] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-31T18:33:58.332769] [DEBUG] [LOCAL ] EOD: Trimmed 21092 records to 15024 (keeping 200 days of data) [2025-10-31T18:33:58.417547] [DEBUG] [LOCAL ] EOD: Primary data saved (15024 records). [2025-10-31T18:33:58.417669] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-31T18:33:58.417764] [INFO ] [MAIN ] Update Progress: 743/2365 symbols completed. EOD took 24.0s. Estimated remaining: 3h 24m 59s. Rate: 7.9 symbols/min [2025-10-31T18:33:58.586495] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:33:58.600468] [DEBUG] [LOCAL ] EOS: Loaded 14451 existing records from primary storage. [2025-10-31T18:33:58.600715] [INFO ] [MAIN ] EOS: Loaded 14451 existing records. [2025-10-31T18:33:58.664013] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-31T18:33:58.783324] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:33:58.783516] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-31T18:33:58.783563] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-31T18:33:58.783953] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-31T18:33:58.784010] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-31T18:33:59.166266] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:33:59.167753] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T18:33:59.457733] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-31T18:34:00.147929] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-31T18:34:00.257668] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-31T18:34:01.057622] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-31T18:34:01.136596] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T18:34:01.148797] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-31T18:34:01.857692] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-31T18:34:02.657711] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-31T18:34:02.989819] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-31T18:34:03.199181] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-31T18:34:03.457667] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-31T18:34:03.537027] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T18:34:04.257623] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-31T18:34:04.416460] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T18:34:05.057689] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-31T18:34:05.857620] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-31T18:34:05.945012] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-31T18:34:06.015149] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T18:34:06.506678] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T18:34:06.657716] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-31T18:34:07.457618] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-31T18:34:07.512767] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-31T18:34:07.974173] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T18:34:08.257686] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-31T18:34:08.841085] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-31T18:34:09.057679] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-31T18:34:09.857665] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-31T18:34:09.916088] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-31T18:34:10.520324] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-31T18:34:10.657680] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-31T18:34:11.457694] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-31T18:34:12.257723] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-31T18:34:12.532786] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-31T18:34:13.057616] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-31T18:34:13.199086] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-31T18:34:13.641167] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-31T18:34:13.857634] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-31T18:34:13.904767] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-31T18:34:13.910177] [INFO ] [REMOTE ] ENVA: Full fetch complete (36683 records). [2025-10-31T18:34:13.910258] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-31T18:34:13.910816] [FATAL] [VALIDATOR ] ENVA: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:34:13.910925] [FATAL] [MAIN ] ENVA: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:34:13.911024] [WARN ] [MAIN ] ENVA: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:34:13.911110] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-31T18:34:13.911185] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-10-31T18:34:13.911223] [INFO ] [LOCAL ] ENVA: Starting deletion of derivative data. [2025-10-31T18:34:13.911367] [DEBUG] [LOCAL ] ENVA: Deleted derivative data file. [2025-10-31T18:34:13.911455] [INFO ] [MAIN ] Update Progress: 744/2365 symbols completed. ENVA took 40.4s. Estimated remaining: 3h 25m 9s. Rate: 7.9 symbols/min [2025-10-31T18:34:14.080309] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:34:14.088485] [DEBUG] [LOCAL ] EOT: Loaded 7000 existing records from primary storage. [2025-10-31T18:34:14.088703] [INFO ] [MAIN ] EOT: Loaded 7000 existing records. [2025-10-31T18:34:14.262123] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:34:14.262346] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-31T18:34:14.262403] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-31T18:34:14.262787] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-31T18:34:14.262849] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-31T18:34:14.610793] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:34:14.657614] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-31T18:34:15.251182] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T18:34:15.457603] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-31T18:34:15.511868] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-31T18:34:16.053860] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-31T18:34:16.257722] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-31T18:34:16.930940] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T18:34:16.933985] [INFO ] [REMOTE ] EOI: Full fetch complete (15832 records). [2025-10-31T18:34:16.934129] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-31T18:34:17.062760] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-31T18:34:17.299300] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-31T18:34:17.299377] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-31T18:34:17.299734] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-31T18:34:17.299792] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-31T18:34:17.300268] [DEBUG] [LOCAL ] EOI: Trimmed 15832 records to 10071 (keeping 200 days of data) [2025-10-31T18:34:17.362184] [DEBUG] [LOCAL ] EOI: Primary data saved (10071 records). [2025-10-31T18:34:17.362322] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-31T18:34:17.362403] [INFO ] [MAIN ] Update Progress: 745/2365 symbols completed. EOI took 29.3s. Estimated remaining: 3h 24m 52s. Rate: 7.9 symbols/min [2025-10-31T18:34:17.534486] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:34:17.534666] [DEBUG] [LOCAL ] EPAC: No existing data file found in primary storage. [2025-10-31T18:34:17.534721] [WARN ] [MAIN ] EPAC: No existing data found, performing full refresh instead. [2025-10-31T18:34:17.534827] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-31T18:34:17.534870] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-31T18:34:17.534919] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-10-31T18:34:17.534957] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-31T18:34:17.859248] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-31T18:34:17.882847] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:34:17.986471] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T18:34:18.657686] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-31T18:34:19.180913] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T18:34:19.330779] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T18:34:19.457667] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-31T18:34:20.257708] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-31T18:34:20.738146] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T18:34:21.057695] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-31T18:34:21.479414] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-31T18:34:21.645035] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-31T18:34:21.857691] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-31T18:34:22.655262] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T18:34:22.660347] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-31T18:34:23.465520] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-31T18:34:23.472474] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T18:34:23.485315] [INFO ] [REMOTE ] EOG: Full fetch complete (77468 records). [2025-10-31T18:34:23.485469] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-31T18:34:24.050864] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-31T18:34:24.051007] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-31T18:34:24.053013] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-31T18:34:24.053200] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-31T18:34:24.062886] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-31T18:34:24.066838] [DEBUG] [LOCAL ] EOG: Trimmed 77468 records to 54166 (keeping 200 days of data) [2025-10-31T18:34:24.257933] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-31T18:34:24.530495] [DEBUG] [LOCAL ] EOG: Primary data saved (54166 records). [2025-10-31T18:34:24.530675] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-31T18:34:24.531485] [INFO ] [MAIN ] Update Progress: 746/2365 symbols completed. EOG took 43.7s. Estimated remaining: 3h 24m 44s. Rate: 7.9 symbols/min [2025-10-31T18:34:24.701559] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:34:24.742377] [DEBUG] [LOCAL ] EPAM: Loaded 39250 existing records from primary storage. [2025-10-31T18:34:24.742665] [INFO ] [MAIN ] EPAM: Loaded 39250 existing records. [2025-10-31T18:34:24.916742] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:34:24.916948] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-31T18:34:24.916993] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-31T18:34:24.917327] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-31T18:34:24.917384] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-31T18:34:25.062843] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-31T18:34:25.284022] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:34:25.307859] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T18:34:25.857696] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-31T18:34:25.914206] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-31T18:34:26.657730] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-31T18:34:26.919329] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-31T18:34:27.061065] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-31T18:34:27.457677] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-31T18:34:28.257613] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-31T18:34:28.366899] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T18:34:28.370876] [INFO ] [REMOTE ] EOS: Full fetch complete (22751 records). [2025-10-31T18:34:28.370966] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-31T18:34:28.371415] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:34:28.371496] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:34:28.371538] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:34:28.371581] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-31T18:34:28.371635] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-31T18:34:28.371712] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-10-31T18:34:28.371868] [DEBUG] [LOCAL ] EOS: Deleted derivative data file. [2025-10-31T18:34:28.371935] [INFO ] [MAIN ] Update Progress: 747/2365 symbols completed. EOS took 30.0s. Estimated remaining: 3h 24m 28s. Rate: 7.9 symbols/min [2025-10-31T18:34:28.540033] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:34:28.578237] [DEBUG] [LOCAL ] EPC: Loaded 39868 existing records from primary storage. [2025-10-31T18:34:28.578535] [INFO ] [MAIN ] EPC: Loaded 39868 existing records. [2025-10-31T18:34:28.771359] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:34:28.771583] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-31T18:34:28.771630] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-31T18:34:28.771871] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-31T18:34:28.771914] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-31T18:34:29.062814] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-31T18:34:29.133268] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:34:29.598180] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T18:34:29.857623] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-31T18:34:29.905697] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T18:34:30.532038] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T18:34:30.657685] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-31T18:34:31.457675] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-31T18:34:31.833629] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T18:34:31.934936] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-31T18:34:32.257676] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-31T18:34:32.816442] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-31T18:34:33.057685] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-31T18:34:33.857693] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-31T18:34:34.052955] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T18:34:34.318179] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-31T18:34:34.657629] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-31T18:34:35.457624] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-31T18:34:35.651801] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-31T18:34:36.257681] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-31T18:34:36.863477] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T18:34:37.057688] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-31T18:34:37.260925] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T18:34:37.689702] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T18:34:37.692117] [INFO ] [REMOTE ] EOT: Full fetch complete (10634 records). [2025-10-31T18:34:37.692190] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-31T18:34:37.870276] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-31T18:34:38.049616] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-31T18:34:38.049726] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-31T18:34:38.050048] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-31T18:34:38.050091] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-31T18:34:38.050587] [DEBUG] [LOCAL ] EOT: Trimmed 10634 records to 7072 (keeping 200 days of data) [2025-10-31T18:34:38.091458] [DEBUG] [LOCAL ] EOT: Primary data saved (7072 records). [2025-10-31T18:34:38.091555] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-31T18:34:38.091628] [INFO ] [MAIN ] Update Progress: 748/2365 symbols completed. EOT took 24.2s. Estimated remaining: 3h 24m 25s. Rate: 7.9 symbols/min [2025-10-31T18:34:38.263443] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:34:38.263636] [DEBUG] [LOCAL ] EPD: No existing data file found in primary storage. [2025-10-31T18:34:38.263712] [WARN ] [MAIN ] EPD: No existing data found, performing full refresh instead. [2025-10-31T18:34:38.263823] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-31T18:34:38.263866] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-31T18:34:38.263907] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-31T18:34:38.263975] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-31T18:34:38.614094] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:34:38.657619] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-31T18:34:39.082924] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T18:34:39.457698] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-31T18:34:40.176616] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-31T18:34:40.257608] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-31T18:34:40.586176] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-31T18:34:41.057730] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-31T18:34:41.514904] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T18:34:41.857681] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-31T18:34:42.657694] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-31T18:34:43.066210] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-31T18:34:43.204453] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T18:34:43.457671] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-31T18:34:43.621615] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T18:34:44.257688] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-31T18:34:44.910374] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-31T18:34:45.057662] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-31T18:34:45.476778] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T18:34:45.857726] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-31T18:34:46.656707] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-31T18:34:46.661458] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-31T18:34:46.964425] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-31T18:34:47.457690] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-31T18:34:47.762994] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-31T18:34:48.257672] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-31T18:34:48.533991] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T18:34:49.057737] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-31T18:34:49.477747] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T18:34:49.857687] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-31T18:34:50.124592] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T18:34:50.657701] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-31T18:34:51.457615] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-31T18:34:51.565486] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-31T18:34:51.880708] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T18:34:52.257679] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-31T18:34:52.738263] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T18:34:52.744518] [INFO ] [REMOTE ] EPAC: Full fetch complete (38790 records). [2025-10-31T18:34:52.744595] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-31T18:34:53.062797] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-31T18:34:53.125436] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-31T18:34:53.125512] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-31T18:34:53.126121] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-31T18:34:53.126181] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-31T18:34:53.127169] [DEBUG] [LOCAL ] EPAC: Trimmed 38790 records to 26468 (keeping 200 days of data) [2025-10-31T18:34:53.281287] [DEBUG] [LOCAL ] EPAC: Primary data saved (26468 records). [2025-10-31T18:34:53.281404] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-31T18:34:53.281469] [INFO ] [MAIN ] Update Progress: 749/2365 symbols completed. EPAC took 35.9s. Estimated remaining: 3h 24m 34s. Rate: 7.9 symbols/min [2025-10-31T18:34:53.450193] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:34:53.486574] [DEBUG] [LOCAL ] EPR: Loaded 43807 existing records from primary storage. [2025-10-31T18:34:53.486919] [INFO ] [MAIN ] EPR: Loaded 43807 existing records. [2025-10-31T18:34:53.668399] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:34:53.668795] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-31T18:34:53.668927] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-31T18:34:53.670053] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-31T18:34:53.670116] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-31T18:34:53.796888] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T18:34:53.862762] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-31T18:34:54.068726] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:34:54.242986] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T18:34:54.657663] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-31T18:34:55.388951] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-31T18:34:55.397799] [INFO ] [REMOTE ] EPAM: Full fetch complete (56964 records). [2025-10-31T18:34:55.397973] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-31T18:34:55.464828] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-31T18:34:55.788694] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-31T18:34:55.788779] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-31T18:34:55.789496] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-31T18:34:55.789536] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-31T18:34:55.790614] [DEBUG] [LOCAL ] EPAM: Trimmed 56964 records to 39545 (keeping 200 days of data) [2025-10-31T18:34:56.028875] [DEBUG] [LOCAL ] EPAM: Primary data saved (39545 records). [2025-10-31T18:34:56.029019] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-31T18:34:56.029727] [INFO ] [MAIN ] Update Progress: 750/2365 symbols completed. EPAM took 31.5s. Estimated remaining: 3h 24m 16s. Rate: 7.9 symbols/min [2025-10-31T18:34:56.203125] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:34:56.249195] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-31T18:34:56.257602] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-31T18:34:56.274395] [DEBUG] [LOCAL ] EPRT: Loaded 48731 existing records from primary storage. [2025-10-31T18:34:56.274723] [INFO ] [MAIN ] EPRT: Loaded 48731 existing records. [2025-10-31T18:34:56.454712] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:34:56.454943] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-31T18:34:56.454992] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-31T18:34:56.455933] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-31T18:34:56.455992] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-31T18:34:56.821759] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:34:57.057677] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-31T18:34:57.218457] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-31T18:34:57.733763] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T18:34:57.857698] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-31T18:34:58.458575] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T18:34:58.657686] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-31T18:34:59.165790] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T18:34:59.457638] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-31T18:35:00.052369] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T18:35:00.257671] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-31T18:35:01.057691] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-31T18:35:01.404685] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-31T18:35:01.416511] [INFO ] [REMOTE ] EPC: Full fetch complete (57487 records). [2025-10-31T18:35:01.416708] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-31T18:35:01.855239] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-31T18:35:01.855354] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-31T18:35:01.856564] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-31T18:35:01.856753] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-31T18:35:01.857767] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-31T18:35:01.859832] [DEBUG] [LOCAL ] EPC: Trimmed 57487 records to 40145 (keeping 200 days of data) [2025-10-31T18:35:02.141967] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-31T18:35:02.170910] [DEBUG] [LOCAL ] EPC: Primary data saved (40145 records). [2025-10-31T18:35:02.171268] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-31T18:35:02.171363] [INFO ] [MAIN ] Update Progress: 751/2365 symbols completed. EPC took 33.8s. Estimated remaining: 3h 24m 5s. Rate: 7.9 symbols/min [2025-10-31T18:35:02.339914] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:35:02.351543] [DEBUG] [LOCAL ] EQBK: Loaded 11167 existing records from primary storage. [2025-10-31T18:35:02.351831] [INFO ] [MAIN ] EQBK: Loaded 11167 existing records. [2025-10-31T18:35:02.528145] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:35:02.528372] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-31T18:35:02.528422] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-31T18:35:02.528776] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-31T18:35:02.528836] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-31T18:35:02.670851] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-31T18:35:02.895478] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:35:03.361752] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-31T18:35:03.457711] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-31T18:35:04.257727] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-31T18:35:04.921971] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T18:35:05.001983] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (3.14 seconds). [2025-10-31T18:35:05.057619] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-31T18:35:05.107598] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-31T18:35:05.126216] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T18:35:05.857681] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-31T18:35:06.543003] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T18:35:06.657742] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-31T18:35:07.457619] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-31T18:35:07.630047] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-31T18:35:08.123290] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-31T18:35:08.257690] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-31T18:35:08.758350] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T18:35:09.057158] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-31T18:35:09.060982] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-31T18:35:09.857690] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-31T18:35:10.337409] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T18:35:10.657731] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-31T18:35:11.024232] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T18:35:11.457719] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-31T18:35:12.257696] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-31T18:35:12.677947] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-31T18:35:12.909639] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T18:35:13.057699] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-31T18:35:13.556952] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T18:35:13.857625] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-31T18:35:14.657691] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-31T18:35:14.842549] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-31T18:35:14.854681] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-10-31T18:35:14.854812] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-31T18:35:15.244661] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-31T18:35:15.244821] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-31T18:35:15.246082] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-31T18:35:15.246147] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-31T18:35:15.247694] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 54386 (keeping 200 days of data) [2025-10-31T18:35:15.375833] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T18:35:15.461799] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-31T18:35:15.625369] [DEBUG] [LOCAL ] EPD: Primary data saved (54386 records). [2025-10-31T18:35:15.625516] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-31T18:35:15.625594] [INFO ] [MAIN ] Update Progress: 752/2365 symbols completed. EPD took 37.5s. Estimated remaining: 3h 24m 10s. Rate: 7.9 symbols/min [2025-10-31T18:35:15.804521] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:35:15.804837] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-10-31T18:35:15.804928] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-10-31T18:35:15.805159] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-31T18:35:15.805261] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-31T18:35:15.805408] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-31T18:35:15.805464] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-31T18:35:16.173836] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T18:35:16.172126] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:35:16.202464] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T18:35:16.257608] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-31T18:35:17.057626] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-31T18:35:17.857620] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-31T18:35:18.004740] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-31T18:35:18.647957] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-31T18:35:18.657599] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-31T18:35:18.744043] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-31T18:35:19.185882] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T18:35:19.457694] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-31T18:35:19.999837] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-31T18:35:20.257683] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-31T18:35:21.057752] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-31T18:35:21.845719] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T18:35:21.855556] [INFO ] [REMOTE ] EPR: Full fetch complete (63404 records). [2025-10-31T18:35:21.855722] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-31T18:35:21.867694] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-31T18:35:22.251693] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-31T18:35:22.251866] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-31T18:35:22.252691] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-31T18:35:22.252933] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-31T18:35:22.254525] [DEBUG] [LOCAL ] EPR: Trimmed 63404 records to 44161 (keeping 200 days of data) [2025-10-31T18:35:22.386388] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T18:35:22.576401] [DEBUG] [LOCAL ] EPR: Primary data saved (44161 records). [2025-10-31T18:35:22.576536] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-31T18:35:22.576617] [INFO ] [MAIN ] Update Progress: 753/2365 symbols completed. EPR took 29.3s. Estimated remaining: 3h 24m 1s. Rate: 7.9 symbols/min [2025-10-31T18:35:22.662751] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-31T18:35:22.766553] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:35:22.814815] [DEBUG] [LOCAL ] EQNR: Loaded 53423 existing records from primary storage. [2025-10-31T18:35:22.815153] [INFO ] [MAIN ] EQNR: Loaded 53423 existing records. [2025-10-31T18:35:23.001454] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:35:23.001730] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-31T18:35:23.001787] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-31T18:35:23.001996] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-31T18:35:23.002052] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-31T18:35:23.367587] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:35:23.394125] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-31T18:35:23.457612] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-31T18:35:24.232612] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T18:35:24.246511] [INFO ] [REMOTE ] EPRT: Full fetch complete (69846 records). [2025-10-31T18:35:24.246723] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-31T18:35:24.262925] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-31T18:35:24.675767] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-31T18:35:24.675923] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-31T18:35:24.676859] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-31T18:35:24.676928] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-31T18:35:24.678223] [DEBUG] [LOCAL ] EPRT: Trimmed 69846 records to 49094 (keeping 200 days of data) [2025-10-31T18:35:24.977112] [DEBUG] [LOCAL ] EPRT: Primary data saved (49094 records). [2025-10-31T18:35:24.977308] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-31T18:35:24.978212] [INFO ] [MAIN ] Update Progress: 754/2365 symbols completed. EPRT took 28.9s. Estimated remaining: 3h 23m 43s. Rate: 7.9 symbols/min [2025-10-31T18:35:25.070672] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-31T18:35:25.207509] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-31T18:35:25.206881] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:35:25.214908] [DEBUG] [LOCAL ] EQR: No existing data file found in primary storage. [2025-10-31T18:35:25.215532] [WARN ] [MAIN ] EQR: No existing data found, performing full refresh instead. [2025-10-31T18:35:25.218167] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-31T18:35:25.218342] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-31T18:35:25.229517] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-31T18:35:25.229632] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-10-31T18:35:25.229726] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-31T18:35:25.581319] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:35:25.857675] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-31T18:35:26.424973] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T18:35:26.657676] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-31T18:35:27.331880] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-31T18:35:27.457672] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-31T18:35:28.171883] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T18:35:28.257626] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-31T18:35:28.970294] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-31T18:35:29.057630] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-31T18:35:29.516847] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T18:35:29.857668] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-31T18:35:30.458807] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-31T18:35:30.657681] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-31T18:35:31.005976] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T18:35:31.304272] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-31T18:35:31.457687] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-31T18:35:32.003752] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T18:35:32.257663] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-31T18:35:33.057668] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-31T18:35:33.502637] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T18:35:33.797308] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-31T18:35:33.800626] [INFO ] [REMOTE ] EQBK: Full fetch complete (15674 records). [2025-10-31T18:35:33.800732] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-31T18:35:33.801150] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:35:33.801247] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:35:33.801326] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:35:33.801426] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-31T18:35:33.801510] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-31T18:35:33.801549] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-31T18:35:33.801772] [DEBUG] [LOCAL ] EQBK: Deleted derivative data file. [2025-10-31T18:35:33.801870] [INFO ] [MAIN ] Update Progress: 755/2365 symbols completed. EQBK took 31.6s. Estimated remaining: 3h 23m 38s. Rate: 7.9 symbols/min [2025-10-31T18:35:33.865596] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-31T18:35:33.987749] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:35:33.987968] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-31T18:35:33.988059] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-31T18:35:33.988143] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-31T18:35:33.988182] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-31T18:35:33.988223] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-31T18:35:33.988256] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-31T18:35:34.346518] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:35:34.657718] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-31T18:35:35.166639] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:35:35.457622] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-31T18:35:35.662209] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T18:35:36.257668] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-31T18:35:36.501596] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T18:35:36.755854] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-31T18:35:37.057683] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-31T18:35:37.857675] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-31T18:35:38.411435] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T18:35:38.657637] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-31T18:35:39.040289] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T18:35:39.457681] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-31T18:35:40.113617] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T18:35:40.125792] [INFO ] [REMOTE ] EQH: Full fetch complete (76588 records). [2025-10-31T18:35:40.125943] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-31T18:35:40.264384] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-31T18:35:40.512882] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-31T18:35:40.512956] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-31T18:35:40.513944] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-31T18:35:40.514007] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-31T18:35:40.515330] [DEBUG] [LOCAL ] EQH: Trimmed 76588 records to 53422 (keeping 200 days of data) [2025-10-31T18:35:40.577914] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T18:35:40.847442] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T18:35:40.879332] [DEBUG] [LOCAL ] EQH: Primary data saved (53422 records). [2025-10-31T18:35:40.879450] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-31T18:35:40.879518] [INFO ] [MAIN ] Update Progress: 756/2365 symbols completed. EQH took 25.3s. Estimated remaining: 3h 23m 29s. Rate: 7.9 symbols/min [2025-10-31T18:35:41.055578] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:35:41.057672] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-31T18:35:41.106353] [DEBUG] [LOCAL ] EQT: Loaded 54074 existing records from primary storage. [2025-10-31T18:35:41.106665] [INFO ] [MAIN ] EQT: Loaded 54074 existing records. [2025-10-31T18:35:41.296088] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:35:41.296344] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-31T18:35:41.296401] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-31T18:35:41.296582] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-31T18:35:41.296619] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-31T18:35:41.390539] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-31T18:35:41.653120] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:35:41.857702] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-31T18:35:42.657684] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-31T18:35:42.891096] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-31T18:35:43.457700] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-31T18:35:43.754980] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-31T18:35:43.795857] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-31T18:35:44.257719] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-31T18:35:45.057743] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-31T18:35:45.494295] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T18:35:45.857716] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-31T18:35:46.433378] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-31T18:35:46.657706] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-31T18:35:47.362476] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T18:35:47.457612] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-31T18:35:48.123480] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T18:35:48.257677] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-31T18:35:48.660822] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T18:35:48.663177] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-31T18:35:49.057689] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-31T18:35:49.857683] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-31T18:35:50.244867] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T18:35:50.657669] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-31T18:35:51.457634] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-31T18:35:51.502549] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-31T18:35:51.783260] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-31T18:35:51.991469] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T18:35:52.257670] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-31T18:35:52.640564] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T18:35:53.057673] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-31T18:35:53.857685] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-31T18:35:54.643684] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-31T18:35:54.657601] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-31T18:35:55.438435] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-31T18:35:55.457619] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-31T18:35:55.872255] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T18:35:56.103267] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T18:35:56.257677] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-31T18:35:57.057701] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-31T18:35:57.785178] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-31T18:35:57.857617] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-31T18:35:58.344803] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T18:35:58.657667] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-31T18:35:59.236045] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-31T18:35:59.283242] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T18:35:59.284163] [INFO ] [REMOTE ] EQS: Full fetch complete (2345 records). [2025-10-31T18:35:59.284229] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-31T18:35:59.473688] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-31T18:35:59.479014] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-31T18:35:59.479825] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:35:59.479913] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:35:59.480012] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-31T18:35:59.480082] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-31T18:35:59.480131] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-31T18:35:59.480186] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-31T18:35:59.480257] [INFO ] [MAIN ] Update Progress: 757/2365 symbols completed. EQS took 25.7s. Estimated remaining: 3h 23m 45s. Rate: 7.9 symbols/min [2025-10-31T18:36:00.257740] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-31T18:36:01.057673] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-31T18:36:01.996366] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-31T18:36:02.009180] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-31T18:36:02.094340] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-31T18:36:02.106588] [INFO ] [REMOTE ] EQNR: Full fetch complete (77008 records). [2025-10-31T18:36:02.106735] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-31T18:36:02.496871] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-31T18:36:02.496956] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-31T18:36:02.497855] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-31T18:36:02.497936] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-31T18:36:02.499343] [DEBUG] [LOCAL ] EQNR: Trimmed 77008 records to 53807 (keeping 200 days of data) [2025-10-31T18:36:02.812447] [DEBUG] [LOCAL ] EQNR: Primary data saved (53807 records). [2025-10-31T18:36:02.812576] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-31T18:36:02.812681] [INFO ] [MAIN ] Update Progress: 758/2365 symbols completed. EQNR took 40.2s. Estimated remaining: 3h 23m 28s. Rate: 7.9 symbols/min [2025-10-31T18:36:03.206225] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-31T18:36:03.217311] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-31T18:36:03.973718] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-31T18:36:03.984935] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-31T18:36:04.855378] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T18:36:04.868047] [INFO ] [REMOTE ] EQR: Full fetch complete (74295 records). [2025-10-31T18:36:04.868255] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-31T18:36:04.869281] [FATAL] [VALIDATOR ] EQR: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:36:04.869378] [FATAL] [MAIN ] EQR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:36:04.869423] [WARN ] [MAIN ] EQR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:36:04.869466] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-31T18:36:04.869533] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-10-31T18:36:04.869569] [INFO ] [LOCAL ] EQR: Starting deletion of derivative data. [2025-10-31T18:36:04.869611] [DEBUG] [LOCAL ] EQR: No derivative data file found to delete. [2025-10-31T18:36:04.869698] [INFO ] [MAIN ] Update Progress: 759/2365 symbols completed. EQR took 39.9s. Estimated remaining: 3h 23m 9s. Rate: 7.9 symbols/min [2025-10-31T18:36:05.555789] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-31T18:36:05.567131] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-31T18:36:06.314501] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T18:36:06.326596] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-31T18:36:06.326776] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-31T18:36:06.724057] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-31T18:36:06.724144] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-31T18:36:06.725159] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-31T18:36:06.725227] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-31T18:36:06.726738] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 54464 (keeping 200 days of data) [2025-10-31T18:36:07.100317] [DEBUG] [LOCAL ] EQT: Primary data saved (54464 records). [2025-10-31T18:36:07.100521] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-31T18:36:07.101173] [INFO ] [MAIN ] Update Progress: 760/2365 symbols completed. EQT took 26.2s. Estimated remaining: 3h 22m 50s. Rate: 7.9 symbols/min [2025-10-31T18:36:07.868248] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:07.849612] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:07.851213] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:07.876890] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:07.885552] [DEBUG] [LOCAL ] EQV: Loaded 2933 existing records from primary storage. [2025-10-31T18:36:07.886066] [INFO ] [MAIN ] EQV: Loaded 2933 existing records. [2025-10-31T18:36:08.103455] [DEBUG] [LOCAL ] ERJ: Loaded 50568 existing records from primary storage. [2025-10-31T18:36:08.112769] [INFO ] [MAIN ] ERJ: Loaded 50568 existing records. [2025-10-31T18:36:08.155246] [DEBUG] [LOCAL ] ERO: Loaded 42273 existing records from primary storage. [2025-10-31T18:36:08.178614] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:08.238369] [INFO ] [MAIN ] ERO: Loaded 42273 existing records. [2025-10-31T18:36:08.238584] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-31T18:36:08.250745] [DEBUG] [LOCAL ] ES: Loaded 53051 existing records from primary storage. [2025-10-31T18:36:08.261156] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-31T18:36:08.292185] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-31T18:36:08.317723] [INFO ] [MAIN ] ES: Loaded 53051 existing records. [2025-10-31T18:36:08.317851] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-31T18:36:08.583579] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:08.644288] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-31T18:36:08.714692] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-31T18:36:08.764188] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-31T18:36:08.797662] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-31T18:36:08.797471] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:08.818090] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-31T18:36:08.823351] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-31T18:36:08.868610] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-31T18:36:08.953199] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:08.978198] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-31T18:36:09.000780] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-31T18:36:09.013321] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-31T18:36:09.182221] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-31T18:36:09.206830] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-31T18:36:09.830548] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:09.876234] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-31T18:36:10.120279] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:10.146536] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-31T18:36:10.219373] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:10.222918] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-31T18:36:10.301775] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:10.302077] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-31T18:36:10.667121] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T18:36:10.669387] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-31T18:36:11.104072] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-31T18:36:11.105774] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-31T18:36:11.451336] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-31T18:36:11.452988] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-31T18:36:11.523529] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-31T18:36:11.531853] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-31T18:36:11.616954] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T18:36:11.628511] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-31T18:36:11.658278] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T18:36:11.778620] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-31T18:36:12.257728] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-31T18:36:12.509419] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T18:36:12.660684] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-31T18:36:12.848953] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T18:36:13.057699] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-31T18:36:13.857676] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-31T18:36:14.442489] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T18:36:14.657707] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-31T18:36:15.085887] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T18:36:15.457689] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-31T18:36:15.950815] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T18:36:16.257677] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-31T18:36:16.647188] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-31T18:36:16.676497] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T18:36:17.057741] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-31T18:36:17.857669] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-31T18:36:18.221286] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-31T18:36:18.223619] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T18:36:18.657690] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-31T18:36:19.457744] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-31T18:36:20.110666] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T18:36:20.257742] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-31T18:36:20.991136] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T18:36:21.057738] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-31T18:36:21.793015] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-31T18:36:21.857716] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-31T18:36:22.063418] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T18:36:22.657689] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-31T18:36:23.130205] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T18:36:23.457712] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-31T18:36:23.632528] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T18:36:24.257684] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-31T18:36:24.842275] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T18:36:25.057725] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-31T18:36:25.295348] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T18:36:25.511818] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-31T18:36:25.857673] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-31T18:36:26.153712] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-31T18:36:26.657693] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-31T18:36:27.457703] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-31T18:36:27.954666] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:36:27.974313] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-31T18:36:27.976212] [INFO ] [REMOTE ] EQV: Full fetch complete (4868 records). [2025-10-31T18:36:27.976331] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-31T18:36:28.262731] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-31T18:36:28.340119] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-31T18:36:28.340192] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-31T18:36:28.340345] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-31T18:36:28.340384] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-31T18:36:28.340770] [DEBUG] [LOCAL ] EQV: Trimmed 4868 records to 2985 (keeping 200 days of data) [2025-10-31T18:36:28.357659] [DEBUG] [LOCAL ] EQV: Primary data saved (2985 records). [2025-10-31T18:36:28.357727] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-31T18:36:28.357795] [INFO ] [MAIN ] Update Progress: 761/2365 symbols completed. EQV took 21.3s. Estimated remaining: 3h 23m 11s. Rate: 7.9 symbols/min [2025-10-31T18:36:28.529387] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:28.556021] [DEBUG] [LOCAL ] ESAB: Loaded 26058 existing records from primary storage. [2025-10-31T18:36:28.556321] [INFO ] [MAIN ] ESAB: Loaded 26058 existing records. [2025-10-31T18:36:28.735978] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:28.736242] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-31T18:36:28.736298] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-31T18:36:28.736465] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-31T18:36:28.736504] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-31T18:36:29.062731] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-31T18:36:29.089538] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:29.670338] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T18:36:29.857708] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-31T18:36:30.110492] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T18:36:30.657689] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-31T18:36:31.241545] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T18:36:31.457704] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-31T18:36:31.953234] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T18:36:32.257718] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-31T18:36:32.871986] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T18:36:33.057677] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-31T18:36:33.772037] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T18:36:33.857605] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-31T18:36:34.454462] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T18:36:34.466522] [INFO ] [REMOTE ] ES: Full fetch complete (76465 records). [2025-10-31T18:36:34.466698] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-31T18:36:34.661604] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-31T18:36:34.875771] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-31T18:36:34.875900] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-31T18:36:34.877234] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-31T18:36:34.877324] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-31T18:36:34.891011] [DEBUG] [LOCAL ] ES: Trimmed 76465 records to 53431 (keeping 200 days of data) [2025-10-31T18:36:34.909936] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-31T18:36:34.986150] [INFO ] [REMOTE ] ERO: Full fetch complete (60820 records). [2025-10-31T18:36:34.986946] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-31T18:36:35.463170] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-31T18:36:35.667118] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-31T18:36:35.668683] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-31T18:36:35.670590] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-31T18:36:35.672014] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-31T18:36:35.679630] [DEBUG] [LOCAL ] ES: Primary data saved (53431 records). [2025-10-31T18:36:35.679755] [INFO ] [MAIN ] ES: Full history saved. [2025-10-31T18:36:35.679865] [INFO ] [MAIN ] Update Progress: 762/2365 symbols completed. ES took 28.5s. Estimated remaining: 3h 23m 3s. Rate: 7.9 symbols/min [2025-10-31T18:36:35.677817] [DEBUG] [LOCAL ] ERO: Trimmed 60820 records to 42555 (keeping 200 days of data) [2025-10-31T18:36:36.012965] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:36.108243] [DEBUG] [LOCAL ] ERO: Primary data saved (42555 records). [2025-10-31T18:36:36.108466] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-31T18:36:36.107407] [DEBUG] [LOCAL ] ESE: Loaded 16164 existing records from primary storage. [2025-10-31T18:36:36.108938] [INFO ] [MAIN ] ESE: Loaded 16164 existing records. [2025-10-31T18:36:36.108708] [INFO ] [MAIN ] Update Progress: 763/2365 symbols completed. ERO took 29.0s. Estimated remaining: 3h 22m 40s. Rate: 7.9 symbols/min [2025-10-31T18:36:36.463593] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:36.467176] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-31T18:36:36.467100] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:36.467890] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-31T18:36:36.468355] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-31T18:36:36.473744] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-31T18:36:36.520362] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T18:36:36.562490] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-31T18:36:36.734123] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-31T18:36:36.894770] [DEBUG] [LOCAL ] ESI: Loaded 50958 existing records from primary storage. [2025-10-31T18:36:36.896230] [INFO ] [MAIN ] ESI: Loaded 50958 existing records. [2025-10-31T18:36:36.990276] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:37.063552] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-31T18:36:37.091252] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:37.091401] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-31T18:36:37.091446] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-31T18:36:37.091617] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-31T18:36:37.091681] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-31T18:36:37.447447] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:37.458951] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-31T18:36:37.637935] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-31T18:36:37.857748] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-31T18:36:38.657618] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-31T18:36:38.732432] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-31T18:36:39.457670] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-31T18:36:39.832207] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-31T18:36:40.257662] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-31T18:36:40.360986] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-31T18:36:41.057703] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-31T18:36:41.440222] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T18:36:41.857617] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-31T18:36:41.938776] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T18:36:42.657681] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-31T18:36:43.027193] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T18:36:43.396752] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T18:36:43.457671] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-31T18:36:44.257666] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-31T18:36:44.285167] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T18:36:45.057684] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-31T18:36:45.619482] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T18:36:45.650746] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-31T18:36:45.857739] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-31T18:36:46.657676] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-31T18:36:46.769351] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T18:36:47.436125] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-31T18:36:47.457607] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-31T18:36:48.257679] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-31T18:36:48.478472] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T18:36:49.057634] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-31T18:36:49.124380] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-31T18:36:49.857667] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-31T18:36:50.377926] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T18:36:50.657688] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-31T18:36:51.457702] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-31T18:36:51.554417] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-31T18:36:51.566276] [INFO ] [REMOTE ] ERJ: Full fetch complete (73264 records). [2025-10-31T18:36:51.566427] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-31T18:36:51.972347] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-31T18:36:51.972468] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-31T18:36:51.973404] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-31T18:36:51.973576] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-31T18:36:51.975080] [DEBUG] [LOCAL ] ERJ: Trimmed 73264 records to 50905 (keeping 200 days of data) [2025-10-31T18:36:52.093433] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T18:36:52.273561] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-31T18:36:52.312343] [DEBUG] [LOCAL ] ERJ: Primary data saved (50905 records). [2025-10-31T18:36:52.312744] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-31T18:36:52.312941] [INFO ] [MAIN ] Update Progress: 764/2365 symbols completed. ERJ took 45.2s. Estimated remaining: 3h 22m 51s. Rate: 7.9 symbols/min [2025-10-31T18:36:52.506373] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:52.540730] [DEBUG] [LOCAL ] ESNT: Loaded 37749 existing records from primary storage. [2025-10-31T18:36:52.540998] [INFO ] [MAIN ] ESNT: Loaded 37749 existing records. [2025-10-31T18:36:52.719795] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:52.720327] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-31T18:36:52.720620] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-31T18:36:52.720901] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-31T18:36:52.721036] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-31T18:36:52.811838] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-31T18:36:52.851333] [INFO ] [REMOTE ] ESAB: Full fetch complete (36960 records). [2025-10-31T18:36:52.862025] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-31T18:36:53.088157] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-31T18:36:53.399822] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:53.522181] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-31T18:36:53.522280] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-31T18:36:53.523200] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-31T18:36:53.523310] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-31T18:36:53.524400] [DEBUG] [LOCAL ] ESAB: Trimmed 36960 records to 26298 (keeping 200 days of data) [2025-10-31T18:36:53.639303] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T18:36:53.720089] [DEBUG] [LOCAL ] ESAB: Primary data saved (26298 records). [2025-10-31T18:36:53.720218] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-31T18:36:53.720299] [INFO ] [MAIN ] Update Progress: 765/2365 symbols completed. ESAB took 25.4s. Estimated remaining: 3h 22m 30s. Rate: 7.9 symbols/min [2025-10-31T18:36:53.866505] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-31T18:36:53.899626] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:36:53.939551] [DEBUG] [LOCAL ] ESRT: Loaded 46721 existing records from primary storage. [2025-10-31T18:36:53.939871] [INFO ] [MAIN ] ESRT: Loaded 46721 existing records. [2025-10-31T18:36:54.142931] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T18:36:54.146125] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:36:54.150223] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-31T18:36:54.150591] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-31T18:36:54.150833] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-31T18:36:54.150918] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-31T18:36:54.525529] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:36:54.657694] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-31T18:36:55.058135] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T18:36:55.312292] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T18:36:55.457739] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-31T18:36:56.257729] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-31T18:36:56.659611] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T18:36:57.057716] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-31T18:36:57.405759] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T18:36:57.795873] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T18:36:57.857674] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-31T18:36:58.553024] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T18:36:58.657681] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-31T18:36:59.347623] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-31T18:36:59.457639] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-31T18:37:00.205180] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T18:37:00.208867] [INFO ] [REMOTE ] ESE: Full fetch complete (22956 records). [2025-10-31T18:37:00.208943] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-31T18:37:00.209385] [FATAL] [VALIDATOR ] ESE: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:37:00.209468] [FATAL] [MAIN ] ESE: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:37:00.209511] [WARN ] [MAIN ] ESE: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:37:00.209548] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-31T18:37:00.209600] [DEBUG] [LOCAL ] ESE: No primary data file found to delete. [2025-10-31T18:37:00.209637] [INFO ] [LOCAL ] ESE: Starting deletion of derivative data. [2025-10-31T18:37:00.209861] [DEBUG] [LOCAL ] ESE: Deleted derivative data file. [2025-10-31T18:37:00.209948] [INFO ] [MAIN ] Update Progress: 766/2365 symbols completed. ESE took 24.5s. Estimated remaining: 3h 22m 20s. Rate: 7.9 symbols/min [2025-10-31T18:37:00.264106] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-31T18:37:00.388826] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:37:00.389063] [DEBUG] [LOCAL ] ESS: No existing data file found in primary storage. [2025-10-31T18:37:00.389106] [WARN ] [MAIN ] ESS: No existing data found, performing full refresh instead. [2025-10-31T18:37:00.389221] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-31T18:37:00.389262] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-31T18:37:00.389303] [DEBUG] [LOCAL ] ESS: No primary data file found to delete. [2025-10-31T18:37:00.389335] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-31T18:37:00.737269] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:37:01.057732] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-31T18:37:01.857682] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-31T18:37:02.385931] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T18:37:02.491787] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-31T18:37:02.657611] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-31T18:37:03.123549] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T18:37:03.457700] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-31T18:37:04.257624] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-31T18:37:04.451771] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-31T18:37:04.463931] [INFO ] [REMOTE ] ESI: Full fetch complete (73380 records). [2025-10-31T18:37:04.464066] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-31T18:37:04.861114] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T18:37:04.892836] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-31T18:37:04.893421] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-31T18:37:04.894476] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-31T18:37:04.894974] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-31T18:37:04.896495] [DEBUG] [LOCAL ] ESI: Trimmed 73380 records to 51338 (keeping 200 days of data) [2025-10-31T18:37:05.075749] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-31T18:37:05.202277] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T18:37:05.244470] [DEBUG] [LOCAL ] ESI: Primary data saved (51338 records). [2025-10-31T18:37:05.244974] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-31T18:37:05.245769] [INFO ] [MAIN ] Update Progress: 767/2365 symbols completed. ESI took 29.1s. Estimated remaining: 3h 22m 8s. Rate: 7.9 symbols/min [2025-10-31T18:37:05.423551] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:37:05.475399] [DEBUG] [LOCAL ] ESTC: Loaded 50555 existing records from primary storage. [2025-10-31T18:37:05.475752] [INFO ] [MAIN ] ESTC: Loaded 50555 existing records. [2025-10-31T18:37:05.676841] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:37:05.677143] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-31T18:37:05.677227] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-31T18:37:05.677502] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-31T18:37:05.677560] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-31T18:37:05.866998] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-31T18:37:06.038406] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:37:06.342892] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T18:37:06.657677] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-31T18:37:07.323089] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T18:37:07.457669] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-31T18:37:07.736254] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T18:37:08.257732] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-31T18:37:08.624696] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T18:37:09.057723] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-31T18:37:09.505812] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T18:37:09.857770] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-31T18:37:10.189306] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T18:37:10.657685] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-31T18:37:11.119537] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:37:11.457745] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-31T18:37:11.754692] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T18:37:12.257673] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-31T18:37:12.678964] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T18:37:13.057673] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-31T18:37:13.525943] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T18:37:13.857667] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-31T18:37:14.164002] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T18:37:14.657666] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-31T18:37:14.788929] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-31T18:37:15.457676] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-31T18:37:15.817421] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T18:37:16.257723] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-31T18:37:16.357751] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T18:37:17.057620] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-31T18:37:17.218143] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T18:37:17.857688] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-31T18:37:18.095236] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T18:37:18.657681] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-31T18:37:19.039133] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-31T18:37:19.457635] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-31T18:37:19.585091] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-31T18:37:20.257673] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-31T18:37:20.698852] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-31T18:37:21.057673] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-31T18:37:21.653815] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:37:21.857622] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-31T18:37:21.974750] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-31T18:37:22.657684] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-31T18:37:23.028048] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T18:37:23.457675] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-31T18:37:23.967282] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T18:37:24.257693] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-31T18:37:24.442766] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T18:37:24.451670] [INFO ] [REMOTE ] ESNT: Full fetch complete (56643 records). [2025-10-31T18:37:24.451832] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-31T18:37:24.830406] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-31T18:37:24.830495] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-31T18:37:24.831271] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-31T18:37:24.831336] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-31T18:37:24.832533] [DEBUG] [LOCAL ] ESNT: Trimmed 56643 records to 37993 (keeping 200 days of data) [2025-10-31T18:37:25.052754] [DEBUG] [LOCAL ] ESNT: Primary data saved (37993 records). [2025-10-31T18:37:25.052882] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-31T18:37:25.052958] [INFO ] [MAIN ] Update Progress: 768/2365 symbols completed. ESNT took 32.7s. Estimated remaining: 3h 22m 25s. Rate: 7.9 symbols/min [2025-10-31T18:37:25.064365] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-31T18:37:25.222844] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:37:25.274289] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-31T18:37:25.274597] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-10-31T18:37:25.453927] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:37:25.454246] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-31T18:37:25.454373] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-31T18:37:25.454689] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-31T18:37:25.454777] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-31T18:37:25.844039] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:37:25.846701] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T18:37:25.857675] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-31T18:37:26.070845] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-31T18:37:26.657667] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-31T18:37:27.177404] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T18:37:27.457694] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-31T18:37:28.257686] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-31T18:37:28.472775] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T18:37:28.745563] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-31T18:37:29.057684] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-31T18:37:29.684554] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-31T18:37:29.857630] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-31T18:37:30.243518] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T18:37:30.251028] [INFO ] [REMOTE ] ESS: Full fetch complete (43980 records). [2025-10-31T18:37:30.251134] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-31T18:37:30.617607] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-31T18:37:30.617709] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-31T18:37:30.618424] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-31T18:37:30.618488] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-31T18:37:30.619412] [DEBUG] [LOCAL ] ESS: Trimmed 43980 records to 30656 (keeping 200 days of data) [2025-10-31T18:37:30.674957] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-31T18:37:30.822403] [DEBUG] [LOCAL ] ESS: Primary data saved (30656 records). [2025-10-31T18:37:30.822544] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-31T18:37:30.822628] [INFO ] [MAIN ] Update Progress: 769/2365 symbols completed. ESS took 30.6s. Estimated remaining: 3h 22m 14s. Rate: 7.9 symbols/min [2025-10-31T18:37:30.993560] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:37:31.006467] [DEBUG] [LOCAL ] ETB: Loaded 11473 existing records from primary storage. [2025-10-31T18:37:31.006699] [INFO ] [MAIN ] ETB: Loaded 11473 existing records. [2025-10-31T18:37:31.180147] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:37:31.180376] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-31T18:37:31.180444] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-31T18:37:31.180625] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-31T18:37:31.180730] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-31T18:37:31.462766] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-31T18:37:31.544944] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:37:31.573521] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-31T18:37:32.030990] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T18:37:32.257683] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-31T18:37:33.057630] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-31T18:37:33.230297] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-31T18:37:33.241542] [INFO ] [REMOTE ] ESTC: Full fetch complete (72207 records). [2025-10-31T18:37:33.241733] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-31T18:37:33.242497] [FATAL] [VALIDATOR ] ESTC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:37:33.242587] [FATAL] [MAIN ] ESTC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:37:33.242631] [WARN ] [MAIN ] ESTC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:37:33.242716] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-31T18:37:33.242815] [DEBUG] [LOCAL ] ESTC: No primary data file found to delete. [2025-10-31T18:37:33.242873] [INFO ] [LOCAL ] ESTC: Starting deletion of derivative data. [2025-10-31T18:37:33.242990] [DEBUG] [LOCAL ] ESTC: Deleted derivative data file. [2025-10-31T18:37:33.243401] [INFO ] [MAIN ] Update Progress: 770/2365 symbols completed. ESTC took 28.0s. Estimated remaining: 3h 21m 56s. Rate: 7.9 symbols/min [2025-10-31T18:37:33.430478] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:37:33.461915] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T18:37:33.491638] [DEBUG] [LOCAL ] ETD: Loaded 26876 existing records from primary storage. [2025-10-31T18:37:33.491944] [INFO ] [MAIN ] ETD: Loaded 26876 existing records. [2025-10-31T18:37:33.667361] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:37:33.667576] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-31T18:37:33.667623] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-31T18:37:33.667820] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-31T18:37:33.667897] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-31T18:37:33.862757] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-31T18:37:33.931863] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T18:37:34.035913] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:37:34.657671] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-31T18:37:35.400759] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T18:37:35.457687] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-31T18:37:35.530954] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-31T18:37:36.058480] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-31T18:37:36.257678] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-31T18:37:37.057676] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-31T18:37:37.857672] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-31T18:37:38.083974] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T18:37:38.143676] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-31T18:37:38.493374] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T18:37:38.657671] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-31T18:37:39.457628] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-31T18:37:40.257692] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-31T18:37:40.638790] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T18:37:40.722141] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-31T18:37:40.740758] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-31T18:37:41.057637] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-31T18:37:41.857693] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-31T18:37:42.666747] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-31T18:37:42.672728] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T18:37:42.684079] [INFO ] [REMOTE ] ESRT: Full fetch complete (66829 records). [2025-10-31T18:37:42.684204] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-31T18:37:43.071909] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-31T18:37:43.072014] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-31T18:37:43.073418] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-31T18:37:43.073482] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-31T18:37:43.074958] [DEBUG] [LOCAL ] ESRT: Trimmed 66829 records to 47104 (keeping 200 days of data) [2025-10-31T18:37:43.287810] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-31T18:37:43.357802] [DEBUG] [LOCAL ] ESRT: Primary data saved (47104 records). [2025-10-31T18:37:43.358019] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-31T18:37:43.358291] [INFO ] [MAIN ] Update Progress: 771/2365 symbols completed. ESRT took 49.6s. Estimated remaining: 3h 21m 53s. Rate: 7.9 symbols/min [2025-10-31T18:37:43.461438] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-31T18:37:43.534296] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:37:43.566119] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-31T18:37:43.589297] [DEBUG] [LOCAL ] ETG: Loaded 16220 existing records from primary storage. [2025-10-31T18:37:43.589536] [INFO ] [MAIN ] ETG: Loaded 16220 existing records. [2025-10-31T18:37:43.765440] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:37:43.765713] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-31T18:37:43.765786] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-31T18:37:43.765960] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-31T18:37:43.766037] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-31T18:37:44.116302] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-31T18:37:44.149948] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:37:44.257611] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-31T18:37:45.057677] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-31T18:37:45.271669] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T18:37:45.552433] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-31T18:37:45.857709] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-31T18:37:46.657743] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-31T18:37:47.457689] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-31T18:37:47.475699] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-31T18:37:47.796411] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-31T18:37:48.104736] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-31T18:37:48.257629] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-31T18:37:49.026808] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T18:37:49.057633] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-31T18:37:49.857666] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-31T18:37:50.657620] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-31T18:37:50.845719] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-31T18:37:50.895278] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T18:37:51.273695] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T18:37:51.457630] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-31T18:37:52.257688] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-31T18:37:52.954447] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T18:37:53.066068] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-31T18:37:53.086888] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-31T18:37:53.857728] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-31T18:37:54.022630] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-31T18:37:54.539291] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T18:37:54.657678] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-31T18:37:55.457691] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-31T18:37:56.141301] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-31T18:37:56.257686] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-31T18:37:56.456612] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-31T18:37:56.468818] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-31T18:37:56.468965] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-31T18:37:56.865414] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-31T18:37:56.865519] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-31T18:37:56.866524] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-31T18:37:56.866587] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-31T18:37:56.868127] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 54569 (keeping 200 days of data) [2025-10-31T18:37:57.076426] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-31T18:37:57.087184] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-31T18:37:57.095045] [INFO ] [REMOTE ] ETB: Full fetch complete (18556 records). [2025-10-31T18:37:57.095452] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-31T18:37:57.504344] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-31T18:37:57.504739] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-31T18:37:57.505148] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-31T18:37:57.505218] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-31T18:37:57.509141] [DEBUG] [LOCAL ] ETB: Trimmed 18556 records to 11545 (keeping 200 days of data) [2025-10-31T18:37:57.657217] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-10-31T18:37:57.660055] [INFO ] [MAIN ] ET: Full history saved. [2025-10-31T18:37:57.661960] [INFO ] [MAIN ] Update Progress: 772/2365 symbols completed. ET took 32.6s. Estimated remaining: 3h 21m 59s. Rate: 7.9 symbols/min [2025-10-31T18:37:57.768838] [DEBUG] [LOCAL ] ETB: Primary data saved (11545 records). [2025-10-31T18:37:57.779894] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-31T18:37:57.780072] [INFO ] [MAIN ] Update Progress: 773/2365 symbols completed. ETB took 27.0s. Estimated remaining: 3h 21m 36s. Rate: 7.9 symbols/min [2025-10-31T18:37:57.868021] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-31T18:37:57.958329] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:37:57.985809] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T18:37:58.045281] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:37:58.059804] [DEBUG] [LOCAL ] ETJ: Loaded 15781 existing records from primary storage. [2025-10-31T18:37:58.060049] [INFO ] [MAIN ] ETJ: Loaded 15781 existing records. [2025-10-31T18:37:58.286158] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:37:58.287267] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-31T18:37:58.287367] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-31T18:37:58.303333] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-31T18:37:58.303475] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-31T18:37:58.303267] [DEBUG] [LOCAL ] ETN: Loaded 52870 existing records from primary storage. [2025-10-31T18:37:58.335880] [INFO ] [MAIN ] ETN: Loaded 52870 existing records. [2025-10-31T18:37:58.665774] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:37:58.660428] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-31T18:37:58.691029] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-31T18:37:58.708023] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-31T18:37:58.714496] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-31T18:37:58.740989] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-31T18:37:59.008455] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:37:59.229735] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T18:37:59.228883] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:37:59.352889] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-31T18:37:59.457670] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-31T18:38:00.171242] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T18:38:00.257718] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-31T18:38:01.057690] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-31T18:38:01.758261] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T18:38:01.836214] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T18:38:01.857683] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-31T18:38:02.564609] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T18:38:02.657676] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-31T18:38:03.384536] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-31T18:38:03.457692] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-31T18:38:04.267584] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-31T18:38:04.269435] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T18:38:05.057718] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-31T18:38:05.768997] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T18:38:05.810228] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T18:38:05.816044] [INFO ] [REMOTE ] ETG: Full fetch complete (24325 records). [2025-10-31T18:38:05.816288] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-31T18:38:05.862906] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-31T18:38:06.254316] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-31T18:38:06.254454] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-31T18:38:06.255747] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-31T18:38:06.255819] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-31T18:38:06.257025] [DEBUG] [LOCAL ] ETG: Trimmed 24325 records to 16348 (keeping 200 days of data) [2025-10-31T18:38:06.371799] [DEBUG] [LOCAL ] ETG: Primary data saved (16348 records). [2025-10-31T18:38:06.372010] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-31T18:38:06.372118] [INFO ] [MAIN ] Update Progress: 774/2365 symbols completed. ETG took 23.0s. Estimated remaining: 3h 21m 31s. Rate: 7.9 symbols/min [2025-10-31T18:38:06.580336] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:38:06.590167] [DEBUG] [LOCAL ] ETO: Loaded 6676 existing records from primary storage. [2025-10-31T18:38:06.590487] [INFO ] [MAIN ] ETO: Loaded 6676 existing records. [2025-10-31T18:38:06.662901] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-31T18:38:06.790900] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:38:06.791219] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-31T18:38:06.791276] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-31T18:38:06.791616] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-31T18:38:06.791727] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-31T18:38:07.186622] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:38:07.471351] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-31T18:38:07.493746] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-31T18:38:07.587895] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T18:38:08.257696] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-31T18:38:08.299329] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T18:38:09.057725] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-31T18:38:09.696473] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T18:38:09.865568] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-31T18:38:09.871445] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-31T18:38:10.444243] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-31T18:38:10.657720] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-31T18:38:11.457661] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-31T18:38:11.595829] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T18:38:11.897670] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-31T18:38:12.257671] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-31T18:38:13.057676] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-31T18:38:13.867478] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-31T18:38:13.872924] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-31T18:38:14.191347] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-31T18:38:14.197399] [INFO ] [REMOTE ] ETD: Full fetch complete (38556 records). [2025-10-31T18:38:14.197523] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-31T18:38:14.382963] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-31T18:38:14.586614] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-31T18:38:14.586717] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-31T18:38:14.587314] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-31T18:38:14.587354] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-31T18:38:14.588212] [DEBUG] [LOCAL ] ETD: Trimmed 38556 records to 27122 (keeping 200 days of data) [2025-10-31T18:38:14.676881] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-31T18:38:14.754573] [DEBUG] [LOCAL ] ETD: Primary data saved (27122 records). [2025-10-31T18:38:14.755190] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-31T18:38:14.755293] [INFO ] [MAIN ] Update Progress: 775/2365 symbols completed. ETD took 41.5s. Estimated remaining: 3h 21m 25s. Rate: 7.9 symbols/min [2025-10-31T18:38:14.969840] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:38:15.024877] [DEBUG] [LOCAL ] ETR: Loaded 53558 existing records from primary storage. [2025-10-31T18:38:15.025182] [INFO ] [MAIN ] ETR: Loaded 53558 existing records. [2025-10-31T18:38:15.199082] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:38:15.199310] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-31T18:38:15.199357] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-31T18:38:15.200363] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-31T18:38:15.200419] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-31T18:38:15.335057] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-31T18:38:15.462819] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-31T18:38:15.572524] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:38:15.991792] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T18:38:16.257694] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-31T18:38:16.767113] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-31T18:38:17.057699] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-31T18:38:17.857689] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-31T18:38:18.526931] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T18:38:18.657632] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-31T18:38:18.803451] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-31T18:38:19.457691] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-31T18:38:20.165348] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-31T18:38:20.257691] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-31T18:38:20.964353] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T18:38:21.057613] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-31T18:38:21.733153] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T18:38:21.857634] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-31T18:38:22.523157] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T18:38:22.657671] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-31T18:38:23.191136] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T18:38:23.457677] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-31T18:38:23.992004] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T18:38:24.199479] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-31T18:38:24.257628] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-31T18:38:25.057637] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-31T18:38:25.809559] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-31T18:38:25.857615] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-31T18:38:26.500921] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T18:38:26.513082] [INFO ] [REMOTE ] ETN: Full fetch complete (76588 records). [2025-10-31T18:38:26.513215] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-31T18:38:26.657895] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-31T18:38:26.933352] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-31T18:38:26.933488] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-31T18:38:26.934484] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-31T18:38:26.934639] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-31T18:38:26.965446] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-31T18:38:26.976787] [DEBUG] [LOCAL ] ETN: Trimmed 76588 records to 53259 (keeping 200 days of data) [2025-10-31T18:38:27.303440] [DEBUG] [LOCAL ] ETN: Primary data saved (53259 records). [2025-10-31T18:38:27.303568] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-31T18:38:27.303668] [INFO ] [MAIN ] Update Progress: 776/2365 symbols completed. ETN took 29.5s. Estimated remaining: 3h 21m 27s. Rate: 7.9 symbols/min [2025-10-31T18:38:27.469920] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-31T18:38:27.507092] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-31T18:38:27.506378] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:38:27.561561] [DEBUG] [LOCAL ] ETSY: Loaded 53946 existing records from primary storage. [2025-10-31T18:38:27.561908] [INFO ] [MAIN ] ETSY: Loaded 53946 existing records. [2025-10-31T18:38:27.739506] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:38:27.739750] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-31T18:38:27.739801] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-31T18:38:27.740595] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-31T18:38:27.740690] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-31T18:38:28.096556] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:38:28.257675] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-31T18:38:28.926156] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-31T18:38:29.057639] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-31T18:38:29.740253] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-31T18:38:29.857666] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-31T18:38:30.338959] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T18:38:30.616410] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-31T18:38:30.657606] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-31T18:38:31.457676] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-31T18:38:32.141996] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-31T18:38:32.172697] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T18:38:32.257680] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-31T18:38:32.968762] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T18:38:33.057689] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-31T18:38:33.495759] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-31T18:38:33.857680] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-31T18:38:34.657704] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-31T18:38:35.239598] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-31T18:38:35.457730] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-31T18:38:36.135548] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T18:38:36.257613] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-31T18:38:36.817103] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T18:38:37.057670] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-31T18:38:37.508167] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T18:38:37.857599] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-31T18:38:37.976461] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T18:38:37.980246] [INFO ] [REMOTE ] ETJ: Full fetch complete (25003 records). [2025-10-31T18:38:37.980323] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-31T18:38:38.345131] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-31T18:38:38.345205] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-31T18:38:38.345711] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-31T18:38:38.345772] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-31T18:38:38.346421] [DEBUG] [LOCAL ] ETJ: Trimmed 25003 records to 15857 (keeping 200 days of data) [2025-10-31T18:38:38.435333] [DEBUG] [LOCAL ] ETJ: Primary data saved (15857 records). [2025-10-31T18:38:38.435459] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-31T18:38:38.435535] [INFO ] [MAIN ] Update Progress: 777/2365 symbols completed. ETJ took 40.8s. Estimated remaining: 3h 21m 27s. Rate: 7.9 symbols/min [2025-10-31T18:38:38.601375] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:38:38.621761] [DEBUG] [LOCAL ] ETV: Loaded 21462 existing records from primary storage. [2025-10-31T18:38:38.622008] [INFO ] [MAIN ] ETV: Loaded 21462 existing records. [2025-10-31T18:38:38.664098] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-31T18:38:38.802255] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:38:38.802450] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-31T18:38:38.802501] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-31T18:38:38.802967] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-31T18:38:38.803030] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-31T18:38:39.155290] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:38:39.421823] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-31T18:38:39.457603] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-31T18:38:39.555707] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-31T18:38:39.558142] [INFO ] [REMOTE ] ETO: Full fetch complete (9670 records). [2025-10-31T18:38:39.558210] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-31T18:38:39.976729] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-31T18:38:39.976814] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-31T18:38:39.977115] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-31T18:38:39.977177] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-31T18:38:39.977723] [DEBUG] [LOCAL ] ETO: Trimmed 9670 records to 6713 (keeping 200 days of data) [2025-10-31T18:38:40.022927] [DEBUG] [LOCAL ] ETO: Primary data saved (6713 records). [2025-10-31T18:38:40.023083] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-31T18:38:40.023172] [INFO ] [MAIN ] Update Progress: 778/2365 symbols completed. ETO took 33.7s. Estimated remaining: 3h 21m 7s. Rate: 7.9 symbols/min [2025-10-31T18:38:40.192579] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:38:40.214137] [DEBUG] [LOCAL ] ETW: Loaded 24618 existing records from primary storage. [2025-10-31T18:38:40.214429] [INFO ] [MAIN ] ETW: Loaded 24618 existing records. [2025-10-31T18:38:40.262854] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-31T18:38:40.403077] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:38:40.403356] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-31T18:38:40.403431] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-31T18:38:40.404127] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-31T18:38:40.404194] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-31T18:38:40.753784] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:38:40.950358] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T18:38:41.057671] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-31T18:38:41.857690] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-31T18:38:42.213968] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-31T18:38:42.226115] [INFO ] [REMOTE ] ETR: Full fetch complete (77269 records). [2025-10-31T18:38:42.226225] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-31T18:38:42.658955] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-31T18:38:42.659216] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-31T18:38:42.661005] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-31T18:38:42.662888] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-31T18:38:42.674573] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-31T18:38:42.675110] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-31T18:38:42.676621] [DEBUG] [LOCAL ] ETR: Trimmed 77269 records to 53945 (keeping 200 days of data) [2025-10-31T18:38:42.998749] [DEBUG] [LOCAL ] ETR: Primary data saved (53945 records). [2025-10-31T18:38:42.998938] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-31T18:38:42.999793] [INFO ] [MAIN ] Update Progress: 779/2365 symbols completed. ETR took 28.2s. Estimated remaining: 3h 20m 50s. Rate: 7.9 symbols/min [2025-10-31T18:38:43.164177] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T18:38:43.226682] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:38:43.235564] [DEBUG] [LOCAL ] ETX: Loaded 5365 existing records from primary storage. [2025-10-31T18:38:43.235853] [INFO ] [MAIN ] ETX: Loaded 5365 existing records. [2025-10-31T18:38:43.450616] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:38:43.450862] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-31T18:38:43.450911] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-31T18:38:43.451144] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-31T18:38:43.451200] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-31T18:38:43.458703] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-31T18:38:43.881104] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:38:43.895996] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T18:38:44.257671] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-31T18:38:45.055552] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T18:38:45.060129] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-31T18:38:45.110034] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-31T18:38:45.737387] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T18:38:45.857708] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-31T18:38:46.521148] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T18:38:46.657682] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-31T18:38:47.017166] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T18:38:47.457631] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-31T18:38:48.197126] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T18:38:48.257632] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-31T18:38:49.057631] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-31T18:38:49.205268] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T18:38:49.802073] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T18:38:49.857689] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-31T18:38:50.634968] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T18:38:50.657612] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-31T18:38:51.387065] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T18:38:51.457636] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-31T18:38:52.257710] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-31T18:38:52.380416] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-31T18:38:53.057674] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-31T18:38:53.307170] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T18:38:53.857700] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-31T18:38:54.243238] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-31T18:38:54.515699] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-31T18:38:54.657638] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-31T18:38:55.454411] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-31T18:38:55.459314] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-31T18:38:56.257702] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-31T18:38:56.851938] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-31T18:38:57.057676] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-31T18:38:57.103502] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-31T18:38:57.773217] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T18:38:57.857687] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-31T18:38:58.611037] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T18:38:58.657632] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-31T18:38:59.457616] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-31T18:38:59.649497] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T18:38:59.655811] [INFO ] [REMOTE ] ETW: Full fetch complete (36377 records). [2025-10-31T18:38:59.655912] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-31T18:38:59.973846] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-31T18:39:00.060550] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-31T18:39:00.060633] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-31T18:39:00.061284] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-31T18:39:00.061329] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-31T18:39:00.062107] [DEBUG] [LOCAL ] ETW: Trimmed 36377 records to 24783 (keeping 200 days of data) [2025-10-31T18:39:00.206216] [DEBUG] [LOCAL ] ETW: Primary data saved (24783 records). [2025-10-31T18:39:00.206358] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-31T18:39:00.206451] [INFO ] [MAIN ] Update Progress: 780/2365 symbols completed. ETW took 20.2s. Estimated remaining: 3h 21m 2s. Rate: 7.9 symbols/min [2025-10-31T18:39:00.267435] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-31T18:39:00.376968] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:00.397025] [DEBUG] [LOCAL ] ETY: Loaded 21795 existing records from primary storage. [2025-10-31T18:39:00.397256] [INFO ] [MAIN ] ETY: Loaded 21795 existing records. [2025-10-31T18:39:00.575556] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:39:00.575793] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-31T18:39:00.575843] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-31T18:39:00.576295] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-31T18:39:00.576354] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-31T18:39:00.937464] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T18:39:00.977786] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:01.057687] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-31T18:39:01.857679] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-31T18:39:01.987140] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-31T18:39:02.657727] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-31T18:39:03.457704] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-31T18:39:03.494276] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T18:39:03.507497] [INFO ] [REMOTE ] ETSY: Full fetch complete (77668 records). [2025-10-31T18:39:03.507706] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-31T18:39:03.863220] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T18:39:03.941921] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-31T18:39:03.942002] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-31T18:39:03.942927] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-31T18:39:03.942991] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-31T18:39:03.944411] [DEBUG] [LOCAL ] ETSY: Trimmed 77668 records to 54336 (keeping 200 days of data) [2025-10-31T18:39:04.059852] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-31T18:39:04.261360] [DEBUG] [LOCAL ] ETSY: Primary data saved (54336 records). [2025-10-31T18:39:04.261568] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-31T18:39:04.262725] [INFO ] [MAIN ] Update Progress: 781/2365 symbols completed. ETSY took 37.0s. Estimated remaining: 3h 20m 47s. Rate: 7.9 symbols/min [2025-10-31T18:39:04.257669] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-31T18:39:04.433589] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:04.451016] [DEBUG] [LOCAL ] EVC: Loaded 17424 existing records from primary storage. [2025-10-31T18:39:04.451242] [INFO ] [MAIN ] EVC: Loaded 17424 existing records. [2025-10-31T18:39:04.631852] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:39:04.632066] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-31T18:39:04.632118] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-31T18:39:04.632497] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-31T18:39:04.632553] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-31T18:39:04.895065] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-31T18:39:05.004035] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:05.057617] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-31T18:39:05.857672] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-31T18:39:06.320579] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:39:06.340318] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T18:39:06.657627] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-31T18:39:07.457604] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-31T18:39:07.533090] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T18:39:08.232057] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T18:39:08.257639] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-31T18:39:09.057632] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-31T18:39:09.150475] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T18:39:09.473337] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T18:39:09.857665] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-31T18:39:10.657684] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-31T18:39:10.685012] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T18:39:11.270976] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T18:39:11.272597] [INFO ] [REMOTE ] ETX: Full fetch complete (6832 records). [2025-10-31T18:39:11.272696] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-31T18:39:11.466744] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-31T18:39:11.623942] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-31T18:39:11.624017] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-31T18:39:11.624184] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-31T18:39:11.624241] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-31T18:39:11.624609] [DEBUG] [LOCAL ] ETX: Trimmed 6832 records to 5411 (keeping 200 days of data) [2025-10-31T18:39:11.657180] [DEBUG] [LOCAL ] ETX: Primary data saved (5411 records). [2025-10-31T18:39:11.657303] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-31T18:39:11.657378] [INFO ] [MAIN ] Update Progress: 782/2365 symbols completed. ETX took 28.7s. Estimated remaining: 3h 20m 39s. Rate: 7.9 symbols/min [2025-10-31T18:39:11.822574] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:11.852080] [DEBUG] [LOCAL ] EVEX: Loaded 33878 existing records from primary storage. [2025-10-31T18:39:11.852328] [INFO ] [MAIN ] EVEX: Loaded 33878 existing records. [2025-10-31T18:39:12.025487] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:39:12.025717] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-31T18:39:12.025771] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-31T18:39:12.026332] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-31T18:39:12.026387] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-31T18:39:12.257675] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-31T18:39:12.382712] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:12.542629] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T18:39:13.057637] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-31T18:39:13.151254] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-31T18:39:13.857618] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-31T18:39:14.025469] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T18:39:14.658797] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-31T18:39:14.663606] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T18:39:15.457634] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-31T18:39:15.634937] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-31T18:39:16.197497] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T18:39:16.257672] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-31T18:39:17.057704] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-31T18:39:17.118339] [DEBUG] [REMOTE ] EVC: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-31T18:39:17.118882] [WARN ] [REMOTE ] EVC: No data returned for month 2025-05 [2025-10-31T18:39:17.118988] [FATAL] [REMOTE ] EVC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:39:17.119089] [FATAL] [MAIN ] EVC: Failed to fetch primary data. [2025-10-31T18:39:17.119156] [WARN ] [MAIN ] EVC: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:39:17.119238] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-31T18:39:17.119401] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-10-31T18:39:17.119462] [INFO ] [LOCAL ] EVC: Starting deletion of derivative data. [2025-10-31T18:39:17.119639] [DEBUG] [LOCAL ] EVC: Deleted derivative data file. [2025-10-31T18:39:17.119764] [INFO ] [MAIN ] Update Progress: 783/2365 symbols completed. EVC took 12.9s. Estimated remaining: 3h 20m 27s. Rate: 7.9 symbols/min [2025-10-31T18:39:17.325893] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:17.327940] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T18:39:17.334894] [INFO ] [REMOTE ] ETV: Full fetch complete (31806 records). [2025-10-31T18:39:17.335026] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-31T18:39:17.456774] [DEBUG] [LOCAL ] EVF: Loaded 9414 existing records from primary storage. [2025-10-31T18:39:17.457532] [INFO ] [MAIN ] EVF: Loaded 9414 existing records. [2025-10-31T18:39:17.862637] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:39:17.862742] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-31T18:39:17.875087] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-31T18:39:17.888192] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-31T18:39:17.888894] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-31T18:39:17.894351] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-31T18:39:18.126357] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-31T18:39:18.126480] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-31T18:39:18.145719] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-31T18:39:18.147341] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-31T18:39:18.241449] [DEBUG] [LOCAL ] ETV: Trimmed 31806 records to 21624 (keeping 200 days of data) [2025-10-31T18:39:18.452609] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:18.485102] [DEBUG] [LOCAL ] ETV: Primary data saved (21624 records). [2025-10-31T18:39:18.485274] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-31T18:39:18.485374] [INFO ] [MAIN ] Update Progress: 784/2365 symbols completed. ETV took 40.0s. Estimated remaining: 3h 20m 7s. Rate: 7.9 symbols/min [2025-10-31T18:39:18.680863] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:18.657833] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-31T18:39:18.702802] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-31T18:39:18.714323] [DEBUG] [LOCAL ] EVG: Loaded 5813 existing records from primary storage. [2025-10-31T18:39:18.714835] [INFO ] [MAIN ] EVG: Loaded 5813 existing records. [2025-10-31T18:39:18.905870] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:39:18.906166] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-31T18:39:18.906222] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-31T18:39:18.906467] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-31T18:39:18.906508] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-31T18:39:19.300554] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:19.440183] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T18:39:19.457684] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-31T18:39:19.852945] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T18:39:20.257707] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-31T18:39:20.788922] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T18:39:21.057680] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-31T18:39:21.615944] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-31T18:39:21.857714] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-31T18:39:22.290512] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T18:39:22.657757] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-31T18:39:23.405128] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T18:39:23.457637] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-31T18:39:24.257738] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-31T18:39:24.698987] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T18:39:25.029820] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-31T18:39:25.057624] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-31T18:39:25.422433] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T18:39:25.857670] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-31T18:39:26.389245] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T18:39:26.657681] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-31T18:39:27.455296] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T18:39:27.458353] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-31T18:39:28.257626] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-31T18:39:28.380600] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-31T18:39:28.807626] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-31T18:39:29.057671] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-31T18:39:29.767203] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T18:39:29.857632] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-31T18:39:30.619783] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-31T18:39:30.657639] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-31T18:39:31.090430] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-31T18:39:31.457678] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-31T18:39:31.998085] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T18:39:32.257764] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-31T18:39:32.983190] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-31T18:39:33.057666] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-31T18:39:33.588279] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T18:39:33.857672] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-31T18:39:34.439709] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-31T18:39:34.657667] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-31T18:39:35.368664] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T18:39:35.371561] [INFO ] [REMOTE ] EVF: Full fetch complete (12986 records). [2025-10-31T18:39:35.371636] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-31T18:39:35.462710] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-31T18:39:35.734735] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-31T18:39:35.734821] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-31T18:39:35.735121] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-31T18:39:35.735162] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-31T18:39:35.735706] [DEBUG] [LOCAL ] EVF: Trimmed 12986 records to 9482 (keeping 200 days of data) [2025-10-31T18:39:35.791577] [DEBUG] [LOCAL ] EVF: Primary data saved (9482 records). [2025-10-31T18:39:35.791755] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-31T18:39:35.791842] [INFO ] [MAIN ] Update Progress: 785/2365 symbols completed. EVF took 18.7s. Estimated remaining: 3h 20m 19s. Rate: 7.9 symbols/min [2025-10-31T18:39:35.962416] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:36.008402] [DEBUG] [LOCAL ] EVH: Loaded 49885 existing records from primary storage. [2025-10-31T18:39:36.008737] [INFO ] [MAIN ] EVH: Loaded 49885 existing records. [2025-10-31T18:39:36.180993] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:39:36.181169] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-31T18:39:36.181214] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-31T18:39:36.181974] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-31T18:39:36.182062] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-31T18:39:36.261096] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-31T18:39:36.404882] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T18:39:36.557125] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:36.759389] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-31T18:39:37.057683] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-31T18:39:37.487193] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T18:39:37.857677] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-31T18:39:38.351754] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-31T18:39:38.657677] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-31T18:39:39.450884] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-31T18:39:39.457607] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-31T18:39:40.257748] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-31T18:39:40.475344] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T18:39:41.057695] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-31T18:39:41.435036] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-31T18:39:41.664221] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T18:39:41.857704] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-31T18:39:42.657673] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-31T18:39:42.952538] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T18:39:43.280503] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T18:39:43.282609] [INFO ] [REMOTE ] EVG: Full fetch complete (8173 records). [2025-10-31T18:39:43.282734] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-31T18:39:43.462785] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-31T18:39:43.641897] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-31T18:39:43.641969] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-31T18:39:43.642169] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-31T18:39:43.642206] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-31T18:39:43.642582] [DEBUG] [LOCAL ] EVG: Trimmed 8173 records to 5887 (keeping 200 days of data) [2025-10-31T18:39:43.678350] [DEBUG] [LOCAL ] EVG: Primary data saved (5887 records). [2025-10-31T18:39:43.678483] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-31T18:39:43.678572] [INFO ] [MAIN ] Update Progress: 786/2365 symbols completed. EVG took 25.2s. Estimated remaining: 3h 20m 12s. Rate: 7.9 symbols/min [2025-10-31T18:39:43.847135] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:43.857857] [DEBUG] [LOCAL ] EVN: Loaded 10947 existing records from primary storage. [2025-10-31T18:39:43.861163] [INFO ] [MAIN ] EVN: Loaded 10947 existing records. [2025-10-31T18:39:44.037398] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:39:44.037665] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-31T18:39:44.037726] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-31T18:39:44.038013] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-31T18:39:44.038070] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-31T18:39:44.270386] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-31T18:39:44.424466] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:44.554132] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-31T18:39:44.560143] [INFO ] [REMOTE ] ETY: Full fetch complete (33647 records). [2025-10-31T18:39:44.560301] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-31T18:39:44.964717] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-31T18:39:44.964829] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-31T18:39:44.965785] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-31T18:39:44.965851] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-31T18:39:44.967047] [DEBUG] [LOCAL ] ETY: Trimmed 33647 records to 21925 (keeping 200 days of data) [2025-10-31T18:39:45.060909] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-31T18:39:45.109200] [DEBUG] [LOCAL ] ETY: Primary data saved (21925 records). [2025-10-31T18:39:45.109325] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-31T18:39:45.109401] [INFO ] [MAIN ] Update Progress: 787/2365 symbols completed. ETY took 44.9s. Estimated remaining: 3h 19m 52s. Rate: 7.9 symbols/min [2025-10-31T18:39:45.277085] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:45.278062] [DEBUG] [LOCAL ] EVR: No existing data file found in primary storage. [2025-10-31T18:39:45.278114] [WARN ] [MAIN ] EVR: No existing data found, performing full refresh instead. [2025-10-31T18:39:45.278301] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-31T18:39:45.278353] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-31T18:39:45.278396] [DEBUG] [LOCAL ] EVR: No primary data file found to delete. [2025-10-31T18:39:45.278428] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-31T18:39:45.632348] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:45.665539] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-31T18:39:45.857690] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-31T18:39:46.173729] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T18:39:46.657683] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-31T18:39:47.031890] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T18:39:47.457709] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-31T18:39:47.790783] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-31T18:39:48.257677] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-31T18:39:48.627071] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T18:39:49.057687] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-31T18:39:49.697153] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T18:39:49.857707] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-31T18:39:50.292483] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T18:39:50.657689] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-31T18:39:50.918958] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T18:39:51.457688] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-31T18:39:51.999967] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T18:39:52.257639] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-31T18:39:52.737439] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T18:39:53.057686] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-31T18:39:53.381297] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T18:39:53.857672] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-31T18:39:54.403342] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-31T18:39:54.413579] [INFO ] [REMOTE ] EVEX: Full fetch complete (44600 records). [2025-10-31T18:39:54.413722] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-31T18:39:54.663046] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-31T18:39:54.799628] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-31T18:39:54.799753] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-31T18:39:54.800718] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-31T18:39:54.800786] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-31T18:39:54.802116] [DEBUG] [LOCAL ] EVEX: Trimmed 44600 records to 34192 (keeping 200 days of data) [2025-10-31T18:39:55.017450] [DEBUG] [LOCAL ] EVEX: Primary data saved (34192 records). [2025-10-31T18:39:55.017682] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-31T18:39:55.018510] [INFO ] [MAIN ] Update Progress: 788/2365 symbols completed. EVEX took 43.4s. Estimated remaining: 3h 19m 49s. Rate: 7.9 symbols/min [2025-10-31T18:39:55.193154] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:39:55.220234] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:39:55.239196] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-31T18:39:55.254165] [DEBUG] [LOCAL ] EVT: Loaded 16338 existing records from primary storage. [2025-10-31T18:39:55.254402] [INFO ] [MAIN ] EVT: Loaded 16338 existing records. [2025-10-31T18:39:55.425156] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:39:55.425379] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-31T18:39:55.425425] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-31T18:39:55.425859] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-31T18:39:55.425917] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-31T18:39:55.463318] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-31T18:39:55.769907] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:39:56.257714] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-31T18:39:56.547285] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T18:39:57.057699] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-31T18:39:57.366509] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:39:57.857729] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-31T18:39:58.110006] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T18:39:58.572381] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T18:39:58.657744] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-31T18:39:59.457730] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-31T18:39:59.970518] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T18:40:00.056175] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-31T18:40:00.257692] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-31T18:40:01.057704] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-31T18:40:01.272570] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T18:40:01.857703] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-31T18:40:02.039952] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-31T18:40:02.657661] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-31T18:40:03.457617] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-31T18:40:03.577594] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T18:40:03.979204] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-31T18:40:04.257674] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-31T18:40:05.001025] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-31T18:40:05.002179] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-31T18:40:05.018516] [INFO ] [REMOTE ] EVH: Full fetch complete (71912 records). [2025-10-31T18:40:05.018717] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-31T18:40:05.062997] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-31T18:40:05.497410] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-31T18:40:05.497524] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-31T18:40:05.499039] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-31T18:40:05.499113] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-31T18:40:05.501192] [DEBUG] [LOCAL ] EVH: Trimmed 71912 records to 50241 (keeping 200 days of data) [2025-10-31T18:40:05.722454] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-31T18:40:05.823047] [DEBUG] [LOCAL ] EVH: Primary data saved (50241 records). [2025-10-31T18:40:05.823318] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-31T18:40:05.824297] [INFO ] [MAIN ] Update Progress: 789/2365 symbols completed. EVH took 30.0s. Estimated remaining: 3h 19m 48s. Rate: 7.9 symbols/min [2025-10-31T18:40:05.862877] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-31T18:40:06.007558] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:40:06.036817] [DEBUG] [LOCAL ] EVTC: Loaded 26818 existing records from primary storage. [2025-10-31T18:40:06.037177] [INFO ] [MAIN ] EVTC: Loaded 26818 existing records. [2025-10-31T18:40:06.225593] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:40:06.225913] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-31T18:40:06.225966] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-31T18:40:06.226690] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-31T18:40:06.226752] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-31T18:40:06.607187] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:40:06.657736] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-31T18:40:06.736865] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T18:40:07.045963] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-31T18:40:07.457689] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-31T18:40:08.213613] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T18:40:08.257618] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-31T18:40:08.819319] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-31T18:40:09.057686] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-31T18:40:09.640151] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-31T18:40:09.857677] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-31T18:40:10.498669] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T18:40:10.657677] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-31T18:40:11.243565] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-31T18:40:11.457714] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-31T18:40:12.257684] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-31T18:40:12.472735] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T18:40:13.062903] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-31T18:40:13.066128] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-31T18:40:13.069738] [INFO ] [REMOTE ] EVN: Full fetch complete (16648 records). [2025-10-31T18:40:13.069814] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-31T18:40:13.433231] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-31T18:40:13.433307] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-31T18:40:13.433681] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-31T18:40:13.433741] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-31T18:40:13.434245] [DEBUG] [LOCAL ] EVN: Trimmed 16648 records to 11009 (keeping 200 days of data) [2025-10-31T18:40:13.502196] [DEBUG] [LOCAL ] EVN: Primary data saved (11009 records). [2025-10-31T18:40:13.502338] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-31T18:40:13.502430] [INFO ] [MAIN ] Update Progress: 790/2365 symbols completed. EVN took 29.8s. Estimated remaining: 3h 19m 40s. Rate: 7.9 symbols/min [2025-10-31T18:40:13.673252] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:40:13.718878] [DEBUG] [LOCAL ] EVTL: Loaded 42652 existing records from primary storage. [2025-10-31T18:40:13.720068] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T18:40:13.720246] [INFO ] [MAIN ] EVTL: Loaded 42652 existing records. [2025-10-31T18:40:13.862737] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-31T18:40:13.904087] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:40:13.904283] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-31T18:40:13.904332] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-31T18:40:13.905143] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-31T18:40:13.905213] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-31T18:40:14.252444] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:40:14.657676] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-31T18:40:14.746066] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-31T18:40:14.750261] [INFO ] [REMOTE ] EVT: Full fetch complete (24712 records). [2025-10-31T18:40:14.750373] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-31T18:40:15.130760] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-31T18:40:15.130888] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-31T18:40:15.131834] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-31T18:40:15.131906] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-31T18:40:15.133301] [DEBUG] [LOCAL ] EVT: Trimmed 24712 records to 16479 (keeping 200 days of data) [2025-10-31T18:40:15.244765] [DEBUG] [LOCAL ] EVT: Primary data saved (16479 records). [2025-10-31T18:40:15.244977] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-31T18:40:15.245114] [INFO ] [MAIN ] Update Progress: 791/2365 symbols completed. EVT took 20.2s. Estimated remaining: 3h 19m 21s. Rate: 7.9 symbols/min [2025-10-31T18:40:15.443073] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:40:15.459353] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-31T18:40:15.473098] [DEBUG] [LOCAL ] EVTR: Loaded 25899 existing records from primary storage. [2025-10-31T18:40:15.473464] [INFO ] [MAIN ] EVTR: Loaded 25899 existing records. [2025-10-31T18:40:15.673468] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:40:15.673807] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-31T18:40:15.673870] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-31T18:40:15.674512] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-31T18:40:15.674572] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-31T18:40:16.024599] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T18:40:16.118161] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:40:16.257629] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-31T18:40:16.407763] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T18:40:17.057626] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-31T18:40:17.125843] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T18:40:17.857616] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-31T18:40:17.922449] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-31T18:40:18.363420] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-31T18:40:18.657728] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-31T18:40:19.457672] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-31T18:40:19.907504] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-31T18:40:20.174552] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-31T18:40:20.257713] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-31T18:40:21.057678] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-31T18:40:21.375826] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T18:40:21.780275] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-31T18:40:21.857606] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-31T18:40:22.657633] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-31T18:40:22.747999] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-31T18:40:23.457725] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-31T18:40:23.769354] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T18:40:24.257628] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-31T18:40:24.436264] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T18:40:25.057627] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-31T18:40:25.228639] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T18:40:25.627512] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T18:40:25.857618] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-31T18:40:26.607771] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T18:40:26.657712] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-31T18:40:27.457710] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-31T18:40:27.734794] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T18:40:28.257681] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-31T18:40:28.372509] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T18:40:29.057629] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-31T18:40:29.170023] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T18:40:29.850194] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-31T18:40:29.857610] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-31T18:40:30.657668] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-31T18:40:30.892350] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T18:40:31.457688] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-31T18:40:31.495249] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T18:40:32.257683] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-31T18:40:32.618102] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T18:40:33.057666] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-31T18:40:33.499537] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-31T18:40:33.506431] [INFO ] [REMOTE ] EVR: Full fetch complete (50464 records). [2025-10-31T18:40:33.506520] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-31T18:40:33.862925] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-31T18:40:33.898340] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-31T18:40:33.898713] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-31T18:40:33.899507] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-31T18:40:33.904843] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-31T18:40:33.914122] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T18:40:33.920126] [DEBUG] [LOCAL ] EVR: Trimmed 50464 records to 33387 (keeping 200 days of data) [2025-10-31T18:40:34.124997] [DEBUG] [LOCAL ] EVR: Primary data saved (33387 records). [2025-10-31T18:40:34.125132] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-31T18:40:34.125201] [INFO ] [MAIN ] Update Progress: 792/2365 symbols completed. EVR took 49.0s. Estimated remaining: 3h 19m 36s. Rate: 7.9 symbols/min [2025-10-31T18:40:34.311122] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:40:34.357707] [DEBUG] [LOCAL ] EW: Loaded 53777 existing records from primary storage. [2025-10-31T18:40:34.358044] [INFO ] [MAIN ] EW: Loaded 53777 existing records. [2025-10-31T18:40:34.531479] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:40:34.531733] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-31T18:40:34.531785] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-31T18:40:34.532732] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-31T18:40:34.532794] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-31T18:40:34.671092] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-31T18:40:34.903405] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:40:35.457684] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-31T18:40:35.612115] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-31T18:40:35.687105] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T18:40:36.257722] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-31T18:40:36.910850] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T18:40:37.057704] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-31T18:40:37.486587] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T18:40:37.493872] [INFO ] [REMOTE ] EVTC: Full fetch complete (38632 records). [2025-10-31T18:40:37.493995] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-31T18:40:37.863347] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-31T18:40:37.865769] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-31T18:40:37.866754] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-31T18:40:37.867440] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-31T18:40:37.867487] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-31T18:40:37.868390] [DEBUG] [LOCAL ] EVTC: Trimmed 38632 records to 27088 (keeping 200 days of data) [2025-10-31T18:40:38.025143] [DEBUG] [LOCAL ] EVTC: Primary data saved (27088 records). [2025-10-31T18:40:38.025270] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-31T18:40:38.025347] [INFO ] [MAIN ] Update Progress: 793/2365 symbols completed. EVTC took 32.2s. Estimated remaining: 3h 19m 21s. Rate: 7.9 symbols/min [2025-10-31T18:40:38.190691] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:40:38.220028] [DEBUG] [LOCAL ] EXG: Loaded 33101 existing records from primary storage. [2025-10-31T18:40:38.220286] [INFO ] [MAIN ] EXG: Loaded 33101 existing records. [2025-10-31T18:40:38.399498] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:40:38.399850] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-31T18:40:38.399911] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-31T18:40:38.400486] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-31T18:40:38.400544] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-31T18:40:38.678246] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-31T18:40:38.803230] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:40:38.821693] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-31T18:40:38.829504] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-31T18:40:39.457713] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-31T18:40:40.080933] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T18:40:40.257683] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-31T18:40:40.441355] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:40:41.057700] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-31T18:40:41.437949] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T18:40:41.857670] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-31T18:40:42.357831] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T18:40:42.657613] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-31T18:40:42.697721] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-31T18:40:43.457668] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-31T18:40:44.169525] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T18:40:44.257672] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-31T18:40:44.476357] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T18:40:45.057682] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-31T18:40:45.719937] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T18:40:45.857730] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-31T18:40:46.197987] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T18:40:46.657711] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-31T18:40:46.998671] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T18:40:47.006781] [INFO ] [REMOTE ] EVTR: Full fetch complete (34883 records). [2025-10-31T18:40:47.006930] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-31T18:40:47.374583] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-31T18:40:47.374690] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-31T18:40:47.375263] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-31T18:40:47.375305] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-31T18:40:47.376051] [DEBUG] [LOCAL ] EVTR: Trimmed 34883 records to 26148 (keeping 200 days of data) [2025-10-31T18:40:47.461306] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-31T18:40:47.532302] [DEBUG] [LOCAL ] EVTR: Primary data saved (26148 records). [2025-10-31T18:40:47.532425] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-31T18:40:47.532501] [INFO ] [MAIN ] Update Progress: 794/2365 symbols completed. EVTR took 32.3s. Estimated remaining: 3h 19m 17s. Rate: 7.9 symbols/min [2025-10-31T18:40:47.697603] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:40:47.744536] [DEBUG] [LOCAL ] EXK: Loaded 53573 existing records from primary storage. [2025-10-31T18:40:47.744883] [INFO ] [MAIN ] EXK: Loaded 53573 existing records. [2025-10-31T18:40:47.931516] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:40:47.931778] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-31T18:40:47.931867] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-31T18:40:47.932845] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-31T18:40:47.932907] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-31T18:40:48.288621] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-31T18:40:48.332592] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:40:48.338760] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-31T18:40:48.483823] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T18:40:49.057685] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-31T18:40:49.857711] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-31T18:40:50.111936] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-31T18:40:50.123756] [INFO ] [REMOTE ] EVTL: Full fetch complete (56104 records). [2025-10-31T18:40:50.123912] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-31T18:40:50.509044] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-31T18:40:50.509208] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-31T18:40:50.510016] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-31T18:40:50.510166] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-31T18:40:50.511680] [DEBUG] [LOCAL ] EVTL: Trimmed 56104 records to 43031 (keeping 200 days of data) [2025-10-31T18:40:50.620015] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-31T18:40:50.657671] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-31T18:40:50.787546] [DEBUG] [LOCAL ] EVTL: Primary data saved (43031 records). [2025-10-31T18:40:50.787823] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-31T18:40:50.787961] [INFO ] [MAIN ] Update Progress: 795/2365 symbols completed. EVTL took 37.3s. Estimated remaining: 3h 19m 1s. Rate: 7.9 symbols/min [2025-10-31T18:40:50.958120] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:40:50.980136] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T18:40:51.009784] [DEBUG] [LOCAL ] EXP: Loaded 29030 existing records from primary storage. [2025-10-31T18:40:51.010056] [INFO ] [MAIN ] EXP: Loaded 29030 existing records. [2025-10-31T18:40:51.183380] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:40:51.183623] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-31T18:40:51.183712] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-31T18:40:51.184267] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-31T18:40:51.184324] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-31T18:40:51.462770] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-31T18:40:51.535440] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:40:52.257666] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-31T18:40:52.292093] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-31T18:40:52.946323] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-31T18:40:53.057677] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-31T18:40:53.299947] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T18:40:53.857623] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-31T18:40:54.038285] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:40:54.657686] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-31T18:40:55.259211] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T18:40:55.457737] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-31T18:40:56.012597] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T18:40:56.257675] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-31T18:40:57.057617] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-31T18:40:57.095132] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-31T18:40:57.188817] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-31T18:40:57.857686] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-31T18:40:58.462616] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-31T18:40:58.657683] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-31T18:40:59.165564] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T18:40:59.457682] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-31T18:40:59.532097] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T18:41:00.257717] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-31T18:41:01.057663] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-31T18:41:01.201891] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-31T18:41:01.528826] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T18:41:01.541042] [INFO ] [REMOTE ] EW: Full fetch complete (77506 records). [2025-10-31T18:41:01.541158] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-31T18:41:01.862870] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-31T18:41:01.938984] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-31T18:41:01.939069] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-31T18:41:01.940023] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-31T18:41:01.940091] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-31T18:41:01.941564] [DEBUG] [LOCAL ] EW: Trimmed 77506 records to 54167 (keeping 200 days of data) [2025-10-31T18:41:02.256755] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T18:41:02.282418] [DEBUG] [LOCAL ] EW: Primary data saved (54167 records). [2025-10-31T18:41:02.282560] [INFO ] [MAIN ] EW: Full history saved. [2025-10-31T18:41:02.282691] [INFO ] [MAIN ] Update Progress: 796/2365 symbols completed. EW took 28.2s. Estimated remaining: 3h 19m 1s. Rate: 7.9 symbols/min [2025-10-31T18:41:02.450614] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:41:02.493300] [DEBUG] [LOCAL ] EXPD: Loaded 47710 existing records from primary storage. [2025-10-31T18:41:02.493639] [INFO ] [MAIN ] EXPD: Loaded 47710 existing records. [2025-10-31T18:41:02.667037] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-31T18:41:02.672083] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:41:02.673218] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-31T18:41:02.673289] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-31T18:41:02.674306] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-31T18:41:02.674382] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-31T18:41:03.042874] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:41:03.457759] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-31T18:41:03.679486] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-31T18:41:03.680552] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T18:41:04.257694] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-31T18:41:04.496574] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T18:41:05.057664] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-31T18:41:05.716330] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-31T18:41:05.857694] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-31T18:41:06.655877] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T18:41:06.664817] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-31T18:41:07.405889] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T18:41:07.413170] [INFO ] [REMOTE ] EXG: Full fetch complete (49212 records). [2025-10-31T18:41:07.413298] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-31T18:41:07.467713] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-31T18:41:07.791126] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-31T18:41:07.791205] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-31T18:41:07.791917] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-31T18:41:07.791980] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-31T18:41:07.792916] [DEBUG] [LOCAL ] EXG: Trimmed 49212 records to 33311 (keeping 200 days of data) [2025-10-31T18:41:07.986058] [DEBUG] [LOCAL ] EXG: Primary data saved (33311 records). [2025-10-31T18:41:07.986194] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-31T18:41:07.986276] [INFO ] [MAIN ] Update Progress: 797/2365 symbols completed. EXG took 30.0s. Estimated remaining: 3h 18m 49s. Rate: 7.9 symbols/min [2025-10-31T18:41:08.122307] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-31T18:41:08.257709] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-31T18:41:09.057618] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-31T18:41:09.255317] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-31T18:41:09.284366] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T18:41:09.857671] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-31T18:41:10.094618] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T18:41:10.657701] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-31T18:41:10.812778] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T18:41:11.457692] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-31T18:41:12.194700] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-31T18:41:12.223849] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T18:41:12.257614] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-31T18:41:13.057637] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-31T18:41:13.857727] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-31T18:41:14.408376] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-31T18:41:14.420707] [INFO ] [REMOTE ] EXK: Full fetch complete (76906 records). [2025-10-31T18:41:14.420853] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-31T18:41:14.831285] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-31T18:41:14.831468] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-31T18:41:14.832399] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-31T18:41:14.832480] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-31T18:41:14.834079] [DEBUG] [LOCAL ] EXK: Trimmed 76906 records to 53962 (keeping 200 days of data) [2025-10-31T18:41:14.947325] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-31T18:41:14.968057] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-31T18:41:15.116436] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T18:41:15.203832] [DEBUG] [LOCAL ] EXK: Primary data saved (53962 records). [2025-10-31T18:41:15.203947] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-31T18:41:15.204611] [INFO ] [MAIN ] Update Progress: 798/2365 symbols completed. EXK took 27.7s. Estimated remaining: 3h 18m 41s. Rate: 7.9 symbols/min [2025-10-31T18:41:15.457706] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-31T18:41:16.262222] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T18:41:16.272715] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-31T18:41:16.638869] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-31T18:41:16.645490] [INFO ] [REMOTE ] EXP: Full fetch complete (42998 records). [2025-10-31T18:41:16.645592] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-31T18:41:17.024331] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-31T18:41:17.024416] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-31T18:41:17.025071] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-31T18:41:17.025133] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-31T18:41:17.026109] [DEBUG] [LOCAL ] EXP: Trimmed 42998 records to 29291 (keeping 200 days of data) [2025-10-31T18:41:17.203900] [DEBUG] [LOCAL ] EXP: Primary data saved (29291 records). [2025-10-31T18:41:17.204035] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-31T18:41:17.204111] [INFO ] [MAIN ] Update Progress: 799/2365 symbols completed. EXP took 26.4s. Estimated remaining: 3h 18m 23s. Rate: 7.9 symbols/min [2025-10-31T18:41:17.594745] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-31T18:41:17.605804] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-31T18:41:18.698083] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T18:41:18.708950] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-31T18:41:19.950285] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T18:41:19.961805] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-31T18:41:21.261773] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-31T18:41:21.271941] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-31T18:41:22.399466] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-31T18:41:22.409495] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-31T18:41:22.970106] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-31T18:41:22.980480] [INFO ] [REMOTE ] EXPD: Full fetch complete (69198 records). [2025-10-31T18:41:22.980597] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-31T18:41:23.379518] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-31T18:41:23.379602] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-31T18:41:23.380453] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-31T18:41:23.380516] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-31T18:41:23.381875] [DEBUG] [LOCAL ] EXPD: Trimmed 69198 records to 48054 (keeping 200 days of data) [2025-10-31T18:41:23.661110] [DEBUG] [LOCAL ] EXPD: Primary data saved (48054 records). [2025-10-31T18:41:23.661229] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-31T18:41:23.661307] [INFO ] [MAIN ] Update Progress: 800/2365 symbols completed. EXPD took 21.4s. Estimated remaining: 3h 18m 13s. Rate: 7.9 symbols/min [2025-10-31T18:41:24.274251] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:41:24.318081] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:41:24.336124] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:41:24.352888] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:41:24.434508] [DEBUG] [LOCAL ] FBIN: Loaded 50513 existing records from primary storage. [2025-10-31T18:41:24.434900] [INFO ] [MAIN ] FBIN: Loaded 50513 existing records. [2025-10-31T18:41:24.565400] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-31T18:41:24.583093] [DEBUG] [LOCAL ] FAF: Loaded 41446 existing records from primary storage. [2025-10-31T18:41:24.581822] [DEBUG] [LOCAL ] EXR: Loaded 45539 existing records from primary storage. [2025-10-31T18:41:24.593818] [INFO ] [MAIN ] FAF: Loaded 41446 existing records. [2025-10-31T18:41:24.588575] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-10-31T18:41:24.684493] [INFO ] [MAIN ] EXR: Loaded 45539 existing records. [2025-10-31T18:41:24.731414] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:41:24.821266] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-31T18:41:24.867801] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-31T18:41:24.957610] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-31T18:41:24.963504] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-31T18:41:25.262004] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:41:25.306894] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:41:25.322591] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-31T18:41:25.360787] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:41:25.380143] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-31T18:41:25.380392] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-31T18:41:25.380252] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-31T18:41:25.397934] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-31T18:41:25.417519] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-31T18:41:25.420631] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-31T18:41:25.420857] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-31T18:41:25.427976] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-31T18:41:25.440300] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-31T18:41:25.506353] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-31T18:41:25.620709] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-31T18:41:26.066886] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:41:26.190893] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-31T18:41:26.492676] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:41:26.506933] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-31T18:41:26.756384] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:41:26.760603] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:41:26.761053] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-31T18:41:26.761382] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-31T18:41:27.701719] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T18:41:27.708885] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-31T18:41:27.823671] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-31T18:41:27.833623] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-31T18:41:28.051132] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T18:41:28.060418] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-31T18:41:28.681058] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T18:41:28.693342] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-31T18:41:28.949253] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T18:41:28.959740] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-31T18:41:29.042425] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-31T18:41:29.053489] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-31T18:41:29.078326] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T18:41:29.087484] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-31T18:41:29.716288] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T18:41:29.857678] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-31T18:41:30.173824] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T18:41:30.216307] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-31T18:41:30.657612] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-31T18:41:30.843888] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-31T18:41:30.880568] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T18:41:31.457667] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-31T18:41:31.964198] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T18:41:32.257668] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-31T18:41:33.057712] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-31T18:41:33.346262] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T18:41:33.426433] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-31T18:41:33.857717] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-31T18:41:34.221258] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T18:41:34.657682] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-31T18:41:34.884336] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T18:41:35.457676] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-31T18:41:35.970014] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T18:41:36.257686] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-31T18:41:36.638829] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T18:41:37.057717] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-31T18:41:37.278753] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T18:41:37.857674] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-31T18:41:38.437664] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T18:41:38.657729] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-31T18:41:39.229164] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T18:41:39.457715] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-31T18:41:40.257672] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-31T18:41:40.622449] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T18:41:40.731839] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-31T18:41:41.057684] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-31T18:41:41.480815] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T18:41:41.857744] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-31T18:41:42.192731] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T18:41:42.657677] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-31T18:41:42.990252] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-31T18:41:43.457692] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-31T18:41:44.257714] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-31T18:41:44.633897] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-31T18:41:44.683754] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T18:41:44.695022] [INFO ] [REMOTE ] FBIN: Full fetch complete (72811 records). [2025-10-31T18:41:44.695145] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-31T18:41:45.059566] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-31T18:41:45.099626] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-31T18:41:45.099782] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-31T18:41:45.100732] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-31T18:41:45.100796] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-31T18:41:45.102202] [DEBUG] [LOCAL ] FBIN: Trimmed 72811 records to 50901 (keeping 200 days of data) [2025-10-31T18:41:45.335070] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-31T18:41:45.437451] [DEBUG] [LOCAL ] FBIN: Primary data saved (50901 records). [2025-10-31T18:41:45.437670] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-31T18:41:45.442617] [INFO ] [MAIN ] Update Progress: 801/2365 symbols completed. FBIN took 21.8s. Estimated remaining: 3h 18m 33s. Rate: 7.9 symbols/min [2025-10-31T18:41:45.616350] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:41:45.642422] [DEBUG] [LOCAL ] FBK: Loaded 27216 existing records from primary storage. [2025-10-31T18:41:45.642799] [INFO ] [MAIN ] FBK: Loaded 27216 existing records. [2025-10-31T18:41:45.823215] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:41:45.823426] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-31T18:41:45.823474] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-31T18:41:45.824312] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-31T18:41:45.824379] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-31T18:41:45.862889] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-31T18:41:46.179803] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:41:46.657639] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-31T18:41:47.133411] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T18:41:47.142585] [INFO ] [REMOTE ] FAF: Full fetch complete (58442 records). [2025-10-31T18:41:47.142735] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-31T18:41:47.473239] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-31T18:41:47.574206] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-31T18:41:47.574505] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-31T18:41:47.575716] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-31T18:41:47.575808] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-31T18:41:47.578831] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-31T18:41:47.591129] [DEBUG] [LOCAL ] FAF: Trimmed 58442 records to 41713 (keeping 200 days of data) [2025-10-31T18:41:47.839947] [DEBUG] [LOCAL ] FAF: Primary data saved (41713 records). [2025-10-31T18:41:47.840069] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-31T18:41:47.840157] [INFO ] [MAIN ] Update Progress: 802/2365 symbols completed. FAF took 24.2s. Estimated remaining: 3h 18m 15s. Rate: 7.9 symbols/min [2025-10-31T18:41:48.022051] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:41:48.053747] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T18:41:48.100808] [DEBUG] [LOCAL ] FBP: Loaded 45731 existing records from primary storage. [2025-10-31T18:41:48.101095] [INFO ] [MAIN ] FBP: Loaded 45731 existing records. [2025-10-31T18:41:48.259172] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-31T18:41:48.283410] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:41:48.284452] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-31T18:41:48.284518] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-31T18:41:48.285387] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-31T18:41:48.285456] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-31T18:41:48.597054] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T18:41:48.687352] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:41:49.057708] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-31T18:41:49.744017] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T18:41:49.857635] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-31T18:41:50.476961] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T18:41:50.657669] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-31T18:41:51.058512] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T18:41:51.457681] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-31T18:41:52.150046] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-31T18:41:52.257720] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-31T18:41:52.634148] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-31T18:41:53.057717] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-31T18:41:53.657140] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T18:41:53.667683] [INFO ] [REMOTE ] EXR: Full fetch complete (66107 records). [2025-10-31T18:41:53.667852] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-31T18:41:53.868744] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-31T18:41:54.057990] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-31T18:41:54.058085] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-31T18:41:54.058990] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-31T18:41:54.059053] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-31T18:41:54.060270] [DEBUG] [LOCAL ] EXR: Trimmed 66107 records to 45913 (keeping 200 days of data) [2025-10-31T18:41:54.306203] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:41:54.385102] [DEBUG] [LOCAL ] EXR: Primary data saved (45913 records). [2025-10-31T18:41:54.385230] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-31T18:41:54.385308] [INFO ] [MAIN ] Update Progress: 803/2365 symbols completed. EXR took 30.7s. Estimated remaining: 3h 18m 5s. Rate: 7.9 symbols/min [2025-10-31T18:41:54.552350] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:41:54.586721] [DEBUG] [LOCAL ] FBRT: Loaded 35046 existing records from primary storage. [2025-10-31T18:41:54.587001] [INFO ] [MAIN ] FBRT: Loaded 35046 existing records. [2025-10-31T18:41:54.662766] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-31T18:41:54.777223] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:41:54.777418] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-31T18:41:54.777464] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-31T18:41:54.777633] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-31T18:41:54.777721] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-31T18:41:55.132399] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:41:55.370047] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T18:41:55.457672] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-31T18:41:56.079928] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-31T18:41:56.257632] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-31T18:41:56.443496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T18:41:57.057638] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-31T18:41:57.857614] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-31T18:41:57.986632] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T18:41:58.027890] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-31T18:41:58.657684] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-31T18:41:58.786939] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-31T18:41:59.457717] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-31T18:42:00.162428] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T18:42:00.257623] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-31T18:42:01.057715] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-31T18:42:01.592381] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.93 seconds). [2025-10-31T18:42:01.616826] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T18:42:01.621867] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-31T18:42:01.622700] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-31T18:42:01.863277] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-31T18:42:02.048758] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-31T18:42:02.048973] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-31T18:42:02.049966] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-31T18:42:02.050168] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-31T18:42:02.051834] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-31T18:42:02.310268] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T18:42:02.434627] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-10-31T18:42:02.434782] [INFO ] [MAIN ] F: Full history saved. [2025-10-31T18:42:02.435492] [INFO ] [MAIN ] Update Progress: 804/2365 symbols completed. F took 38.8s. Estimated remaining: 3h 17m 59s. Rate: 7.9 symbols/min [2025-10-31T18:42:02.599168] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:42:02.613706] [DEBUG] [LOCAL ] FC: Loaded 13920 existing records from primary storage. [2025-10-31T18:42:02.613930] [INFO ] [MAIN ] FC: Loaded 13920 existing records. [2025-10-31T18:42:02.662990] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-31T18:42:02.796591] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:42:02.796861] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-31T18:42:02.796910] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-31T18:42:02.797243] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-31T18:42:02.797301] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-31T18:42:03.145025] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:42:03.463436] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-31T18:42:03.482605] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-31T18:42:03.897623] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T18:42:04.257609] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-31T18:42:04.413343] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T18:42:05.057692] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-31T18:42:05.320871] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-31T18:42:05.647983] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T18:42:05.857734] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-31T18:42:06.657693] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-31T18:42:06.876871] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T18:42:07.457690] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-31T18:42:07.709122] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T18:42:08.257699] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-31T18:42:08.498921] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T18:42:09.057662] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-31T18:42:09.096333] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-31T18:42:09.679575] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T18:42:09.857684] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-31T18:42:10.657691] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-31T18:42:10.884946] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T18:42:11.457727] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-31T18:42:11.763301] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T18:42:11.770434] [INFO ] [REMOTE ] FBK: Full fetch complete (35522 records). [2025-10-31T18:42:11.770527] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-31T18:42:11.771081] [FATAL] [VALIDATOR ] FBK: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:42:11.771164] [FATAL] [MAIN ] FBK: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:42:11.771207] [WARN ] [MAIN ] FBK: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:42:11.771245] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-31T18:42:11.771300] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-10-31T18:42:11.771334] [INFO ] [LOCAL ] FBK: Starting deletion of derivative data. [2025-10-31T18:42:11.771497] [DEBUG] [LOCAL ] FBK: Deleted derivative data file. [2025-10-31T18:42:11.771583] [INFO ] [MAIN ] Update Progress: 805/2365 symbols completed. FBK took 26.3s. Estimated remaining: 3h 17m 54s. Rate: 7.9 symbols/min [2025-10-31T18:42:11.959771] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:42:11.995395] [DEBUG] [LOCAL ] FCF: Loaded 38840 existing records from primary storage. [2025-10-31T18:42:11.995687] [INFO ] [MAIN ] FCF: Loaded 38840 existing records. [2025-10-31T18:42:12.173737] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:42:12.173927] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-31T18:42:12.173972] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-31T18:42:12.174611] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-31T18:42:12.174703] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-31T18:42:12.265289] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-31T18:42:12.538462] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:42:12.558706] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T18:42:13.057670] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-31T18:42:13.787405] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-31T18:42:13.857624] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-31T18:42:14.205526] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T18:42:14.657712] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-31T18:42:14.864596] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T18:42:15.457715] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-31T18:42:15.538463] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-31T18:42:16.257672] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-31T18:42:16.423977] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T18:42:17.057621] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-31T18:42:17.270016] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T18:42:17.857688] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-31T18:42:18.124440] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T18:42:18.657677] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-31T18:42:19.089464] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T18:42:19.098351] [INFO ] [REMOTE ] FBRT: Full fetch complete (49721 records). [2025-10-31T18:42:19.098454] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-31T18:42:19.250675] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T18:42:19.460930] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-31T18:42:19.503608] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-31T18:42:19.503726] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-31T18:42:19.504452] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-31T18:42:19.504508] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-31T18:42:19.505735] [DEBUG] [LOCAL ] FBRT: Trimmed 49721 records to 35288 (keeping 200 days of data) [2025-10-31T18:42:19.720670] [DEBUG] [LOCAL ] FBRT: Primary data saved (35288 records). [2025-10-31T18:42:19.720809] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-31T18:42:19.721545] [INFO ] [MAIN ] Update Progress: 806/2365 symbols completed. FBRT took 25.3s. Estimated remaining: 3h 17m 47s. Rate: 7.9 symbols/min [2025-10-31T18:42:19.889390] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:42:19.915323] [DEBUG] [LOCAL ] FCN: Loaded 26029 existing records from primary storage. [2025-10-31T18:42:19.915584] [INFO ] [MAIN ] FCN: Loaded 26029 existing records. [2025-10-31T18:42:20.123684] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:42:20.123902] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-31T18:42:20.123969] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-31T18:42:20.124541] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-31T18:42:20.124600] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-31T18:42:20.263257] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-31T18:42:20.480842] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:42:20.790596] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T18:42:21.057633] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-31T18:42:21.493350] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T18:42:21.857732] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-31T18:42:22.155823] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T18:42:22.657666] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-31T18:42:23.106859] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T18:42:23.457727] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-31T18:42:23.817353] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T18:42:24.262428] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-31T18:42:24.264677] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T18:42:24.746121] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-31T18:42:25.057739] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-31T18:42:25.800435] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T18:42:25.857637] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-31T18:42:26.657752] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-31T18:42:26.786727] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T18:42:27.457719] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-31T18:42:27.675434] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T18:42:28.257752] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-31T18:42:28.537156] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T18:42:28.907072] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-31T18:42:29.057672] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-31T18:42:29.857686] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-31T18:42:30.116984] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T18:42:30.657630] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-31T18:42:30.766174] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T18:42:31.457697] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-31T18:42:32.072633] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-31T18:42:32.258990] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-31T18:42:32.262044] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T18:42:32.273412] [INFO ] [REMOTE ] FBP: Full fetch complete (66819 records). [2025-10-31T18:42:32.273563] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-31T18:42:32.665827] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-31T18:42:32.665915] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-31T18:42:32.666762] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-31T18:42:32.666843] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-31T18:42:32.668235] [DEBUG] [LOCAL ] FBP: Trimmed 66819 records to 46073 (keeping 200 days of data) [2025-10-31T18:42:32.939783] [DEBUG] [LOCAL ] FBP: Primary data saved (46073 records). [2025-10-31T18:42:32.939926] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-31T18:42:32.940021] [INFO ] [MAIN ] Update Progress: 807/2365 symbols completed. FBP took 45.1s. Estimated remaining: 3h 17m 51s. Rate: 7.9 symbols/min [2025-10-31T18:42:33.062758] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-31T18:42:33.109793] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:42:33.143450] [DEBUG] [LOCAL ] FCPT: Loaded 36785 existing records from primary storage. [2025-10-31T18:42:33.143751] [INFO ] [MAIN ] FCPT: Loaded 36785 existing records. [2025-10-31T18:42:33.324512] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:42:33.324773] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-31T18:42:33.324834] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-31T18:42:33.330720] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-31T18:42:33.339555] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-31T18:42:33.372251] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T18:42:33.699205] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:42:33.854639] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T18:42:33.857639] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-31T18:42:33.859114] [INFO ] [REMOTE ] FC: Full fetch complete (21533 records). [2025-10-31T18:42:33.859181] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-31T18:42:34.216806] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-31T18:42:34.216880] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-31T18:42:34.217341] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-31T18:42:34.217397] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-31T18:42:34.218019] [DEBUG] [LOCAL ] FC: Trimmed 21533 records to 13996 (keeping 200 days of data) [2025-10-31T18:42:34.298573] [DEBUG] [LOCAL ] FC: Primary data saved (13996 records). [2025-10-31T18:42:34.298761] [INFO ] [MAIN ] FC: Full history saved. [2025-10-31T18:42:34.298852] [INFO ] [MAIN ] Update Progress: 808/2365 symbols completed. FC took 31.9s. Estimated remaining: 3h 17m 31s. Rate: 7.9 symbols/min [2025-10-31T18:42:34.463402] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:42:34.463575] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-31T18:42:34.463614] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-31T18:42:34.463743] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-31T18:42:34.463783] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-31T18:42:34.463823] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-31T18:42:34.463854] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-31T18:42:34.664559] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-31T18:42:34.812079] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:42:34.943479] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T18:42:35.457672] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-31T18:42:35.910493] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-31T18:42:35.937989] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T18:42:36.257721] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-31T18:42:37.025719] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-31T18:42:37.057621] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-31T18:42:37.857712] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-31T18:42:37.918977] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T18:42:38.129778] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-31T18:42:38.657676] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-31T18:42:39.457723] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-31T18:42:39.672310] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T18:42:40.257687] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-31T18:42:40.415047] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T18:42:41.057723] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-31T18:42:41.337419] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T18:42:41.344158] [INFO ] [REMOTE ] FCN: Full fetch complete (37078 records). [2025-10-31T18:42:41.344275] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-31T18:42:41.742446] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-31T18:42:41.742554] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-31T18:42:41.743173] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-31T18:42:41.743235] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-31T18:42:41.744124] [DEBUG] [LOCAL ] FCN: Trimmed 37078 records to 26298 (keeping 200 days of data) [2025-10-31T18:42:41.857703] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-31T18:42:41.904876] [DEBUG] [LOCAL ] FCN: Primary data saved (26298 records). [2025-10-31T18:42:41.905117] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-31T18:42:41.905209] [INFO ] [MAIN ] Update Progress: 809/2365 symbols completed. FCN took 22.2s. Estimated remaining: 3h 17m 23s. Rate: 7.9 symbols/min [2025-10-31T18:42:42.074745] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:42:42.099330] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T18:42:42.118495] [DEBUG] [LOCAL ] FCT: Loaded 14574 existing records from primary storage. [2025-10-31T18:42:42.118790] [INFO ] [MAIN ] FCT: Loaded 14574 existing records. [2025-10-31T18:42:42.195686] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-31T18:42:42.301186] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:42:42.301424] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-31T18:42:42.301477] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-31T18:42:42.301847] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-31T18:42:42.301904] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-31T18:42:42.657766] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-31T18:42:42.660356] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:42:43.457673] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-31T18:42:43.764465] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-31T18:42:43.770639] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T18:42:44.257624] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-31T18:42:45.057701] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-31T18:42:45.405688] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T18:42:45.857665] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-31T18:42:46.012144] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-31T18:42:46.657622] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-31T18:42:46.680080] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T18:42:47.457622] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-31T18:42:47.568678] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T18:42:48.257672] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-31T18:42:48.488380] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T18:42:48.731944] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-31T18:42:49.057663] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-31T18:42:49.766676] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T18:42:49.857690] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-31T18:42:50.657701] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-31T18:42:50.843694] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T18:42:51.457688] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-31T18:42:51.812118] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-31T18:42:51.821593] [INFO ] [REMOTE ] FCF: Full fetch complete (57909 records). [2025-10-31T18:42:51.821743] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-31T18:42:52.208717] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-31T18:42:52.208834] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-31T18:42:52.209672] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-31T18:42:52.214919] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-31T18:42:52.219789] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T18:42:52.224386] [DEBUG] [LOCAL ] FCF: Trimmed 57909 records to 39159 (keeping 200 days of data) [2025-10-31T18:42:52.277044] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-31T18:42:52.454069] [DEBUG] [LOCAL ] FCF: Primary data saved (39159 records). [2025-10-31T18:42:52.454227] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-31T18:42:52.454318] [INFO ] [MAIN ] Update Progress: 810/2365 symbols completed. FCF took 40.7s. Estimated remaining: 3h 17m 21s. Rate: 7.9 symbols/min [2025-10-31T18:42:52.622107] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:42:52.668194] [DEBUG] [LOCAL ] FCX: Loaded 54092 existing records from primary storage. [2025-10-31T18:42:52.668487] [INFO ] [MAIN ] FCX: Loaded 54092 existing records. [2025-10-31T18:42:52.847038] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:42:52.847304] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-31T18:42:52.847388] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-31T18:42:52.848474] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-31T18:42:52.848536] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-31T18:42:52.960686] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T18:42:53.062823] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-31T18:42:53.224620] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:42:53.444979] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-31T18:42:53.857668] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-31T18:42:54.123234] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-31T18:42:54.657687] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-31T18:42:55.457725] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-31T18:42:56.259867] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-31T18:42:56.262984] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-31T18:42:56.491882] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-31T18:42:56.582770] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-31T18:42:57.057723] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-31T18:42:57.344334] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-31T18:42:57.857678] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-31T18:42:58.130836] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-31T18:42:58.657713] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-31T18:42:59.457682] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-31T18:42:59.796684] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-31T18:42:59.797453] [INFO ] [REMOTE ] FCRX: Full fetch complete (1618 records). [2025-10-31T18:42:59.797524] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-31T18:42:59.992937] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-31T18:42:59.993210] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:42:59.993424] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:42:59.993537] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-31T18:42:59.993603] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-31T18:42:59.993665] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-31T18:42:59.993735] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-31T18:42:59.993793] [INFO ] [MAIN ] Update Progress: 811/2365 symbols completed. FCRX took 25.7s. Estimated remaining: 3h 17m 14s. Rate: 7.9 symbols/min [2025-10-31T18:43:00.180000] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:43:00.209287] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-31T18:43:00.240981] [DEBUG] [LOCAL ] FDP: Loaded 29681 existing records from primary storage. [2025-10-31T18:43:00.241284] [INFO ] [MAIN ] FDP: Loaded 29681 existing records. [2025-10-31T18:43:00.262903] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-31T18:43:00.420758] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:43:00.420953] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-31T18:43:00.420999] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-31T18:43:00.421511] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-31T18:43:00.421566] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-31T18:43:00.766074] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:43:01.057639] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-31T18:43:01.857688] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-31T18:43:02.205597] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T18:43:02.242331] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-31T18:43:02.657674] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-31T18:43:02.907396] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T18:43:03.457727] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-31T18:43:04.145336] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T18:43:04.257667] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-31T18:43:04.375990] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T18:43:05.057746] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-31T18:43:05.687566] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T18:43:05.780525] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T18:43:05.857630] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-31T18:43:06.447100] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-31T18:43:06.657675] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-31T18:43:07.264446] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-31T18:43:07.457665] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-31T18:43:08.081609] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-31T18:43:08.257679] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-31T18:43:09.042993] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T18:43:09.047282] [INFO ] [REMOTE ] FCT: Full fetch complete (21128 records). [2025-10-31T18:43:09.047379] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-31T18:43:09.062843] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-31T18:43:09.419223] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-31T18:43:09.419330] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-31T18:43:09.419913] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-31T18:43:09.419981] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-31T18:43:09.420574] [DEBUG] [LOCAL ] FCT: Trimmed 21128 records to 14720 (keeping 200 days of data) [2025-10-31T18:43:09.505981] [DEBUG] [LOCAL ] FCT: Primary data saved (14720 records). [2025-10-31T18:43:09.506113] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-31T18:43:09.506189] [INFO ] [MAIN ] Update Progress: 812/2365 symbols completed. FCT took 27.6s. Estimated remaining: 3h 17m 10s. Rate: 7.9 symbols/min [2025-10-31T18:43:09.685451] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:43:09.711636] [DEBUG] [LOCAL ] FDS: Loaded 28767 existing records from primary storage. [2025-10-31T18:43:09.711915] [INFO ] [MAIN ] FDS: Loaded 28767 existing records. [2025-10-31T18:43:09.863460] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-31T18:43:09.904626] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:43:09.904901] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-31T18:43:09.904949] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-31T18:43:09.905592] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-31T18:43:09.905688] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-31T18:43:10.253795] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:43:10.657626] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-31T18:43:10.833137] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-31T18:43:10.881440] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T18:43:11.457628] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-31T18:43:11.646149] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-31T18:43:12.257631] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-31T18:43:13.057728] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-31T18:43:13.121541] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-31T18:43:13.439422] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-31T18:43:13.857699] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-31T18:43:14.056893] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T18:43:14.657626] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-31T18:43:15.393046] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-31T18:43:15.449937] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T18:43:15.457601] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-31T18:43:16.257620] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-31T18:43:16.302211] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T18:43:17.057697] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-31T18:43:17.167819] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T18:43:17.857728] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-31T18:43:18.378739] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T18:43:18.387327] [INFO ] [REMOTE ] FCPT: Full fetch complete (53861 records). [2025-10-31T18:43:18.387424] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-31T18:43:18.662883] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-31T18:43:18.767600] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-31T18:43:18.767829] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-31T18:43:18.768700] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-31T18:43:18.768787] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-31T18:43:18.775306] [DEBUG] [LOCAL ] FCPT: Trimmed 53861 records to 37087 (keeping 200 days of data) [2025-10-31T18:43:18.785521] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-31T18:43:19.011742] [DEBUG] [LOCAL ] FCPT: Primary data saved (37087 records). [2025-10-31T18:43:19.011883] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-31T18:43:19.011959] [INFO ] [MAIN ] Update Progress: 813/2365 symbols completed. FCPT took 46.1s. Estimated remaining: 3h 17m 6s. Rate: 7.9 symbols/min [2025-10-31T18:43:19.181237] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:43:19.228133] [DEBUG] [LOCAL ] FDX: Loaded 51324 existing records from primary storage. [2025-10-31T18:43:19.228432] [INFO ] [MAIN ] FDX: Loaded 51324 existing records. [2025-10-31T18:43:19.403727] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:43:19.403922] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-31T18:43:19.403967] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-31T18:43:19.404595] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-31T18:43:19.404681] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-31T18:43:19.468339] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-31T18:43:19.789432] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:43:20.257625] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-31T18:43:20.375172] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-31T18:43:20.376250] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T18:43:21.044491] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-31T18:43:21.057604] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-31T18:43:21.861165] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-31T18:43:21.863221] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-31T18:43:22.657667] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-31T18:43:22.881476] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T18:43:23.297175] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T18:43:23.309617] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-31T18:43:23.309793] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-31T18:43:23.480877] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-31T18:43:23.718682] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-31T18:43:23.718767] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-31T18:43:23.719677] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-31T18:43:23.719740] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-31T18:43:23.721322] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 54482 (keeping 200 days of data) [2025-10-31T18:43:24.065566] [DEBUG] [LOCAL ] FCX: Primary data saved (54482 records). [2025-10-31T18:43:24.065749] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-31T18:43:24.065844] [INFO ] [MAIN ] Update Progress: 814/2365 symbols completed. FCX took 31.6s. Estimated remaining: 3h 16m 53s. Rate: 7.9 symbols/min [2025-10-31T18:43:24.238489] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:43:24.265581] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-31T18:43:24.288038] [DEBUG] [LOCAL ] FE: Loaded 53820 existing records from primary storage. [2025-10-31T18:43:24.288346] [INFO ] [MAIN ] FE: Loaded 53820 existing records. [2025-10-31T18:43:24.468490] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:43:24.468727] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-31T18:43:24.468785] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-31T18:43:24.469003] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-31T18:43:24.469060] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-31T18:43:24.849953] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:43:24.851417] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T18:43:25.057618] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-31T18:43:25.104786] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-31T18:43:25.857682] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-31T18:43:26.537414] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-31T18:43:26.657671] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-31T18:43:27.163203] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T18:43:27.457625] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-31T18:43:27.639220] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T18:43:28.257673] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-31T18:43:28.718162] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T18:43:29.057665] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-31T18:43:29.293842] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T18:43:29.300215] [INFO ] [REMOTE ] FDP: Full fetch complete (43038 records). [2025-10-31T18:43:29.300316] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-31T18:43:29.678916] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-31T18:43:29.678993] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-31T18:43:29.679712] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-31T18:43:29.679782] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-31T18:43:29.680910] [DEBUG] [LOCAL ] FDP: Trimmed 43038 records to 29943 (keeping 200 days of data) [2025-10-31T18:43:29.861418] [DEBUG] [LOCAL ] FDP: Primary data saved (29943 records). [2025-10-31T18:43:29.861729] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-31T18:43:29.862670] [INFO ] [MAIN ] Update Progress: 815/2365 symbols completed. FDP took 29.9s. Estimated remaining: 3h 16m 42s. Rate: 7.9 symbols/min [2025-10-31T18:43:29.857633] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-31T18:43:30.043698] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:43:30.054039] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-31T18:43:30.054619] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T18:43:30.054744] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-31T18:43:30.060585] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-31T18:43:30.061106] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-31T18:43:30.061176] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-31T18:43:30.061221] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-31T18:43:30.414552] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:43:30.657683] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-31T18:43:31.043923] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-31T18:43:31.252207] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-31T18:43:31.457691] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-31T18:43:32.257674] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-31T18:43:32.988327] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-31T18:43:33.057665] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-31T18:43:33.857704] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-31T18:43:34.198060] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T18:43:34.292699] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-31T18:43:34.657708] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-31T18:43:35.181861] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T18:43:35.457709] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-31T18:43:36.119831] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T18:43:36.257695] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-31T18:43:36.988748] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-31T18:43:36.998775] [INFO ] [REMOTE ] FDS: Full fetch complete (39945 records). [2025-10-31T18:43:36.998915] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-31T18:43:36.999734] [FATAL] [VALIDATOR ] FDS: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:43:36.999879] [FATAL] [MAIN ] FDS: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:43:36.999945] [WARN ] [MAIN ] FDS: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:43:37.000027] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-31T18:43:37.000115] [DEBUG] [LOCAL ] FDS: No primary data file found to delete. [2025-10-31T18:43:37.000158] [INFO ] [LOCAL ] FDS: Starting deletion of derivative data. [2025-10-31T18:43:37.000471] [DEBUG] [LOCAL ] FDS: Deleted derivative data file. [2025-10-31T18:43:37.000593] [INFO ] [MAIN ] Update Progress: 816/2365 symbols completed. FDS took 27.5s. Estimated remaining: 3h 16m 33s. Rate: 7.9 symbols/min [2025-10-31T18:43:37.069745] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-31T18:43:37.184542] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:43:37.236785] [DEBUG] [LOCAL ] FERG: Loaded 48834 existing records from primary storage. [2025-10-31T18:43:37.237199] [INFO ] [MAIN ] FERG: Loaded 48834 existing records. [2025-10-31T18:43:37.430216] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:43:37.430758] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-31T18:43:37.430880] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-31T18:43:37.431452] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-31T18:43:37.431519] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-31T18:43:37.836152] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-31T18:43:37.861692] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-31T18:43:37.887721] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:43:38.236899] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-31T18:43:38.544074] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-31T18:43:38.657711] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-31T18:43:38.892517] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-31T18:43:39.457686] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-31T18:43:39.787285] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-31T18:43:40.257685] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-31T18:43:41.057731] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-31T18:43:41.604351] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T18:43:41.857709] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-31T18:43:42.514089] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-31T18:43:42.657630] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-31T18:43:42.957633] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T18:43:43.457689] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-31T18:43:44.208752] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T18:43:44.257616] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-31T18:43:44.843508] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T18:43:45.057704] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-31T18:43:45.639340] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-31T18:43:45.857623] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-31T18:43:46.483517] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-31T18:43:46.657637] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-31T18:43:47.457630] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-31T18:43:47.571314] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-31T18:43:48.062969] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T18:43:48.257733] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-31T18:43:48.775238] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T18:43:49.057607] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-31T18:43:49.748261] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T18:43:49.759165] [INFO ] [REMOTE ] FDX: Full fetch complete (74074 records). [2025-10-31T18:43:49.759281] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-31T18:43:49.859130] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-31T18:43:50.143589] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-31T18:43:50.143706] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-31T18:43:50.144555] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-31T18:43:50.144596] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-31T18:43:50.146069] [DEBUG] [LOCAL ] FDX: Trimmed 74074 records to 51699 (keeping 200 days of data) [2025-10-31T18:43:50.366997] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-31T18:43:50.477201] [DEBUG] [LOCAL ] FDX: Primary data saved (51699 records). [2025-10-31T18:43:50.477419] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-31T18:43:50.477596] [INFO ] [MAIN ] Update Progress: 817/2365 symbols completed. FDX took 31.5s. Estimated remaining: 3h 16m 37s. Rate: 7.9 symbols/min [2025-10-31T18:43:50.615133] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-31T18:43:50.670620] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-31T18:43:50.697535] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:43:50.712966] [DEBUG] [LOCAL ] FET: Loaded 13130 existing records from primary storage. [2025-10-31T18:43:50.713176] [INFO ] [MAIN ] FET: Loaded 13130 existing records. [2025-10-31T18:43:50.907109] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:43:50.907312] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-31T18:43:50.907358] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-31T18:43:50.907882] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-31T18:43:50.907943] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-31T18:43:51.264633] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:43:51.457611] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-31T18:43:51.937367] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T18:43:52.203049] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T18:43:52.257712] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-31T18:43:53.057705] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-31T18:43:53.608444] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-31T18:43:53.724086] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T18:43:53.857623] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-31T18:43:54.189960] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-31T18:43:54.657736] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-31T18:43:55.457724] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-31T18:43:55.718817] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-31T18:43:55.944282] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T18:43:56.257671] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-31T18:43:56.827580] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T18:43:57.057637] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-31T18:43:57.626849] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-31T18:43:57.639257] [INFO ] [REMOTE ] FE: Full fetch complete (77502 records). [2025-10-31T18:43:57.639384] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-31T18:43:57.864500] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-31T18:43:58.040210] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-31T18:43:58.040325] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-31T18:43:58.041259] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-31T18:43:58.041326] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-31T18:43:58.042701] [DEBUG] [LOCAL ] FE: Trimmed 77502 records to 54209 (keeping 200 days of data) [2025-10-31T18:43:58.355581] [DEBUG] [LOCAL ] FE: Primary data saved (54209 records). [2025-10-31T18:43:58.355743] [INFO ] [MAIN ] FE: Full history saved. [2025-10-31T18:43:58.355826] [INFO ] [MAIN ] Update Progress: 818/2365 symbols completed. FE took 34.3s. Estimated remaining: 3h 16m 30s. Rate: 7.9 symbols/min [2025-10-31T18:43:58.521075] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:43:58.521198] [DEBUG] [LOCAL ] FF: No existing data file found in primary storage. [2025-10-31T18:43:58.521234] [WARN ] [MAIN ] FF: No existing data found, performing full refresh instead. [2025-10-31T18:43:58.521337] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-31T18:43:58.521378] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-31T18:43:58.521418] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-10-31T18:43:58.521450] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-31T18:43:58.662725] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-31T18:43:58.873392] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:43:58.980026] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-31T18:43:59.236266] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T18:43:59.457675] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-31T18:44:00.257677] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-31T18:44:01.057629] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-31T18:44:01.161106] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-31T18:44:01.212223] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-31T18:44:01.857674] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-31T18:44:02.657685] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-31T18:44:02.778839] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-31T18:44:03.266431] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-31T18:44:03.457611] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-31T18:44:03.936118] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-31T18:44:03.990668] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T18:44:04.257672] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-31T18:44:04.644167] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-31T18:44:05.057684] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-31T18:44:05.522185] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-31T18:44:05.523063] [INFO ] [REMOTE ] FENG: Full fetch complete (2250 records). [2025-10-31T18:44:05.523132] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-31T18:44:05.523466] [FATAL] [VALIDATOR ] FENG: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:44:05.523547] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:44:05.523589] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:44:05.523629] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-31T18:44:05.523758] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-31T18:44:05.523812] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-31T18:44:05.523867] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-31T18:44:05.523938] [INFO ] [MAIN ] Update Progress: 819/2365 symbols completed. FENG took 35.7s. Estimated remaining: 3h 16m 21s. Rate: 7.9 symbols/min [2025-10-31T18:44:05.694108] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:44:05.702535] [DEBUG] [LOCAL ] FFA: Loaded 5274 existing records from primary storage. [2025-10-31T18:44:05.702790] [INFO ] [MAIN ] FFA: Loaded 5274 existing records. [2025-10-31T18:44:05.868343] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-31T18:44:05.881501] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:44:05.882449] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-31T18:44:05.882522] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-31T18:44:05.882682] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-31T18:44:05.882740] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-31T18:44:06.229459] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:44:06.657624] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-31T18:44:07.457620] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-31T18:44:07.525704] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-31T18:44:07.537187] [INFO ] [REMOTE ] FERG: Full fetch complete (71077 records). [2025-10-31T18:44:07.537401] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-31T18:44:07.637190] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:44:07.931196] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-31T18:44:07.931272] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-31T18:44:07.932135] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-31T18:44:07.932198] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-31T18:44:07.933498] [DEBUG] [LOCAL ] FERG: Trimmed 71077 records to 49195 (keeping 200 days of data) [2025-10-31T18:44:08.231677] [DEBUG] [LOCAL ] FERG: Primary data saved (49195 records). [2025-10-31T18:44:08.231799] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-31T18:44:08.232435] [INFO ] [MAIN ] Update Progress: 820/2365 symbols completed. FERG took 31.2s. Estimated remaining: 3h 16m 4s. Rate: 7.9 symbols/min [2025-10-31T18:44:08.262781] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-31T18:44:08.361945] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-31T18:44:08.422935] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:44:08.423062] [DEBUG] [LOCAL ] FFC: No existing data file found in primary storage. [2025-10-31T18:44:08.423097] [WARN ] [MAIN ] FFC: No existing data found, performing full refresh instead. [2025-10-31T18:44:08.423205] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-31T18:44:08.423245] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-31T18:44:08.423286] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-10-31T18:44:08.423318] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-31T18:44:08.735771] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-31T18:44:08.791532] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:44:09.057767] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-31T18:44:09.859673] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-31T18:44:09.861347] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-31T18:44:10.657628] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-31T18:44:10.837619] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-31T18:44:11.215304] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-31T18:44:11.457686] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-31T18:44:11.897983] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-31T18:44:12.257720] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-31T18:44:12.902582] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-31T18:44:13.057638] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-31T18:44:13.775174] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-31T18:44:13.857621] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-31T18:44:14.587857] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-31T18:44:14.657614] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-31T18:44:15.336829] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T18:44:15.457617] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-31T18:44:16.124198] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T18:44:16.257624] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-31T18:44:16.925295] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-31T18:44:17.057673] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-31T18:44:17.747848] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-31T18:44:17.857630] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-31T18:44:18.566969] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-31T18:44:18.657695] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-31T18:44:19.457615] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-31T18:44:19.482812] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T18:44:20.257671] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-31T18:44:20.643077] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T18:44:20.872135] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-31T18:44:21.057620] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-31T18:44:21.489685] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T18:44:21.857665] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-31T18:44:22.657626] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-31T18:44:22.678829] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-31T18:44:22.682993] [INFO ] [REMOTE ] FET: Full fetch complete (18873 records). [2025-10-31T18:44:22.683084] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-31T18:44:23.117045] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-31T18:44:23.117171] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-31T18:44:23.117986] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-31T18:44:23.118067] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-31T18:44:23.119216] [DEBUG] [LOCAL ] FET: Trimmed 18873 records to 13323 (keeping 200 days of data) [2025-10-31T18:44:23.215379] [DEBUG] [LOCAL ] FET: Primary data saved (13323 records). [2025-10-31T18:44:23.215552] [INFO ] [MAIN ] FET: Full history saved. [2025-10-31T18:44:23.215681] [INFO ] [MAIN ] Update Progress: 821/2365 symbols completed. FET took 32.7s. Estimated remaining: 3h 16m 11s. Rate: 7.9 symbols/min [2025-10-31T18:44:23.460303] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-31T18:44:23.486150] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:44:23.530559] [DEBUG] [LOCAL ] FFWM: Loaded 35801 existing records from primary storage. [2025-10-31T18:44:23.531023] [INFO ] [MAIN ] FFWM: Loaded 35801 existing records. [2025-10-31T18:44:23.754186] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T18:44:23.809093] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:44:23.809344] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-31T18:44:23.809413] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-31T18:44:23.809872] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-31T18:44:23.809945] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-31T18:44:23.989340] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T18:44:24.221185] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:44:24.257607] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-31T18:44:25.057675] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-31T18:44:25.241051] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:44:25.857631] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-31T18:44:25.895967] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T18:44:26.657618] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-31T18:44:26.764810] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T18:44:27.457675] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-31T18:44:27.492671] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T18:44:27.863123] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T18:44:28.257697] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-31T18:44:29.036533] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-31T18:44:29.057611] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-31T18:44:29.710961] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-31T18:44:29.857742] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-31T18:44:30.644224] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T18:44:30.648561] [INFO ] [REMOTE ] FFC: Full fetch complete (24344 records). [2025-10-31T18:44:30.648712] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-31T18:44:30.649262] [FATAL] [VALIDATOR ] FFC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:44:30.649352] [FATAL] [MAIN ] FFC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:44:30.649416] [WARN ] [MAIN ] FFC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:44:30.649501] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-31T18:44:30.649585] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-10-31T18:44:30.649698] [INFO ] [LOCAL ] FFC: Starting deletion of derivative data. [2025-10-31T18:44:30.649773] [DEBUG] [LOCAL ] FFC: No derivative data file found to delete. [2025-10-31T18:44:30.649855] [INFO ] [MAIN ] Update Progress: 822/2365 symbols completed. FFC took 22.4s. Estimated remaining: 3h 16m 3s. Rate: 7.9 symbols/min [2025-10-31T18:44:30.662963] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-31T18:44:30.860552] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:44:30.882903] [DEBUG] [LOCAL ] FG: Loaded 20510 existing records from primary storage. [2025-10-31T18:44:30.883178] [INFO ] [MAIN ] FG: Loaded 20510 existing records. [2025-10-31T18:44:31.061501] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:44:31.061766] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-31T18:44:31.061818] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-31T18:44:31.062045] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-31T18:44:31.062101] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-31T18:44:31.358125] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T18:44:31.436774] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:44:31.457637] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-31T18:44:32.045318] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-31T18:44:32.257731] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-31T18:44:32.904249] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-31T18:44:33.057637] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-31T18:44:33.621228] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-31T18:44:33.857691] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-31T18:44:34.657700] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-31T18:44:34.888816] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T18:44:35.457622] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-31T18:44:35.480551] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T18:44:36.076251] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T18:44:36.078463] [INFO ] [REMOTE ] FFA: Full fetch complete (8649 records). [2025-10-31T18:44:36.078537] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-31T18:44:36.266606] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-31T18:44:36.435419] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-31T18:44:36.435495] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-31T18:44:36.435725] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-31T18:44:36.435784] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-31T18:44:36.436155] [DEBUG] [LOCAL ] FFA: Trimmed 8649 records to 5309 (keeping 200 days of data) [2025-10-31T18:44:36.467027] [DEBUG] [LOCAL ] FFA: Primary data saved (5309 records). [2025-10-31T18:44:36.467102] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-31T18:44:36.467172] [INFO ] [MAIN ] Update Progress: 823/2365 symbols completed. FFA took 30.9s. Estimated remaining: 3h 15m 52s. Rate: 7.9 symbols/min [2025-10-31T18:44:36.633822] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:44:36.639137] [DEBUG] [LOCAL ] FGN: Loaded 3461 existing records from primary storage. [2025-10-31T18:44:36.639288] [INFO ] [MAIN ] FGN: Loaded 3461 existing records. [2025-10-31T18:44:36.815852] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:44:36.816036] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-31T18:44:36.816082] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-31T18:44:36.816204] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-31T18:44:36.816243] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-31T18:44:37.063093] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-31T18:44:37.167797] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:44:37.491885] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T18:44:37.857613] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-31T18:44:38.001074] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-31T18:44:38.465340] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-31T18:44:38.657677] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-31T18:44:38.977040] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T18:44:39.457704] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-31T18:44:40.246410] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T18:44:40.257601] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-31T18:44:41.057627] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-31T18:44:41.107344] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T18:44:41.112443] [INFO ] [REMOTE ] FF: Full fetch complete (35975 records). [2025-10-31T18:44:41.112538] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-31T18:44:41.412293] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-31T18:44:41.490169] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-31T18:44:41.490244] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-31T18:44:41.490868] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-31T18:44:41.490931] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-31T18:44:41.491698] [DEBUG] [LOCAL ] FF: Trimmed 35975 records to 23206 (keeping 200 days of data) [2025-10-31T18:44:41.618775] [DEBUG] [LOCAL ] FF: Primary data saved (23206 records). [2025-10-31T18:44:41.618892] [INFO ] [MAIN ] FF: Full history saved. [2025-10-31T18:44:41.618959] [INFO ] [MAIN ] Update Progress: 824/2365 symbols completed. FF took 43.3s. Estimated remaining: 3h 15m 39s. Rate: 7.9 symbols/min [2025-10-31T18:44:41.784950] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:44:41.785096] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-31T18:44:41.785133] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-31T18:44:41.785265] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-31T18:44:41.785320] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-31T18:44:41.785365] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-31T18:44:41.785398] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-31T18:44:41.862790] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-31T18:44:42.143984] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:44:42.657629] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-31T18:44:42.673970] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-31T18:44:43.055799] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-31T18:44:43.457687] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-31T18:44:43.844028] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T18:44:44.257675] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-31T18:44:45.046882] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-31T18:44:45.057599] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-31T18:44:45.857628] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-31T18:44:45.964055] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T18:44:46.657616] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-31T18:44:46.691962] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T18:44:47.406938] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T18:44:47.457694] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-31T18:44:47.916504] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-31T18:44:48.257624] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-31T18:44:48.635917] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-31T18:44:49.057716] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-31T18:44:49.537401] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-31T18:44:49.857698] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-31T18:44:50.501164] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-31T18:44:50.657679] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-31T18:44:51.054215] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-31T18:44:51.457795] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-31T18:44:51.879193] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-31T18:44:52.257751] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-31T18:44:52.996098] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T18:44:53.057669] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-31T18:44:53.857729] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-31T18:44:54.241399] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-31T18:44:54.360095] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:44:54.657677] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-31T18:44:55.342614] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T18:44:55.457671] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-31T18:44:56.190048] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-31T18:44:56.257670] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-31T18:44:56.578346] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-31T18:44:57.057693] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-31T18:44:57.509699] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-31T18:44:57.857690] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-31T18:44:58.657714] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-31T18:44:58.822580] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-31T18:44:58.826992] [INFO ] [REMOTE ] FG: Full fetch complete (28976 records). [2025-10-31T18:44:58.827064] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-31T18:44:58.827515] [FATAL] [VALIDATOR ] FG: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:44:58.827595] [FATAL] [MAIN ] FG: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:44:58.827637] [WARN ] [MAIN ] FG: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:44:58.827732] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-31T18:44:58.827795] [DEBUG] [LOCAL ] FG: No primary data file found to delete. [2025-10-31T18:44:58.827831] [INFO ] [LOCAL ] FG: Starting deletion of derivative data. [2025-10-31T18:44:58.827993] [DEBUG] [LOCAL ] FG: Deleted derivative data file. [2025-10-31T18:44:58.828074] [INFO ] [MAIN ] Update Progress: 825/2365 symbols completed. FG took 28.2s. Estimated remaining: 3h 15m 50s. Rate: 7.9 symbols/min [2025-10-31T18:44:58.996045] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:44:59.037136] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-31T18:44:59.039762] [DEBUG] [LOCAL ] FHI: Loaded 39508 existing records from primary storage. [2025-10-31T18:44:59.040060] [INFO ] [MAIN ] FHI: Loaded 39508 existing records. [2025-10-31T18:44:59.215458] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:44:59.215639] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-31T18:44:59.215721] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-31T18:44:59.216096] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-31T18:44:59.216178] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-31T18:44:59.462807] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-31T18:44:59.562882] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:00.257691] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-31T18:45:00.527859] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T18:45:00.977951] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T18:45:01.057699] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-31T18:45:01.857718] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-31T18:45:02.648957] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T18:45:02.650397] [INFO ] [REMOTE ] FGSN: Full fetch complete (8199 records). [2025-10-31T18:45:02.650495] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-31T18:45:02.651061] [FATAL] [VALIDATOR ] FGSN: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:45:02.651144] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:45:02.651190] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:45:02.651254] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-31T18:45:02.651338] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-31T18:45:02.651406] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-31T18:45:02.651460] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-31T18:45:02.651518] [INFO ] [MAIN ] Update Progress: 826/2365 symbols completed. FGSN took 21.0s. Estimated remaining: 3h 15m 35s. Rate: 7.9 symbols/min [2025-10-31T18:45:02.663970] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-31T18:45:02.836785] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:02.885737] [DEBUG] [LOCAL ] FHN: Loaded 53786 existing records from primary storage. [2025-10-31T18:45:02.886113] [INFO ] [MAIN ] FHN: Loaded 53786 existing records. [2025-10-31T18:45:03.031250] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-31T18:45:03.126630] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:45:03.131520] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-31T18:45:03.131403] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T18:45:03.131681] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-31T18:45:03.133514] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-31T18:45:03.133571] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-31T18:45:03.465574] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-31T18:45:03.494806] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:03.942189] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-31T18:45:03.943326] [INFO ] [REMOTE ] FGN: Full fetch complete (5351 records). [2025-10-31T18:45:03.943391] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-31T18:45:04.262775] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-31T18:45:04.299849] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-31T18:45:04.300011] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-31T18:45:04.300213] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-31T18:45:04.300254] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-31T18:45:04.300602] [DEBUG] [LOCAL ] FGN: Trimmed 5351 records to 3503 (keeping 200 days of data) [2025-10-31T18:45:04.321998] [DEBUG] [LOCAL ] FGN: Primary data saved (3503 records). [2025-10-31T18:45:04.322079] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-31T18:45:04.322149] [INFO ] [MAIN ] Update Progress: 827/2365 symbols completed. FGN took 27.9s. Estimated remaining: 3h 15m 16s. Rate: 7.9 symbols/min [2025-10-31T18:45:04.489015] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:04.541021] [DEBUG] [LOCAL ] FI: Loaded 53965 existing records from primary storage. [2025-10-31T18:45:04.541318] [INFO ] [MAIN ] FI: Loaded 53965 existing records. [2025-10-31T18:45:04.722713] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:45:04.722944] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-31T18:45:04.722996] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-31T18:45:04.723333] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-31T18:45:04.723389] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-31T18:45:05.062014] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-31T18:45:05.072513] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:05.463751] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T18:45:05.857672] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-31T18:45:06.177360] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-31T18:45:06.657699] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-31T18:45:07.043296] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T18:45:07.457665] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-31T18:45:08.121891] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T18:45:08.257713] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-31T18:45:08.469633] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T18:45:09.057680] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-31T18:45:09.672031] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T18:45:09.857681] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-31T18:45:10.178520] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-31T18:45:10.657676] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-31T18:45:10.973517] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T18:45:10.981985] [INFO ] [REMOTE ] FFWM: Full fetch complete (52111 records). [2025-10-31T18:45:10.982105] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-31T18:45:10.982722] [FATAL] [VALIDATOR ] FFWM: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T18:45:10.982805] [FATAL] [MAIN ] FFWM: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:45:10.982846] [WARN ] [MAIN ] FFWM: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:45:10.982907] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-31T18:45:10.982967] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-10-31T18:45:10.983001] [INFO ] [LOCAL ] FFWM: Starting deletion of derivative data. [2025-10-31T18:45:10.983171] [DEBUG] [LOCAL ] FFWM: Deleted derivative data file. [2025-10-31T18:45:10.983258] [INFO ] [MAIN ] Update Progress: 828/2365 symbols completed. FFWM took 47.8s. Estimated remaining: 3h 15m 7s. Rate: 7.9 symbols/min [2025-10-31T18:45:11.158833] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:11.181261] [DEBUG] [LOCAL ] FICO: Loaded 21987 existing records from primary storage. [2025-10-31T18:45:11.181504] [INFO ] [MAIN ] FICO: Loaded 21987 existing records. [2025-10-31T18:45:11.368286] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:45:11.368541] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-31T18:45:11.368599] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-31T18:45:11.368908] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-31T18:45:11.368964] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-31T18:45:11.462775] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-31T18:45:11.741673] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:11.897192] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T18:45:12.257683] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-31T18:45:12.704772] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T18:45:13.057623] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-31T18:45:13.083190] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T18:45:13.857722] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-31T18:45:14.386766] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T18:45:14.657666] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-31T18:45:14.891533] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T18:45:15.457684] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-31T18:45:16.117159] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T18:45:16.257732] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-31T18:45:16.375513] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T18:45:17.057664] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-31T18:45:17.536543] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T18:45:17.857704] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-31T18:45:18.390065] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T18:45:18.657678] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-31T18:45:19.370590] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T18:45:19.457636] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-31T18:45:20.257672] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-31T18:45:20.333036] [DEBUG] [REMOTE ] FHI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-31T18:45:20.345814] [WARN ] [REMOTE ] FHI: No data returned for month 2025-06 [2025-10-31T18:45:20.347621] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-31T18:45:20.346501] [FATAL] [REMOTE ] FHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:45:20.358637] [FATAL] [MAIN ] FHI: Failed to fetch primary data. [2025-10-31T18:45:20.359087] [WARN ] [MAIN ] FHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:45:20.359523] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-31T18:45:20.359600] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-10-31T18:45:20.359638] [INFO ] [LOCAL ] FHI: Starting deletion of derivative data. [2025-10-31T18:45:20.359906] [DEBUG] [LOCAL ] FHI: Deleted derivative data file. [2025-10-31T18:45:20.360365] [INFO ] [MAIN ] Update Progress: 829/2365 symbols completed. FHI took 21.5s. Estimated remaining: 3h 15m 3s. Rate: 7.9 symbols/min [2025-10-31T18:45:20.528334] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:20.528546] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-31T18:45:20.528587] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-31T18:45:20.528717] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-31T18:45:20.528762] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-31T18:45:20.528804] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-31T18:45:20.528835] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-31T18:45:20.895096] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:20.926807] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T18:45:21.057620] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-31T18:45:21.857673] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-31T18:45:22.360616] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-31T18:45:22.663606] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-31T18:45:22.666088] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T18:45:22.931727] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-31T18:45:23.457664] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-31T18:45:24.257669] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-31T18:45:25.057667] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-31T18:45:25.123613] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-31T18:45:25.265256] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-31T18:45:25.285454] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T18:45:25.857682] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-31T18:45:26.045776] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-10-31T18:45:26.657698] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-31T18:45:27.457632] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-31T18:45:28.084864] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-31T18:45:28.257619] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-31T18:45:28.580250] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-31T18:45:28.680797] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T18:45:29.057689] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-31T18:45:29.857721] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-31T18:45:30.656670] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T18:45:30.660827] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-31T18:45:30.707575] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-31T18:45:31.457720] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-31T18:45:31.705546] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-31T18:45:32.257731] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-31T18:45:32.409290] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T18:45:32.409537] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-31T18:45:32.409624] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:45:32.409744] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-31T18:45:32.409810] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:45:32.409856] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-31T18:45:32.409935] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-31T18:45:32.410023] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-31T18:45:32.410073] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-31T18:45:32.410119] [INFO ] [MAIN ] Update Progress: 830/2365 symbols completed. FIG took 12.0s. Estimated remaining: 3h 15m 3s. Rate: 7.9 symbols/min [2025-10-31T18:45:32.583935] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:32.620394] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-31T18:45:32.632984] [INFO ] [REMOTE ] FHN: Full fetch complete (77483 records). [2025-10-31T18:45:32.633177] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-31T18:45:32.892832] [DEBUG] [LOCAL ] FIGS: Loaded 48575 existing records from primary storage. [2025-10-31T18:45:32.931525] [INFO ] [MAIN ] FIGS: Loaded 48575 existing records. [2025-10-31T18:45:33.064556] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-31T18:45:33.179613] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-31T18:45:33.189968] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-31T18:45:33.213633] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-31T18:45:33.222033] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-31T18:45:33.263076] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:45:33.263375] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-31T18:45:33.263488] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-31T18:45:33.263921] [DEBUG] [LOCAL ] FHN: Trimmed 77483 records to 54176 (keeping 200 days of data) [2025-10-31T18:45:33.264464] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-31T18:45:33.264523] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-31T18:45:33.847196] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:33.857670] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-31T18:45:33.950613] [DEBUG] [LOCAL ] FHN: Primary data saved (54176 records). [2025-10-31T18:45:33.950765] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-31T18:45:33.950844] [INFO ] [MAIN ] Update Progress: 831/2365 symbols completed. FHN took 31.3s. Estimated remaining: 3h 14m 44s. Rate: 7.9 symbols/min [2025-10-31T18:45:34.125090] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:34.160953] [DEBUG] [LOCAL ] FIHL: Loaded 38824 existing records from primary storage. [2025-10-31T18:45:34.161218] [INFO ] [MAIN ] FIHL: Loaded 38824 existing records. [2025-10-31T18:45:34.354928] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:45:34.356250] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T18:45:34.355587] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-31T18:45:34.361770] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-31T18:45:34.362702] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-31T18:45:34.362760] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-31T18:45:34.662873] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-31T18:45:34.714433] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:35.179827] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T18:45:35.457719] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-31T18:45:35.699618] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T18:45:36.257684] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-31T18:45:36.508178] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T18:45:37.057713] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-31T18:45:37.680006] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T18:45:37.723174] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T18:45:37.857696] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-31T18:45:38.657712] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-31T18:45:38.954912] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-31T18:45:38.961789] [INFO ] [REMOTE ] FICO: Full fetch complete (30415 records). [2025-10-31T18:45:38.961940] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-31T18:45:39.324505] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-31T18:45:39.324602] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-31T18:45:39.325191] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-31T18:45:39.325246] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-31T18:45:39.326000] [DEBUG] [LOCAL ] FICO: Trimmed 30415 records to 22177 (keeping 200 days of data) [2025-10-31T18:45:39.459533] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-31T18:45:39.464461] [DEBUG] [LOCAL ] FICO: Primary data saved (22177 records). [2025-10-31T18:45:39.464527] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-31T18:45:39.464598] [INFO ] [MAIN ] Update Progress: 832/2365 symbols completed. FICO took 28.5s. Estimated remaining: 3h 14m 33s. Rate: 7.9 symbols/min [2025-10-31T18:45:39.646172] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:39.666856] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T18:45:39.679720] [DEBUG] [LOCAL ] FINS: Loaded 8197 existing records from primary storage. [2025-10-31T18:45:39.679887] [INFO ] [MAIN ] FINS: Loaded 8197 existing records. [2025-10-31T18:45:39.851527] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:45:39.851760] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-31T18:45:39.851808] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-31T18:45:39.851943] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-31T18:45:39.851980] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-31T18:45:40.199841] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:40.257614] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-31T18:45:40.592378] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T18:45:40.883136] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-31T18:45:41.057690] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-31T18:45:41.857711] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-31T18:45:42.276967] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-31T18:45:42.306332] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T18:45:42.657670] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-31T18:45:43.457731] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-31T18:45:44.257721] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-31T18:45:44.444348] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-31T18:45:45.057687] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-31T18:45:45.503626] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T18:45:45.857631] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-31T18:45:45.970780] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-31T18:45:46.262262] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T18:45:46.657625] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-31T18:45:46.745960] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-31T18:45:47.457639] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-31T18:45:48.257717] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-31T18:45:48.701303] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T18:45:48.763740] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-31T18:45:48.776489] [INFO ] [REMOTE ] FI: Full fetch complete (77511 records). [2025-10-31T18:45:48.776690] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-31T18:45:49.067972] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-31T18:45:49.165004] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-31T18:45:49.165082] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-31T18:45:49.166048] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-31T18:45:49.166111] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-31T18:45:49.167489] [DEBUG] [LOCAL ] FI: Trimmed 77511 records to 54355 (keeping 200 days of data) [2025-10-31T18:45:49.494602] [DEBUG] [LOCAL ] FI: Primary data saved (54355 records). [2025-10-31T18:45:49.494748] [INFO ] [MAIN ] FI: Full history saved. [2025-10-31T18:45:49.495495] [INFO ] [MAIN ] Update Progress: 833/2365 symbols completed. FI took 45.2s. Estimated remaining: 3h 14m 30s. Rate: 7.9 symbols/min [2025-10-31T18:45:49.706846] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T18:45:49.706517] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:49.712105] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T18:45:49.761195] [DEBUG] [LOCAL ] FINV: Loaded 45574 existing records from primary storage. [2025-10-31T18:45:49.761480] [INFO ] [MAIN ] FINV: Loaded 45574 existing records. [2025-10-31T18:45:49.860688] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-31T18:45:49.940275] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:45:49.940500] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-31T18:45:49.940558] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-31T18:45:49.940928] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-31T18:45:49.940984] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-31T18:45:50.295267] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:45:50.392579] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T18:45:50.657627] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-31T18:45:51.457720] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-31T18:45:51.879073] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T18:45:52.257681] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-31T18:45:52.552506] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T18:45:53.057631] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-31T18:45:53.309430] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T18:45:53.857677] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-31T18:45:54.217386] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T18:45:54.657616] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-31T18:45:55.012401] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T18:45:55.090559] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-31T18:45:55.457671] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-31T18:45:55.926697] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-31T18:45:56.257684] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-31T18:45:57.057635] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-31T18:45:57.179408] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-31T18:45:57.857675] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-31T18:45:58.294490] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-31T18:45:58.565751] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-31T18:45:58.576294] [INFO ] [REMOTE ] FIGS: Full fetch complete (70619 records). [2025-10-31T18:45:58.576419] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-31T18:45:58.662888] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-31T18:45:58.967127] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-31T18:45:58.967213] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-31T18:45:58.968138] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-31T18:45:58.968203] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-31T18:45:58.969564] [DEBUG] [LOCAL ] FIGS: Trimmed 70619 records to 48932 (keeping 200 days of data) [2025-10-31T18:45:59.237834] [DEBUG] [LOCAL ] FIGS: Primary data saved (48932 records). [2025-10-31T18:45:59.240881] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-31T18:45:59.241504] [INFO ] [MAIN ] Update Progress: 834/2365 symbols completed. FIGS took 26.8s. Estimated remaining: 3h 14m 26s. Rate: 7.9 symbols/min [2025-10-31T18:45:59.407143] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:45:59.456224] [DEBUG] [LOCAL ] FIS: Loaded 53713 existing records from primary storage. [2025-10-31T18:45:59.456548] [INFO ] [MAIN ] FIS: Loaded 53713 existing records. [2025-10-31T18:45:59.467747] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-31T18:45:59.635200] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:45:59.635480] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-31T18:45:59.635526] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-31T18:45:59.636457] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-31T18:45:59.636517] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-31T18:45:59.997278] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:46:00.018516] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T18:46:00.042076] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T18:46:00.257668] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-31T18:46:01.057733] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-31T18:46:01.857696] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-31T18:46:02.508374] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T18:46:02.510313] [INFO ] [REMOTE ] FINS: Full fetch complete (11441 records). [2025-10-31T18:46:02.510383] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-31T18:46:02.659373] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-31T18:46:02.908312] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-31T18:46:02.908422] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-31T18:46:02.909051] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-31T18:46:02.909116] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-31T18:46:02.909941] [DEBUG] [LOCAL ] FINS: Trimmed 11441 records to 8239 (keeping 200 days of data) [2025-10-31T18:46:02.972173] [DEBUG] [LOCAL ] FINS: Primary data saved (8239 records). [2025-10-31T18:46:02.972317] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-31T18:46:02.972447] [INFO ] [MAIN ] Update Progress: 835/2365 symbols completed. FINS took 23.5s. Estimated remaining: 3h 14m 11s. Rate: 7.9 symbols/min [2025-10-31T18:46:03.184720] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:46:03.224492] [DEBUG] [LOCAL ] FIX: Loaded 28476 existing records from primary storage. [2025-10-31T18:46:03.224909] [INFO ] [MAIN ] FIX: Loaded 28476 existing records. [2025-10-31T18:46:03.478256] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:46:03.478542] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-31T18:46:03.478615] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-31T18:46:03.479074] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-31T18:46:03.479149] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-31T18:46:04.011690] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:46:04.012257] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-31T18:46:04.045555] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T18:46:04.149667] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (3.89 seconds). [2025-10-31T18:46:04.257691] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-31T18:46:05.057624] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-31T18:46:05.089246] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T18:46:05.254048] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (4.20 seconds). [2025-10-31T18:46:05.418558] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T18:46:05.857691] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-31T18:46:05.974066] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T18:46:06.657678] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-31T18:46:07.023888] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T18:46:07.457679] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-31T18:46:07.794400] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T18:46:08.257669] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-31T18:46:08.786361] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T18:46:09.057726] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-31T18:46:09.676143] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-31T18:46:09.857681] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-31T18:46:10.403232] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T18:46:10.657727] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-31T18:46:11.271956] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T18:46:11.280951] [INFO ] [REMOTE ] FIHL: Full fetch complete (56412 records). [2025-10-31T18:46:11.281091] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-31T18:46:11.466557] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-31T18:46:11.662160] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-31T18:46:11.662325] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-31T18:46:11.663126] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-31T18:46:11.663290] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-31T18:46:11.664424] [DEBUG] [LOCAL ] FIHL: Trimmed 56412 records to 39116 (keeping 200 days of data) [2025-10-31T18:46:11.793860] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-31T18:46:11.925711] [DEBUG] [LOCAL ] FIHL: Primary data saved (39116 records). [2025-10-31T18:46:11.925849] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-31T18:46:11.925928] [INFO ] [MAIN ] Update Progress: 836/2365 symbols completed. FIHL took 38.0s. Estimated remaining: 3h 14m 6s. Rate: 7.9 symbols/min [2025-10-31T18:46:12.110065] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:46:12.110222] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-31T18:46:12.110258] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-31T18:46:12.110366] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-31T18:46:12.110407] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-31T18:46:12.110446] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-31T18:46:12.110478] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-31T18:46:12.265116] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-31T18:46:12.467759] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:46:12.648319] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T18:46:13.057712] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-31T18:46:13.279490] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T18:46:13.857672] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-31T18:46:14.435383] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T18:46:14.657633] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-31T18:46:15.131007] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T18:46:15.457680] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-31T18:46:16.120249] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T18:46:16.257676] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-31T18:46:16.441003] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T18:46:16.441305] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-31T18:46:16.441395] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:46:16.441448] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-31T18:46:16.441512] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:46:16.441583] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-31T18:46:16.441666] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-31T18:46:16.441725] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-31T18:46:16.441770] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-31T18:46:16.441816] [INFO ] [MAIN ] Update Progress: 837/2365 symbols completed. FIXT took 4.5s. Estimated remaining: 3h 13m 53s. Rate: 7.9 symbols/min [2025-10-31T18:46:16.639617] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T18:46:17.057729] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-31T18:46:17.857677] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-31T18:46:18.365000] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T18:46:18.657715] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-31T18:46:19.303604] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-31T18:46:19.457721] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-31T18:46:19.548350] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-31T18:46:20.257735] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-31T18:46:20.742356] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T18:46:21.057623] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-31T18:46:21.137159] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-31T18:46:21.857622] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-31T18:46:22.387223] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T18:46:22.657670] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-31T18:46:23.086881] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T18:46:23.093703] [INFO ] [REMOTE ] FIX: Full fetch complete (45626 records). [2025-10-31T18:46:23.093817] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-31T18:46:23.457817] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-31T18:46:23.458018] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-31T18:46:23.458094] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-31T18:46:23.459512] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-31T18:46:23.459576] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-31T18:46:23.460619] [DEBUG] [LOCAL ] FIX: Trimmed 45626 records to 28632 (keeping 200 days of data) [2025-10-31T18:46:23.637222] [DEBUG] [LOCAL ] FIX: Primary data saved (28632 records). [2025-10-31T18:46:23.637349] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-31T18:46:23.637424] [INFO ] [MAIN ] Update Progress: 838/2365 symbols completed. FIX took 20.7s. Estimated remaining: 3h 13m 44s. Rate: 7.9 symbols/min [2025-10-31T18:46:24.170664] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-31T18:46:24.181537] [INFO ] [REMOTE ] FINV: Full fetch complete (65270 records). [2025-10-31T18:46:24.181702] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-31T18:46:24.562071] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-31T18:46:24.562146] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-31T18:46:24.562991] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-31T18:46:24.563053] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-31T18:46:24.564235] [DEBUG] [LOCAL ] FINV: Trimmed 65270 records to 45954 (keeping 200 days of data) [2025-10-31T18:46:24.804005] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-31T18:46:24.819756] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-31T18:46:24.862123] [DEBUG] [LOCAL ] FINV: Primary data saved (45954 records). [2025-10-31T18:46:24.862257] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-31T18:46:24.863173] [INFO ] [MAIN ] Update Progress: 839/2365 symbols completed. FINV took 35.4s. Estimated remaining: 3h 13m 25s. Rate: 7.9 symbols/min [2025-10-31T18:46:26.341428] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T18:46:26.352802] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-31T18:46:27.799554] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T18:46:27.811220] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-31T18:46:29.256612] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T18:46:29.268200] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-31T18:46:29.873927] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T18:46:29.886391] [INFO ] [REMOTE ] FIS: Full fetch complete (77413 records). [2025-10-31T18:46:29.886546] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-31T18:46:30.273542] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-31T18:46:30.273625] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-31T18:46:30.274582] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-31T18:46:30.274665] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-31T18:46:30.276187] [DEBUG] [LOCAL ] FIS: Trimmed 77413 records to 54103 (keeping 200 days of data) [2025-10-31T18:46:30.597791] [DEBUG] [LOCAL ] FIS: Primary data saved (54103 records). [2025-10-31T18:46:30.597953] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-31T18:46:30.598572] [INFO ] [MAIN ] Update Progress: 840/2365 symbols completed. FIS took 31.4s. Estimated remaining: 3h 13m 14s. Rate: 7.9 symbols/min [2025-10-31T18:46:31.328370] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:46:31.305604] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:46:31.325350] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:46:31.306560] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:46:31.338442] [DEBUG] [LOCAL ] FLC: Loaded 5093 existing records from primary storage. [2025-10-31T18:46:31.338825] [INFO ] [MAIN ] FLC: Loaded 5093 existing records. [2025-10-31T18:46:31.567384] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:46:31.567990] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-31T18:46:31.568106] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-31T18:46:31.582471] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-31T18:46:31.582724] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-31T18:46:31.583334] [DEBUG] [LOCAL ] FLO: Loaded 52480 existing records from primary storage. [2025-10-31T18:46:31.596214] [DEBUG] [LOCAL ] FLNG: Loaded 33002 existing records from primary storage. [2025-10-31T18:46:31.595274] [INFO ] [MAIN ] FLO: Loaded 52480 existing records. [2025-10-31T18:46:31.621296] [INFO ] [MAIN ] FLNG: Loaded 33002 existing records. [2025-10-31T18:46:31.837607] [DEBUG] [LOCAL ] FLG: Loaded 53697 existing records from primary storage. [2025-10-31T18:46:31.889245] [INFO ] [MAIN ] FLG: Loaded 53697 existing records. [2025-10-31T18:46:32.149006] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:46:32.270046] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-31T18:46:32.336314] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-31T18:46:32.374066] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-31T18:46:32.396950] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:46:32.412627] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-31T18:46:32.412562] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-31T18:46:32.418174] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-31T18:46:32.476993] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-31T18:46:32.553918] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-31T18:46:32.685096] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:46:32.699045] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:46:32.732225] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-31T18:46:32.732523] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-31T18:46:32.746767] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-31T18:46:32.794521] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-31T18:46:32.834558] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-31T18:46:33.416322] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T18:46:33.482394] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-31T18:46:33.506824] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:46:33.538987] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:46:33.573631] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-31T18:46:33.573927] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-31T18:46:33.701484] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:46:33.701834] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-31T18:46:33.968067] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-31T18:46:33.969594] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-31T18:46:34.376085] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-31T18:46:34.378877] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-31T18:46:34.553753] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:46:34.560885] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-31T18:46:34.740472] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-31T18:46:34.750727] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-31T18:46:34.924178] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-31T18:46:34.926415] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-31T18:46:35.114017] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T18:46:35.235524] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-31T18:46:35.457607] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-31T18:46:35.538940] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T18:46:35.765508] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-31T18:46:35.897423] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T18:46:36.257707] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-31T18:46:37.057638] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-31T18:46:37.465574] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T18:46:37.857678] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-31T18:46:38.176583] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T18:46:38.351774] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-31T18:46:38.657638] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-31T18:46:39.035899] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T18:46:39.457680] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-31T18:46:40.257694] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-31T18:46:40.589351] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-31T18:46:40.820931] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T18:46:41.057740] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-31T18:46:41.857670] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-31T18:46:42.628166] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-31T18:46:42.657622] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-31T18:46:42.976404] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T18:46:43.457690] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-31T18:46:44.178461] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T18:46:44.257610] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-31T18:46:44.537467] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T18:46:45.057629] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-31T18:46:45.569036] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-31T18:46:45.570631] [INFO ] [REMOTE ] FLC: Full fetch complete (7787 records). [2025-10-31T18:46:45.570727] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-31T18:46:45.867942] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-31T18:46:45.950981] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-31T18:46:45.961589] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-31T18:46:45.967035] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-31T18:46:45.967114] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-31T18:46:45.982402] [DEBUG] [LOCAL ] FLC: Trimmed 7787 records to 5104 (keeping 200 days of data) [2025-10-31T18:46:45.997986] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-31T18:46:46.027768] [DEBUG] [LOCAL ] FLC: Primary data saved (5104 records). [2025-10-31T18:46:46.028542] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-31T18:46:46.028679] [INFO ] [MAIN ] Update Progress: 841/2365 symbols completed. FLC took 15.4s. Estimated remaining: 3h 13m 21s. Rate: 7.9 symbols/min [2025-10-31T18:46:46.245468] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:46:46.245698] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-31T18:46:46.245764] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-31T18:46:46.245900] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-31T18:46:46.245948] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-31T18:46:46.245998] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-31T18:46:46.246038] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-31T18:46:46.617246] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:46:46.657685] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-31T18:46:47.030050] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T18:46:47.462837] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-31T18:46:47.466241] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T18:46:48.257691] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-31T18:46:48.726484] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T18:46:49.057622] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-31T18:46:49.157373] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T18:46:49.857627] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-31T18:46:50.026221] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T18:46:50.657679] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-31T18:46:51.210355] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T18:46:51.457688] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-31T18:46:52.032381] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T18:46:52.257699] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-31T18:46:52.498183] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T18:46:53.057666] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-31T18:46:53.492723] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T18:46:53.759731] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T18:46:53.857624] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-31T18:46:54.657701] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-31T18:46:54.928161] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T18:46:55.457688] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-31T18:46:56.221568] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-31T18:46:56.257608] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-31T18:46:56.531463] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T18:46:57.057702] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-31T18:46:57.519486] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T18:46:57.857635] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-31T18:46:58.054275] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-31T18:46:58.657611] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-31T18:46:58.861710] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T18:46:59.457661] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-31T18:47:00.129965] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T18:47:00.257677] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-31T18:47:01.057631] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-31T18:47:01.089232] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T18:47:01.096189] [INFO ] [REMOTE ] FLNG: Full fetch complete (49549 records). [2025-10-31T18:47:01.096285] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-31T18:47:01.521744] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-31T18:47:01.521936] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-31T18:47:01.523931] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T18:47:01.523174] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-31T18:47:01.530085] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-31T18:47:01.531362] [DEBUG] [LOCAL ] FLNG: Trimmed 49549 records to 33245 (keeping 200 days of data) [2025-10-31T18:47:01.729616] [DEBUG] [LOCAL ] FLNG: Primary data saved (33245 records). [2025-10-31T18:47:01.729780] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-31T18:47:01.730543] [INFO ] [MAIN ] Update Progress: 842/2365 symbols completed. FLNG took 31.1s. Estimated remaining: 3h 13m 28s. Rate: 7.9 symbols/min [2025-10-31T18:47:01.871305] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-31T18:47:01.904410] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:01.957058] [DEBUG] [LOCAL ] FLR: Loaded 53628 existing records from primary storage. [2025-10-31T18:47:01.957398] [INFO ] [MAIN ] FLR: Loaded 53628 existing records. [2025-10-31T18:47:02.136293] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:02.136511] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-31T18:47:02.136558] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-31T18:47:02.136907] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-31T18:47:02.136964] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-31T18:47:02.486705] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:02.623682] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-31T18:47:02.657678] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-31T18:47:03.457689] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-31T18:47:03.853867] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-31T18:47:03.866576] [INFO ] [REMOTE ] FLO: Full fetch complete (75448 records). [2025-10-31T18:47:03.866776] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-31T18:47:04.265952] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-31T18:47:04.284390] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-31T18:47:04.284501] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-31T18:47:04.285547] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-31T18:47:04.286492] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-31T18:47:04.332059] [DEBUG] [LOCAL ] FLO: Trimmed 75448 records to 52868 (keeping 200 days of data) [2025-10-31T18:47:04.339638] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T18:47:04.349300] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-31T18:47:04.668528] [DEBUG] [LOCAL ] FLO: Primary data saved (52868 records). [2025-10-31T18:47:04.668684] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-31T18:47:04.668782] [INFO ] [MAIN ] Update Progress: 843/2365 symbols completed. FLO took 34.0s. Estimated remaining: 3h 13m 12s. Rate: 7.9 symbols/min [2025-10-31T18:47:04.837408] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:04.884285] [DEBUG] [LOCAL ] FLS: Loaded 50790 existing records from primary storage. [2025-10-31T18:47:04.884577] [INFO ] [MAIN ] FLS: Loaded 50790 existing records. [2025-10-31T18:47:05.058533] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:05.058751] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-31T18:47:05.059825] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-31T18:47:05.059961] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-31T18:47:05.060231] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-31T18:47:05.060314] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-31T18:47:05.409086] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:05.751059] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-31T18:47:05.857610] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-31T18:47:06.657704] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-31T18:47:06.939531] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-31T18:47:06.952494] [INFO ] [REMOTE ] FLG: Full fetch complete (77414 records). [2025-10-31T18:47:06.952691] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-31T18:47:07.375785] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-31T18:47:07.375883] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-31T18:47:07.376899] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-31T18:47:07.376983] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-31T18:47:07.404374] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-31T18:47:07.414123] [DEBUG] [LOCAL ] FLG: Trimmed 77414 records to 54083 (keeping 200 days of data) [2025-10-31T18:47:07.468141] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-31T18:47:07.749040] [DEBUG] [LOCAL ] FLG: Primary data saved (54083 records). [2025-10-31T18:47:07.749165] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-31T18:47:07.749241] [INFO ] [MAIN ] Update Progress: 844/2365 symbols completed. FLG took 37.1s. Estimated remaining: 3h 12m 56s. Rate: 7.9 symbols/min [2025-10-31T18:47:07.922941] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:07.993709] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T18:47:07.994671] [DEBUG] [LOCAL ] FLUT: Loaded 50967 existing records from primary storage. [2025-10-31T18:47:08.004230] [INFO ] [MAIN ] FLUT: Loaded 50967 existing records. [2025-10-31T18:47:08.185940] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:08.186195] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-31T18:47:08.186254] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-31T18:47:08.186470] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-31T18:47:08.186509] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-31T18:47:08.262819] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-31T18:47:08.547528] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:08.572388] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T18:47:09.057683] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-31T18:47:09.412049] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T18:47:09.857678] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-31T18:47:10.280752] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T18:47:10.657688] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-31T18:47:11.036437] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T18:47:11.457727] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-31T18:47:11.498783] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-31T18:47:12.257693] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-31T18:47:12.609526] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T18:47:13.057676] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-31T18:47:13.232487] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-31T18:47:13.240834] [INFO ] [REMOTE ] FLOC: Full fetch complete (42545 records). [2025-10-31T18:47:13.240946] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-31T18:47:13.711278] [DEBUG] [VALIDATOR ] FLOC: All expected trading days are present. [2025-10-31T18:47:13.711371] [DEBUG] [VALIDATOR ] FLOC: Primary data validation passed. [2025-10-31T18:47:13.712121] [INFO ] [MAIN ] FLOC: Fetched primary data is valid. [2025-10-31T18:47:13.712186] [DEBUG] [LOCAL ] FLOC: Saving primary data. [2025-10-31T18:47:13.713236] [DEBUG] [LOCAL ] FLOC: Trimmed 42545 records to 27975 (keeping 200 days of data) [2025-10-31T18:47:13.875454] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-31T18:47:13.910543] [DEBUG] [LOCAL ] FLOC: Primary data saved (27975 records). [2025-10-31T18:47:13.910685] [INFO ] [MAIN ] FLOC: Full history saved. [2025-10-31T18:47:13.910776] [INFO ] [MAIN ] Update Progress: 845/2365 symbols completed. FLOC took 27.9s. Estimated remaining: 3h 12m 46s. Rate: 7.9 symbols/min [2025-10-31T18:47:14.122248] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:14.146145] [DEBUG] [LOCAL ] FLXR: Loaded 22005 existing records from primary storage. [2025-10-31T18:47:14.146478] [INFO ] [MAIN ] FLXR: Loaded 22005 existing records. [2025-10-31T18:47:14.426845] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:14.427272] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-31T18:47:14.427562] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-31T18:47:14.428143] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-31T18:47:14.428261] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-31T18:47:14.675017] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-31T18:47:14.792372] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-31T18:47:15.029285] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:15.359223] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-31T18:47:15.457676] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-31T18:47:16.084536] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-31T18:47:16.242322] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-31T18:47:16.257617] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-31T18:47:17.057638] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-31T18:47:17.598904] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T18:47:17.857683] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-31T18:47:18.359997] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T18:47:18.657668] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-31T18:47:19.217813] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:47:19.457633] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-31T18:47:19.942885] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T18:47:20.257633] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-31T18:47:20.711757] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-31T18:47:20.783341] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T18:47:21.057707] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-31T18:47:21.857639] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-31T18:47:21.922292] [DEBUG] [REMOTE ] FLXR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-31T18:47:21.922588] [WARN ] [REMOTE ] FLXR: No data returned for month 2025-03 [2025-10-31T18:47:21.922705] [FATAL] [REMOTE ] FLXR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:47:21.922785] [FATAL] [MAIN ] FLXR: Failed to fetch primary data. [2025-10-31T18:47:21.922846] [WARN ] [MAIN ] FLXR: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:47:21.922915] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-31T18:47:21.922976] [DEBUG] [LOCAL ] FLXR: No primary data file found to delete. [2025-10-31T18:47:21.923012] [INFO ] [LOCAL ] FLXR: Starting deletion of derivative data. [2025-10-31T18:47:21.923206] [DEBUG] [LOCAL ] FLXR: Deleted derivative data file. [2025-10-31T18:47:21.923287] [INFO ] [MAIN ] Update Progress: 846/2365 symbols completed. FLXR took 8.0s. Estimated remaining: 3h 12m 39s. Rate: 7.9 symbols/min [2025-10-31T18:47:22.101488] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:22.150024] [DEBUG] [LOCAL ] FMC: Loaded 52227 existing records from primary storage. [2025-10-31T18:47:22.150326] [INFO ] [MAIN ] FMC: Loaded 52227 existing records. [2025-10-31T18:47:22.341661] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:22.342026] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-31T18:47:22.342141] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-31T18:47:22.342794] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-31T18:47:22.342924] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-31T18:47:22.553263] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T18:47:22.661182] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-31T18:47:22.769985] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:23.457670] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-31T18:47:24.115872] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T18:47:24.257629] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-31T18:47:24.858377] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:47:25.057693] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-31T18:47:25.629508] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T18:47:25.857736] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-31T18:47:26.288900] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T18:47:26.657667] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-31T18:47:27.249797] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-31T18:47:27.457685] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-31T18:47:28.236552] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-31T18:47:28.257639] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-31T18:47:28.621470] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T18:47:29.057699] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-31T18:47:29.523183] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T18:47:29.857634] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-31T18:47:30.581557] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-31T18:47:30.657672] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-31T18:47:31.281787] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T18:47:31.457691] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-31T18:47:32.115925] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-31T18:47:32.257617] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-31T18:47:32.817484] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T18:47:33.057697] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-31T18:47:33.559157] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-31T18:47:33.857671] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-31T18:47:34.548118] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T18:47:34.657606] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-31T18:47:35.447477] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T18:47:35.458432] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-31T18:47:35.460450] [INFO ] [REMOTE ] FLS: Full fetch complete (72774 records). [2025-10-31T18:47:35.460541] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-31T18:47:35.842066] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-31T18:47:35.842140] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-31T18:47:35.843068] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-31T18:47:35.843130] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-31T18:47:35.844432] [DEBUG] [LOCAL ] FLS: Trimmed 72774 records to 51170 (keeping 200 days of data) [2025-10-31T18:47:36.172991] [DEBUG] [LOCAL ] FLS: Primary data saved (51170 records). [2025-10-31T18:47:36.173260] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-31T18:47:36.173879] [INFO ] [MAIN ] Update Progress: 847/2365 symbols completed. FLS took 31.5s. Estimated remaining: 3h 12m 43s. Rate: 7.9 symbols/min [2025-10-31T18:47:36.175259] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-31T18:47:36.260305] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-31T18:47:36.354670] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:36.363115] [DEBUG] [LOCAL ] FMN: Loaded 5638 existing records from primary storage. [2025-10-31T18:47:36.363317] [INFO ] [MAIN ] FMN: Loaded 5638 existing records. [2025-10-31T18:47:36.536594] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:36.536815] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-31T18:47:36.536870] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-31T18:47:36.537028] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-31T18:47:36.537065] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-31T18:47:36.889253] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:36.920208] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T18:47:37.057619] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-31T18:47:37.544825] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-31T18:47:37.697468] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T18:47:37.857635] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-31T18:47:38.657667] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-31T18:47:39.150278] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T18:47:39.457727] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-31T18:47:39.958671] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T18:47:40.148803] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-31T18:47:40.257671] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-31T18:47:41.057744] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-31T18:47:41.857622] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-31T18:47:42.065438] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-31T18:47:42.077105] [INFO ] [REMOTE ] FLUT: Full fetch complete (73456 records). [2025-10-31T18:47:42.077222] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-31T18:47:42.479243] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T18:47:42.482021] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-31T18:47:42.482922] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-31T18:47:42.484360] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-31T18:47:42.484453] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-31T18:47:42.485871] [DEBUG] [LOCAL ] FLUT: Trimmed 73456 records to 51353 (keeping 200 days of data) [2025-10-31T18:47:42.665866] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-31T18:47:42.729133] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-31T18:47:42.834784] [DEBUG] [LOCAL ] FLUT: Primary data saved (51353 records). [2025-10-31T18:47:42.834914] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-31T18:47:42.834991] [INFO ] [MAIN ] Update Progress: 848/2365 symbols completed. FLUT took 35.1s. Estimated remaining: 3h 12m 34s. Rate: 7.9 symbols/min [2025-10-31T18:47:43.000895] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:43.029050] [DEBUG] [LOCAL ] FMS: Loaded 30281 existing records from primary storage. [2025-10-31T18:47:43.029296] [INFO ] [MAIN ] FMS: Loaded 30281 existing records. [2025-10-31T18:47:43.208341] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:43.208594] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-31T18:47:43.208696] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-31T18:47:43.209046] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-31T18:47:43.209117] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-31T18:47:43.462701] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-31T18:47:43.565810] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:43.967449] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T18:47:44.257704] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-31T18:47:44.598991] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-31T18:47:44.611152] [INFO ] [REMOTE ] FLR: Full fetch complete (76967 records). [2025-10-31T18:47:44.611261] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-31T18:47:44.695317] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-31T18:47:45.017342] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-31T18:47:45.017426] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-31T18:47:45.018383] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-31T18:47:45.018449] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-31T18:47:45.019986] [DEBUG] [LOCAL ] FLR: Trimmed 76967 records to 54015 (keeping 200 days of data) [2025-10-31T18:47:45.068397] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-31T18:47:45.343157] [DEBUG] [LOCAL ] FLR: Primary data saved (54015 records). [2025-10-31T18:47:45.343289] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-31T18:47:45.344015] [INFO ] [MAIN ] Update Progress: 849/2365 symbols completed. FLR took 43.6s. Estimated remaining: 3h 12m 17s. Rate: 7.9 symbols/min [2025-10-31T18:47:45.513319] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:45.553129] [DEBUG] [LOCAL ] FMX: Loaded 40220 existing records from primary storage. [2025-10-31T18:47:45.553406] [INFO ] [MAIN ] FMX: Loaded 40220 existing records. [2025-10-31T18:47:45.737529] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:45.737791] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-31T18:47:45.737857] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-31T18:47:45.738433] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-31T18:47:45.738490] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-31T18:47:45.862750] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-31T18:47:46.104141] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:46.119739] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T18:47:46.281929] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-31T18:47:46.657722] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-31T18:47:47.089491] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T18:47:47.457663] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-31T18:47:48.257621] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-31T18:47:48.343309] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-31T18:47:48.634850] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T18:47:49.057669] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-31T18:47:49.857667] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-31T18:47:50.107736] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T18:47:50.657667] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-31T18:47:51.164776] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-31T18:47:51.457612] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-31T18:47:51.557483] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-31T18:47:51.569413] [INFO ] [REMOTE ] FMC: Full fetch complete (75461 records). [2025-10-31T18:47:51.569527] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-31T18:47:51.949764] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-31T18:47:51.949838] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-31T18:47:51.950719] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-31T18:47:51.950781] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-31T18:47:51.952082] [DEBUG] [LOCAL ] FMC: Trimmed 75461 records to 52617 (keeping 200 days of data) [2025-10-31T18:47:52.162807] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T18:47:52.167285] [INFO ] [REMOTE ] FMN: Full fetch complete (9752 records). [2025-10-31T18:47:52.167671] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-31T18:47:52.262912] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-31T18:47:52.622016] [DEBUG] [LOCAL ] FMC: Primary data saved (52617 records). [2025-10-31T18:47:52.637769] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-31T18:47:52.644049] [INFO ] [MAIN ] Update Progress: 850/2365 symbols completed. FMC took 30.7s. Estimated remaining: 3h 12m 9s. Rate: 7.9 symbols/min [2025-10-31T18:47:52.675805] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-31T18:47:52.713952] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-31T18:47:52.736084] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-31T18:47:52.746373] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-31T18:47:52.757639] [DEBUG] [LOCAL ] FMN: Trimmed 9752 records to 5697 (keeping 200 days of data) [2025-10-31T18:47:52.842627] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:52.852782] [DEBUG] [LOCAL ] FMN: Primary data saved (5697 records). [2025-10-31T18:47:52.852855] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-31T18:47:52.852927] [INFO ] [MAIN ] Update Progress: 851/2365 symbols completed. FMN took 16.7s. Estimated remaining: 3h 11m 48s. Rate: 7.9 symbols/min [2025-10-31T18:47:52.929004] [DEBUG] [LOCAL ] FMY: Loaded 1329 existing records from primary storage. [2025-10-31T18:47:52.944940] [INFO ] [MAIN ] FMY: Loaded 1329 existing records. [2025-10-31T18:47:53.062142] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-31T18:47:53.128628] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:47:53.212612] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:53.213343] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-31T18:47:53.213515] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-31T18:47:53.213704] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-31T18:47:53.213770] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-31T18:47:53.448605] [DEBUG] [LOCAL ] FN: Loaded 37165 existing records from primary storage. [2025-10-31T18:47:53.454144] [INFO ] [MAIN ] FN: Loaded 37165 existing records. [2025-10-31T18:47:53.683199] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-31T18:47:53.861002] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-31T18:47:53.866491] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:53.846581] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:47:53.867108] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-31T18:47:53.867232] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-31T18:47:53.867629] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-31T18:47:53.867711] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-31T18:47:54.239482] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:47:54.260712] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T18:47:54.657726] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-31T18:47:54.970873] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-31T18:47:55.457638] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-31T18:47:55.757955] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T18:47:56.257682] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-31T18:47:56.378552] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-31T18:47:56.515157] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-31T18:47:57.057704] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-31T18:47:57.857686] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-31T18:47:58.002633] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T18:47:58.192523] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-31T18:47:58.657639] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-31T18:47:58.881554] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-31T18:47:59.457676] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-31T18:48:00.265017] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-31T18:48:00.267103] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T18:48:01.057635] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-31T18:48:01.602236] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T18:48:01.857719] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-31T18:48:02.027572] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T18:48:02.141732] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-31T18:48:02.657724] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-31T18:48:03.457621] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-31T18:48:03.565931] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T18:48:04.257684] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-31T18:48:04.489331] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T18:48:05.057670] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-31T18:48:05.607865] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-31T18:48:05.857675] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-31T18:48:06.061401] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-31T18:48:06.657692] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-31T18:48:07.069223] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-31T18:48:07.107085] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T18:48:07.457690] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-31T18:48:08.257668] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-31T18:48:08.487637] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T18:48:09.057686] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-31T18:48:09.452599] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T18:48:09.857684] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-31T18:48:10.002173] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-31T18:48:10.113036] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-31T18:48:10.657634] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-31T18:48:11.457667] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-31T18:48:11.974138] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T18:48:11.982849] [INFO ] [REMOTE ] FMS: Full fetch complete (43205 records). [2025-10-31T18:48:11.983074] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-31T18:48:12.262884] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-31T18:48:12.377512] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-31T18:48:12.377607] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-31T18:48:12.378482] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-31T18:48:12.378550] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-31T18:48:12.379708] [DEBUG] [LOCAL ] FMS: Trimmed 43205 records to 30521 (keeping 200 days of data) [2025-10-31T18:48:12.549144] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-31T18:48:12.570097] [DEBUG] [LOCAL ] FMS: Primary data saved (30521 records). [2025-10-31T18:48:12.570269] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-31T18:48:12.570538] [INFO ] [MAIN ] Update Progress: 852/2365 symbols completed. FMS took 29.7s. Estimated remaining: 3h 12m 2s. Rate: 7.9 symbols/min [2025-10-31T18:48:12.784487] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T18:48:12.788580] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:48:12.849068] [DEBUG] [LOCAL ] FNB: Loaded 52987 existing records from primary storage. [2025-10-31T18:48:12.849406] [INFO ] [MAIN ] FNB: Loaded 52987 existing records. [2025-10-31T18:48:13.036480] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:48:13.036790] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-31T18:48:13.036841] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-31T18:48:13.037220] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-31T18:48:13.037276] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-31T18:48:13.066939] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-31T18:48:13.398081] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:48:13.857666] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-31T18:48:14.356703] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T18:48:14.657676] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-31T18:48:15.167163] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T18:48:15.457628] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-31T18:48:15.952255] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T18:48:16.257687] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-31T18:48:16.516334] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-31T18:48:16.667034] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T18:48:17.057716] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-31T18:48:17.857669] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-31T18:48:18.145438] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-31T18:48:18.295777] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T18:48:18.657668] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-31T18:48:19.457627] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-31T18:48:19.664547] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T18:48:20.257683] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-31T18:48:20.693871] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T18:48:20.849435] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T18:48:20.850257] [INFO ] [REMOTE ] FMY: Full fetch complete (1934 records). [2025-10-31T18:48:20.850323] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-31T18:48:21.062742] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-31T18:48:21.207241] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-31T18:48:21.207316] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-31T18:48:21.207405] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-31T18:48:21.207441] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-31T18:48:21.207798] [DEBUG] [LOCAL ] FMY: Trimmed 1934 records to 1339 (keeping 200 days of data) [2025-10-31T18:48:21.216692] [DEBUG] [LOCAL ] FMY: Primary data saved (1339 records). [2025-10-31T18:48:21.216762] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-31T18:48:21.216829] [INFO ] [MAIN ] Update Progress: 853/2365 symbols completed. FMY took 28.6s. Estimated remaining: 3h 11m 56s. Rate: 7.9 symbols/min [2025-10-31T18:48:21.387540] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:48:21.435715] [DEBUG] [LOCAL ] FND: Loaded 52401 existing records from primary storage. [2025-10-31T18:48:21.436027] [INFO ] [MAIN ] FND: Loaded 52401 existing records. [2025-10-31T18:48:21.630336] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:48:21.630532] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-31T18:48:21.630577] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-31T18:48:21.630858] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-31T18:48:21.630914] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-31T18:48:21.864708] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-31T18:48:21.978923] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:48:22.594353] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T18:48:22.657681] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-31T18:48:23.220420] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T18:48:23.457677] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-31T18:48:24.034164] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T18:48:24.257604] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-31T18:48:24.554394] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T18:48:25.057716] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-31T18:48:25.509580] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T18:48:25.857678] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-31T18:48:26.427782] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-31T18:48:26.437201] [INFO ] [REMOTE ] FN: Full fetch complete (56627 records). [2025-10-31T18:48:26.437351] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-31T18:48:26.663789] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-31T18:48:26.880153] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-31T18:48:26.880245] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-31T18:48:26.881126] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-31T18:48:26.881191] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-31T18:48:26.882434] [DEBUG] [LOCAL ] FN: Trimmed 56627 records to 37468 (keeping 200 days of data) [2025-10-31T18:48:27.110060] [DEBUG] [LOCAL ] FN: Primary data saved (37468 records). [2025-10-31T18:48:27.110227] [INFO ] [MAIN ] FN: Full history saved. [2025-10-31T18:48:27.110501] [INFO ] [MAIN ] Update Progress: 854/2365 symbols completed. FN took 34.3s. Estimated remaining: 3h 11m 45s. Rate: 7.9 symbols/min [2025-10-31T18:48:27.283462] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:48:27.316027] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T18:48:27.365165] [DEBUG] [LOCAL ] FNF: Loaded 48716 existing records from primary storage. [2025-10-31T18:48:27.365462] [INFO ] [MAIN ] FNF: Loaded 48716 existing records. [2025-10-31T18:48:27.462877] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-31T18:48:27.541759] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:48:27.541924] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-31T18:48:27.541969] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-31T18:48:27.542255] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-31T18:48:27.542309] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-31T18:48:27.890786] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:48:27.918436] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T18:48:27.926919] [INFO ] [REMOTE ] FMX: Full fetch complete (57926 records). [2025-10-31T18:48:27.927024] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-31T18:48:28.262862] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-31T18:48:28.305128] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-31T18:48:28.305214] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-31T18:48:28.306042] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-31T18:48:28.306105] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-31T18:48:28.307202] [DEBUG] [LOCAL ] FMX: Trimmed 57926 records to 40525 (keeping 200 days of data) [2025-10-31T18:48:28.549662] [DEBUG] [LOCAL ] FMX: Primary data saved (40525 records). [2025-10-31T18:48:28.549791] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-31T18:48:28.550535] [INFO ] [MAIN ] Update Progress: 855/2365 symbols completed. FMX took 43.2s. Estimated remaining: 3h 11m 27s. Rate: 7.9 symbols/min [2025-10-31T18:48:28.723167] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:48:28.768692] [DEBUG] [LOCAL ] FNV: Loaded 46143 existing records from primary storage. [2025-10-31T18:48:28.769007] [INFO ] [MAIN ] FNV: Loaded 46143 existing records. [2025-10-31T18:48:28.945965] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:48:28.946242] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-31T18:48:28.946314] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-31T18:48:28.955316] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-31T18:48:28.961386] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-31T18:48:29.052667] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-31T18:48:29.063290] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-31T18:48:29.331158] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:48:29.802862] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-31T18:48:29.857622] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-31T18:48:30.287637] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T18:48:30.657725] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-31T18:48:31.147289] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T18:48:31.457677] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-31T18:48:32.103461] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T18:48:32.257689] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-31T18:48:32.478958] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T18:48:33.057674] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-31T18:48:33.743358] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T18:48:33.857675] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-31T18:48:34.461561] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-31T18:48:34.657717] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-31T18:48:35.183636] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T18:48:35.457693] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-31T18:48:35.960586] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T18:48:36.257735] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-31T18:48:36.792840] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T18:48:37.057712] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-31T18:48:37.841139] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T18:48:37.853416] [INFO ] [REMOTE ] FNB: Full fetch complete (76256 records). [2025-10-31T18:48:37.853561] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-31T18:48:37.865536] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-31T18:48:38.278805] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-31T18:48:38.278912] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-31T18:48:38.279977] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-31T18:48:38.280121] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-31T18:48:38.281915] [DEBUG] [LOCAL ] FNB: Trimmed 76256 records to 53377 (keeping 200 days of data) [2025-10-31T18:48:38.403256] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T18:48:38.657742] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-31T18:48:38.684361] [DEBUG] [LOCAL ] FNB: Primary data saved (53377 records). [2025-10-31T18:48:38.684523] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-31T18:48:38.684615] [INFO ] [MAIN ] Update Progress: 856/2365 symbols completed. FNB took 26.1s. Estimated remaining: 3h 11m 24s. Rate: 7.9 symbols/min [2025-10-31T18:48:38.887532] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:48:38.903119] [DEBUG] [LOCAL ] FOA: Loaded 12762 existing records from primary storage. [2025-10-31T18:48:38.903352] [INFO ] [MAIN ] FOA: Loaded 12762 existing records. [2025-10-31T18:48:39.114049] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:48:39.114266] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-31T18:48:39.114353] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-31T18:48:39.114527] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-31T18:48:39.114567] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-31T18:48:39.466412] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-31T18:48:39.557906] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:48:39.589784] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-31T18:48:40.014130] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-31T18:48:40.257672] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-31T18:48:40.728946] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T18:48:41.057666] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-31T18:48:41.593171] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T18:48:41.857675] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-31T18:48:42.444201] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T18:48:42.657635] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-31T18:48:42.712381] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T18:48:43.457685] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-31T18:48:44.165046] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T18:48:44.257758] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-31T18:48:44.736929] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T18:48:44.874768] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-31T18:48:45.057760] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-31T18:48:45.797062] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T18:48:45.857640] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-31T18:48:46.515302] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-31T18:48:46.657696] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-31T18:48:47.457704] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-31T18:48:47.985829] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T18:48:48.257703] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-31T18:48:48.726339] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-31T18:48:49.057718] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-31T18:48:49.429805] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-31T18:48:49.634567] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-31T18:48:49.857671] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-31T18:48:50.657705] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-31T18:48:51.239953] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-31T18:48:51.270922] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T18:48:51.457670] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-31T18:48:52.054774] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T18:48:52.257679] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-31T18:48:52.815198] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-31T18:48:53.057633] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-31T18:48:53.857715] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-31T18:48:54.326389] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T18:48:54.657734] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-31T18:48:55.048727] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T18:48:55.457769] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-31T18:48:56.084360] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-31T18:48:56.257673] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-31T18:48:57.060087] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-31T18:48:57.075623] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T18:48:57.090285] [INFO ] [REMOTE ] FND: Full fetch complete (75186 records). [2025-10-31T18:48:57.090528] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-31T18:48:57.517633] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-31T18:48:57.517810] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-31T18:48:57.519141] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-31T18:48:57.519273] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-31T18:48:57.521668] [DEBUG] [LOCAL ] FND: Trimmed 75186 records to 52791 (keeping 200 days of data) [2025-10-31T18:48:57.646478] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T18:48:57.860610] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-31T18:48:57.910724] [DEBUG] [LOCAL ] FND: Primary data saved (52791 records). [2025-10-31T18:48:57.910888] [INFO ] [MAIN ] FND: Full history saved. [2025-10-31T18:48:57.910996] [INFO ] [MAIN ] Update Progress: 857/2365 symbols completed. FND took 36.7s. Estimated remaining: 3h 11m 37s. Rate: 7.9 symbols/min [2025-10-31T18:48:58.084920] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:48:58.096635] [DEBUG] [LOCAL ] FOF: Loaded 8187 existing records from primary storage. [2025-10-31T18:48:58.096973] [INFO ] [MAIN ] FOF: Loaded 8187 existing records. [2025-10-31T18:48:58.285027] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:48:58.285560] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-31T18:48:58.285696] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-31T18:48:58.286198] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-31T18:48:58.286312] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-31T18:48:58.597141] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-31T18:48:58.642358] [INFO ] [REMOTE ] FNF: Full fetch complete (69824 records). [2025-10-31T18:48:58.652792] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-31T18:48:58.658045] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-31T18:48:58.768697] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:48:59.128738] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-31T18:48:59.128864] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-31T18:48:59.130032] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-31T18:48:59.130130] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-31T18:48:59.132160] [DEBUG] [LOCAL ] FNF: Trimmed 69824 records to 49066 (keeping 200 days of data) [2025-10-31T18:48:59.246742] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-31T18:48:59.457744] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-31T18:48:59.481335] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-31T18:48:59.482987] [DEBUG] [LOCAL ] FNF: Primary data saved (49066 records). [2025-10-31T18:48:59.487596] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-31T18:48:59.488547] [INFO ] [MAIN ] Update Progress: 858/2365 symbols completed. FNF took 32.4s. Estimated remaining: 3h 11m 18s. Rate: 7.9 symbols/min [2025-10-31T18:48:59.667014] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:48:59.685737] [DEBUG] [LOCAL ] FOR: Loaded 19034 existing records from primary storage. [2025-10-31T18:48:59.685971] [INFO ] [MAIN ] FOR: Loaded 19034 existing records. [2025-10-31T18:48:59.881426] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:48:59.881877] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-31T18:48:59.881937] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-31T18:48:59.882319] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-31T18:48:59.882376] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-31T18:49:00.003693] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-31T18:49:00.257622] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-31T18:49:00.275536] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:49:00.727605] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-31T18:49:01.057693] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-31T18:49:01.857772] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-31T18:49:01.906986] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T18:49:02.354404] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T18:49:02.657675] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-31T18:49:03.324381] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T18:49:03.457626] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-31T18:49:03.949964] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T18:49:04.257679] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-31T18:49:05.057626] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-31T18:49:05.072252] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T18:49:05.857668] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-31T18:49:06.390791] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T18:49:06.419513] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T18:49:06.657676] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-31T18:49:07.147115] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-31T18:49:07.457736] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-31T18:49:07.887394] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-31T18:49:08.257718] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-31T18:49:09.057705] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-31T18:49:09.652127] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-31T18:49:09.692005] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-31T18:49:09.703100] [INFO ] [REMOTE ] FNV: Full fetch complete (67014 records). [2025-10-31T18:49:09.703298] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-31T18:49:09.862808] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-31T18:49:10.117045] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-31T18:49:10.117170] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-31T18:49:10.118685] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-31T18:49:10.118762] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-31T18:49:10.120885] [DEBUG] [LOCAL ] FNV: Trimmed 67014 records to 46476 (keeping 200 days of data) [2025-10-31T18:49:10.424565] [DEBUG] [LOCAL ] FNV: Primary data saved (46476 records). [2025-10-31T18:49:10.424722] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-31T18:49:10.425595] [INFO ] [MAIN ] Update Progress: 859/2365 symbols completed. FNV took 41.9s. Estimated remaining: 3h 11m 17s. Rate: 7.9 symbols/min [2025-10-31T18:49:10.597335] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:49:10.642946] [DEBUG] [LOCAL ] FOUR: Loaded 50005 existing records from primary storage. [2025-10-31T18:49:10.643268] [INFO ] [MAIN ] FOUR: Loaded 50005 existing records. [2025-10-31T18:49:10.663702] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-31T18:49:10.793354] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T18:49:10.852067] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:49:10.852271] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-31T18:49:10.852319] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-31T18:49:10.853102] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-31T18:49:10.853159] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-31T18:49:11.200043] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:49:11.426375] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-31T18:49:11.429910] [INFO ] [REMOTE ] FOA: Full fetch complete (20277 records). [2025-10-31T18:49:11.429994] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-31T18:49:11.462878] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-31T18:49:11.821022] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-31T18:49:11.821133] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-31T18:49:11.821723] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-31T18:49:11.821788] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-31T18:49:11.822581] [DEBUG] [LOCAL ] FOA: Trimmed 20277 records to 12832 (keeping 200 days of data) [2025-10-31T18:49:11.896535] [DEBUG] [LOCAL ] FOA: Primary data saved (12832 records). [2025-10-31T18:49:11.896723] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-31T18:49:11.896837] [INFO ] [MAIN ] Update Progress: 860/2365 symbols completed. FOA took 33.2s. Estimated remaining: 3h 10m 58s. Rate: 7.9 symbols/min [2025-10-31T18:49:12.083525] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:49:12.102130] [DEBUG] [LOCAL ] FPF: Loaded 18642 existing records from primary storage. [2025-10-31T18:49:12.102347] [INFO ] [MAIN ] FPF: Loaded 18642 existing records. [2025-10-31T18:49:12.275415] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-31T18:49:12.280689] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:49:12.281804] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-31T18:49:12.281913] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-31T18:49:12.282104] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-31T18:49:12.282144] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-31T18:49:12.660596] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T18:49:12.679331] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:49:13.057692] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-31T18:49:13.718036] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T18:49:13.806211] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T18:49:13.857633] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-31T18:49:14.657685] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-31T18:49:15.238681] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-31T18:49:15.370777] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-31T18:49:15.457616] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-31T18:49:16.133241] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T18:49:16.257638] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-31T18:49:16.921258] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T18:49:17.057630] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-31T18:49:17.776552] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T18:49:17.857616] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-31T18:49:18.563355] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T18:49:18.657625] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-31T18:49:19.457717] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-31T18:49:19.473220] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-31T18:49:19.477567] [INFO ] [REMOTE ] FOR: Full fetch complete (29352 records). [2025-10-31T18:49:19.477670] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-31T18:49:19.855905] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-31T18:49:19.855982] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-31T18:49:19.856571] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-31T18:49:19.856611] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-31T18:49:19.857304] [DEBUG] [LOCAL ] FOR: Trimmed 29352 records to 19149 (keeping 200 days of data) [2025-10-31T18:49:19.964710] [DEBUG] [LOCAL ] FOR: Primary data saved (19149 records). [2025-10-31T18:49:19.964838] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-31T18:49:19.964910] [INFO ] [MAIN ] Update Progress: 861/2365 symbols completed. FOR took 20.5s. Estimated remaining: 3h 10m 51s. Rate: 7.9 symbols/min [2025-10-31T18:49:20.140823] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:49:20.159329] [DEBUG] [LOCAL ] FPH: Loaded 19256 existing records from primary storage. [2025-10-31T18:49:20.159553] [INFO ] [MAIN ] FPH: Loaded 19256 existing records. [2025-10-31T18:49:20.267415] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-31T18:49:20.351005] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:49:20.351187] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-31T18:49:20.351233] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-31T18:49:20.351418] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-31T18:49:20.351473] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-31T18:49:20.725080] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:49:20.755456] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T18:49:20.970702] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-31T18:49:21.057711] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-31T18:49:21.857694] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-31T18:49:22.355126] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T18:49:22.657693] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-31T18:49:22.696567] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-31T18:49:23.457702] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-31T18:49:23.974772] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-31T18:49:24.199009] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T18:49:24.257670] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-31T18:49:24.985085] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-31T18:49:25.057669] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-31T18:49:25.646999] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T18:49:25.857692] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-31T18:49:26.650169] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-31T18:49:26.657599] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-31T18:49:27.319831] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T18:49:27.457670] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-31T18:49:28.156220] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T18:49:28.257618] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-31T18:49:29.057621] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-31T18:49:29.128235] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-31T18:49:29.680079] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T18:49:29.682508] [INFO ] [REMOTE ] FOF: Full fetch complete (11910 records). [2025-10-31T18:49:29.682577] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-31T18:49:29.863134] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-31T18:49:30.049230] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-31T18:49:30.049305] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-31T18:49:30.049573] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-31T18:49:30.049612] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-31T18:49:30.050059] [DEBUG] [LOCAL ] FOF: Trimmed 11910 records to 8225 (keeping 200 days of data) [2025-10-31T18:49:30.098456] [DEBUG] [LOCAL ] FOF: Primary data saved (8225 records). [2025-10-31T18:49:30.098565] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-31T18:49:30.098667] [INFO ] [MAIN ] Update Progress: 862/2365 symbols completed. FOF took 32.2s. Estimated remaining: 3h 10m 48s. Rate: 7.9 symbols/min [2025-10-31T18:49:30.262935] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:49:30.292787] [DEBUG] [LOCAL ] FPI: Loaded 31207 existing records from primary storage. [2025-10-31T18:49:30.293033] [INFO ] [MAIN ] FPI: Loaded 31207 existing records. [2025-10-31T18:49:30.464259] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:49:30.464450] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-31T18:49:30.464496] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-31T18:49:30.464785] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-31T18:49:30.464841] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-31T18:49:30.662914] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-31T18:49:30.816738] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:49:31.195392] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:49:31.457667] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-31T18:49:31.572608] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T18:49:31.578194] [INFO ] [REMOTE ] FPF: Full fetch complete (26583 records). [2025-10-31T18:49:31.578273] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-31T18:49:31.939914] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-31T18:49:31.939999] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-31T18:49:31.940553] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-31T18:49:31.940595] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-31T18:49:31.941293] [DEBUG] [LOCAL ] FPF: Trimmed 26583 records to 18791 (keeping 200 days of data) [2025-10-31T18:49:32.050501] [DEBUG] [LOCAL ] FPF: Primary data saved (18791 records). [2025-10-31T18:49:32.050634] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-31T18:49:32.050752] [INFO ] [MAIN ] Update Progress: 863/2365 symbols completed. FPF took 20.2s. Estimated remaining: 3h 10m 31s. Rate: 7.9 symbols/min [2025-10-31T18:49:32.225811] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:49:32.257701] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-31T18:49:32.272894] [DEBUG] [LOCAL ] FR: Loaded 46772 existing records from primary storage. [2025-10-31T18:49:32.273189] [INFO ] [MAIN ] FR: Loaded 46772 existing records. [2025-10-31T18:49:32.465672] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:49:32.467158] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T18:49:32.467323] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-31T18:49:32.467491] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-31T18:49:32.475817] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-31T18:49:32.475875] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-31T18:49:32.822828] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:49:33.057635] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-31T18:49:33.633286] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T18:49:33.857684] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-31T18:49:34.151104] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T18:49:34.657675] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-31T18:49:35.227571] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T18:49:35.402921] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T18:49:35.457691] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-31T18:49:36.257741] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-31T18:49:36.286099] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T18:49:37.057684] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-31T18:49:37.422516] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T18:49:37.857684] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-31T18:49:38.499717] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T18:49:38.603392] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-31T18:49:38.657728] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-31T18:49:39.289003] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-31T18:49:39.457731] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-31T18:49:40.138193] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T18:49:40.257687] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-31T18:49:40.926073] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T18:49:41.057712] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-31T18:49:41.857776] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-31T18:49:42.657712] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-31T18:49:42.691029] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T18:49:42.864163] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-31T18:49:42.875695] [INFO ] [REMOTE ] FOUR: Full fetch complete (72403 records). [2025-10-31T18:49:42.875813] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-31T18:49:43.278413] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-31T18:49:43.278507] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-31T18:49:43.279430] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-31T18:49:43.279522] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-31T18:49:43.281160] [DEBUG] [LOCAL ] FOUR: Trimmed 72403 records to 50391 (keeping 200 days of data) [2025-10-31T18:49:43.463585] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-31T18:49:43.585384] [DEBUG] [LOCAL ] FOUR: Primary data saved (50391 records). [2025-10-31T18:49:43.585514] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-31T18:49:43.586366] [INFO ] [MAIN ] Update Progress: 864/2365 symbols completed. FOUR took 33.2s. Estimated remaining: 3h 10m 30s. Rate: 7.9 symbols/min [2025-10-31T18:49:43.758870] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:49:43.775595] [DEBUG] [LOCAL ] FRA: Loaded 13351 existing records from primary storage. [2025-10-31T18:49:43.775880] [INFO ] [MAIN ] FRA: Loaded 13351 existing records. [2025-10-31T18:49:43.961875] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:49:43.962118] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-31T18:49:43.962238] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-31T18:49:43.962414] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-31T18:49:43.962454] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-31T18:49:44.260505] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-31T18:49:44.346721] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:49:44.383750] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T18:49:44.385569] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-31T18:49:45.057639] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-31T18:49:45.249355] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T18:49:45.840333] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T18:49:45.857620] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-31T18:49:46.521475] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T18:49:46.657713] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-31T18:49:47.457733] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-31T18:49:48.075326] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T18:49:48.224836] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T18:49:48.257618] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-31T18:49:48.967045] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-31T18:49:49.057612] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-31T18:49:49.644187] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T18:49:49.857681] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-31T18:49:50.657740] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-31T18:49:51.185110] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T18:49:51.280881] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-31T18:49:51.457686] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-31T18:49:52.257670] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-31T18:49:52.697329] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T18:49:53.057746] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-31T18:49:53.222166] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-31T18:49:53.737926] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-31T18:49:53.857670] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-31T18:49:54.578883] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T18:49:54.584049] [INFO ] [REMOTE ] FPH: Full fetch complete (30739 records). [2025-10-31T18:49:54.584147] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-31T18:49:54.662889] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-31T18:49:54.971763] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-31T18:49:54.971852] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-31T18:49:54.972663] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-31T18:49:54.972727] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-31T18:49:54.973458] [DEBUG] [LOCAL ] FPH: Trimmed 30739 records to 19404 (keeping 200 days of data) [2025-10-31T18:49:55.082632] [DEBUG] [LOCAL ] FPH: Primary data saved (19404 records). [2025-10-31T18:49:55.082797] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-31T18:49:55.082891] [INFO ] [MAIN ] Update Progress: 865/2365 symbols completed. FPH took 35.1s. Estimated remaining: 3h 10m 29s. Rate: 7.9 symbols/min [2025-10-31T18:49:55.253802] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:49:55.270453] [DEBUG] [LOCAL ] FRGE: Loaded 15367 existing records from primary storage. [2025-10-31T18:49:55.270743] [INFO ] [MAIN ] FRGE: Loaded 15367 existing records. [2025-10-31T18:49:55.452582] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:49:55.452877] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-31T18:49:55.452964] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-31T18:49:55.453123] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-31T18:49:55.453163] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-31T18:49:55.465763] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-31T18:49:55.825161] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:49:56.050000] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T18:49:56.191199] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T18:49:56.257716] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-31T18:49:57.057707] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-31T18:49:57.333567] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T18:49:57.857727] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-31T18:49:58.170876] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T18:49:58.657733] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-31T18:49:58.908932] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T18:49:59.417326] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T18:49:59.457625] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-31T18:50:00.257688] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-31T18:50:00.420161] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T18:50:01.057678] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-31T18:50:01.333229] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T18:50:01.862851] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-31T18:50:01.872729] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-31T18:50:02.657688] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-31T18:50:02.920602] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T18:50:03.457696] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-31T18:50:04.155177] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-31T18:50:04.257750] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-31T18:50:04.313361] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-31T18:50:04.996447] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-31T18:50:05.057683] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-31T18:50:05.688890] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-31T18:50:05.857677] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-31T18:50:06.657713] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-31T18:50:07.224613] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-31T18:50:07.418831] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-31T18:50:07.430535] [INFO ] [REMOTE ] FR: Full fetch complete (67536 records). [2025-10-31T18:50:07.430721] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-31T18:50:07.462827] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-31T18:50:07.853163] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-31T18:50:07.853299] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-31T18:50:07.854358] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-31T18:50:07.854427] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-31T18:50:07.855776] [DEBUG] [LOCAL ] FR: Trimmed 67536 records to 47086 (keeping 200 days of data) [2025-10-31T18:50:08.140180] [DEBUG] [LOCAL ] FR: Primary data saved (47086 records). [2025-10-31T18:50:08.140308] [INFO ] [MAIN ] FR: Full history saved. [2025-10-31T18:50:08.140387] [INFO ] [MAIN ] Update Progress: 866/2365 symbols completed. FR took 36.1s. Estimated remaining: 3h 10m 31s. Rate: 7.9 symbols/min [2025-10-31T18:50:08.262806] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-31T18:50:08.313358] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:08.362570] [DEBUG] [LOCAL ] FRO: Loaded 51965 existing records from primary storage. [2025-10-31T18:50:08.362936] [INFO ] [MAIN ] FRO: Loaded 51965 existing records. [2025-10-31T18:50:08.544958] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:50:08.545299] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-31T18:50:08.545352] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-31T18:50:08.545541] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-31T18:50:08.545577] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-31T18:50:08.728002] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T18:50:08.992416] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-31T18:50:08.991872] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:09.057666] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-31T18:50:09.778531] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T18:50:09.857679] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-31T18:50:10.657693] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-31T18:50:11.106215] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T18:50:11.114181] [INFO ] [REMOTE ] FPI: Full fetch complete (43834 records). [2025-10-31T18:50:11.114348] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-31T18:50:11.472458] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-31T18:50:11.500526] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-31T18:50:11.546094] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-31T18:50:11.546211] [INFO ] [REMOTE ] FRA: Full fetch complete (22374 records). [2025-10-31T18:50:11.546331] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-31T18:50:11.547124] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-31T18:50:11.547239] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-31T18:50:11.547338] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-31T18:50:11.651459] [DEBUG] [LOCAL ] FPI: Trimmed 43834 records to 31452 (keeping 200 days of data) [2025-10-31T18:50:12.102979] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-31T18:50:12.117731] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-31T18:50:12.119910] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-31T18:50:12.119988] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-31T18:50:12.130993] [DEBUG] [LOCAL ] FRA: Trimmed 22374 records to 13447 (keeping 200 days of data) [2025-10-31T18:50:12.172625] [DEBUG] [LOCAL ] FPI: Primary data saved (31452 records). [2025-10-31T18:50:12.179042] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-31T18:50:12.179398] [INFO ] [MAIN ] Update Progress: 867/2365 symbols completed. FPI took 42.1s. Estimated remaining: 3h 10m 17s. Rate: 7.9 symbols/min [2025-10-31T18:50:12.264248] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-31T18:50:12.378724] [DEBUG] [LOCAL ] FRA: Primary data saved (13447 records). [2025-10-31T18:50:12.378879] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-31T18:50:12.395955] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:12.405593] [INFO ] [MAIN ] Update Progress: 868/2365 symbols completed. FRA took 28.8s. Estimated remaining: 3h 9m 57s. Rate: 7.9 symbols/min [2025-10-31T18:50:12.406747] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-31T18:50:12.617623] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:12.617843] [DEBUG] [LOCAL ] FSCO: No existing data file found in primary storage. [2025-10-31T18:50:12.617923] [WARN ] [MAIN ] FSCO: No existing data found, performing full refresh instead. [2025-10-31T18:50:12.618224] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-31T18:50:12.618354] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-31T18:50:12.618405] [DEBUG] [LOCAL ] FSCO: No primary data file found to delete. [2025-10-31T18:50:12.618440] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-31T18:50:12.745325] [DEBUG] [LOCAL ] FRT: Loaded 41315 existing records from primary storage. [2025-10-31T18:50:12.745990] [INFO ] [MAIN ] FRT: Loaded 41315 existing records. [2025-10-31T18:50:13.060399] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-31T18:50:13.116882] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:50:13.121623] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-31T18:50:13.127221] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-31T18:50:13.148089] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-31T18:50:13.166631] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-31T18:50:13.300408] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:13.547833] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:13.722397] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T18:50:13.857703] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-31T18:50:14.047412] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-31T18:50:14.657627] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-31T18:50:14.714466] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-31T18:50:14.718207] [INFO ] [REMOTE ] FRGE: Full fetch complete (29305 records). [2025-10-31T18:50:14.718306] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-31T18:50:15.080083] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-31T18:50:15.080159] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-31T18:50:15.080712] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-31T18:50:15.080773] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-31T18:50:15.081391] [DEBUG] [LOCAL ] FRGE: Trimmed 29305 records to 15502 (keeping 200 days of data) [2025-10-31T18:50:15.167424] [DEBUG] [LOCAL ] FRGE: Primary data saved (15502 records). [2025-10-31T18:50:15.167548] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-31T18:50:15.167632] [INFO ] [MAIN ] Update Progress: 869/2365 symbols completed. FRGE took 20.1s. Estimated remaining: 3h 9m 41s. Rate: 7.9 symbols/min [2025-10-31T18:50:15.333816] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:15.380076] [DEBUG] [LOCAL ] FSK: Loaded 49725 existing records from primary storage. [2025-10-31T18:50:15.380382] [INFO ] [MAIN ] FSK: Loaded 49725 existing records. [2025-10-31T18:50:15.462925] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-31T18:50:15.555872] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:50:15.556087] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-31T18:50:15.556134] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-31T18:50:15.556316] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-31T18:50:15.556353] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-31T18:50:15.916391] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:15.939865] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T18:50:16.257670] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-31T18:50:16.904228] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-31T18:50:17.057639] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-31T18:50:17.289998] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T18:50:17.857669] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-31T18:50:18.501319] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-31T18:50:18.657685] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-31T18:50:19.005480] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T18:50:19.457680] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-31T18:50:19.534085] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T18:50:20.257679] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-31T18:50:20.497690] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T18:50:21.057635] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-31T18:50:21.653227] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-31T18:50:21.857678] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-31T18:50:22.339880] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T18:50:22.657679] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-31T18:50:23.330555] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-31T18:50:23.457618] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-31T18:50:23.516874] [DEBUG] [REMOTE ] FRT: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-31T18:50:23.517178] [WARN ] [REMOTE ] FRT: No data returned for month 2025-02 [2025-10-31T18:50:23.517298] [FATAL] [REMOTE ] FRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T18:50:23.517393] [FATAL] [MAIN ] FRT: Failed to fetch primary data. [2025-10-31T18:50:23.517459] [WARN ] [MAIN ] FRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T18:50:23.517529] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-31T18:50:23.517592] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-31T18:50:23.517627] [INFO ] [LOCAL ] FRT: Starting deletion of derivative data. [2025-10-31T18:50:23.517901] [DEBUG] [LOCAL ] FRT: Deleted derivative data file. [2025-10-31T18:50:23.518009] [INFO ] [MAIN ] Update Progress: 870/2365 symbols completed. FRT took 11.3s. Estimated remaining: 3h 9m 34s. Rate: 7.9 symbols/min [2025-10-31T18:50:23.711360] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:23.733345] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T18:50:23.784785] [DEBUG] [LOCAL ] FSLY: Loaded 51576 existing records from primary storage. [2025-10-31T18:50:23.785147] [INFO ] [MAIN ] FSLY: Loaded 51576 existing records. [2025-10-31T18:50:23.989402] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:50:23.989631] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-31T18:50:23.989712] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-31T18:50:23.989906] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-31T18:50:23.989945] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-31T18:50:24.266456] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-31T18:50:24.346822] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:25.057670] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-31T18:50:25.570670] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T18:50:25.857689] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-31T18:50:26.131508] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-31T18:50:26.657679] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-31T18:50:27.012732] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T18:50:27.457727] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-31T18:50:28.157835] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-31T18:50:28.257721] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-31T18:50:28.481752] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T18:50:29.057683] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-31T18:50:29.450026] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T18:50:29.857697] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-31T18:50:30.016119] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T18:50:30.657729] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-31T18:50:31.163854] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T18:50:31.457702] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-31T18:50:32.082992] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-31T18:50:32.257620] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-31T18:50:32.569418] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T18:50:33.057697] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-31T18:50:33.514686] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T18:50:33.857717] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-31T18:50:34.314662] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T18:50:34.657715] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-31T18:50:35.188753] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T18:50:35.457708] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-31T18:50:35.699703] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T18:50:36.257713] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-31T18:50:36.717249] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-31T18:50:37.057710] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-31T18:50:37.626245] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T18:50:37.857635] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-31T18:50:38.469675] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T18:50:38.479857] [INFO ] [REMOTE ] FSCO: Full fetch complete (55265 records). [2025-10-31T18:50:38.479982] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-31T18:50:38.666103] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-31T18:50:38.874133] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-31T18:50:38.874200] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-31T18:50:38.874953] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-31T18:50:38.875014] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-31T18:50:38.876051] [DEBUG] [LOCAL ] FSCO: Trimmed 55265 records to 38879 (keeping 200 days of data) [2025-10-31T18:50:39.101129] [DEBUG] [LOCAL ] FSCO: Primary data saved (38879 records). [2025-10-31T18:50:39.101293] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-31T18:50:39.101379] [INFO ] [MAIN ] Update Progress: 871/2365 symbols completed. FSCO took 26.7s. Estimated remaining: 3h 9m 40s. Rate: 7.9 symbols/min [2025-10-31T18:50:39.282462] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:39.315546] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T18:50:39.368503] [DEBUG] [LOCAL ] FSM: Loaded 53683 existing records from primary storage. [2025-10-31T18:50:39.368842] [INFO ] [MAIN ] FSM: Loaded 53683 existing records. [2025-10-31T18:50:39.464713] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-31T18:50:39.544638] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:50:39.544911] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-31T18:50:39.544969] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-31T18:50:39.545222] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-31T18:50:39.545281] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-31T18:50:39.899855] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:40.006668] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T18:50:40.257686] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-31T18:50:40.729316] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T18:50:41.057705] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-31T18:50:41.842990] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-31T18:50:41.857615] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-31T18:50:42.428700] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T18:50:42.657675] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-31T18:50:43.118547] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T18:50:43.457681] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-31T18:50:44.257673] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-31T18:50:44.346688] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-31T18:50:44.358767] [INFO ] [REMOTE ] FRO: Full fetch complete (75286 records). [2025-10-31T18:50:44.358913] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-31T18:50:44.759796] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-31T18:50:44.759931] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-31T18:50:44.760995] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-31T18:50:44.761082] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-31T18:50:44.787419] [DEBUG] [LOCAL ] FRO: Trimmed 75286 records to 52338 (keeping 200 days of data) [2025-10-31T18:50:44.789355] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T18:50:45.065280] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-31T18:50:45.109336] [DEBUG] [LOCAL ] FRO: Primary data saved (52338 records). [2025-10-31T18:50:45.109445] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-31T18:50:45.109517] [INFO ] [MAIN ] Update Progress: 872/2365 symbols completed. FRO took 37.0s. Estimated remaining: 3h 9m 30s. Rate: 7.9 symbols/min [2025-10-31T18:50:45.278010] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:45.308491] [DEBUG] [LOCAL ] FSS: Loaded 32926 existing records from primary storage. [2025-10-31T18:50:45.308799] [INFO ] [MAIN ] FSS: Loaded 32926 existing records. [2025-10-31T18:50:45.482948] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:50:45.483152] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-31T18:50:45.483197] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-31T18:50:45.483855] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-31T18:50:45.483910] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-31T18:50:45.843065] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:45.863783] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-31T18:50:45.879921] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T18:50:45.892382] [INFO ] [REMOTE ] FSK: Full fetch complete (72206 records). [2025-10-31T18:50:45.892526] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-31T18:50:46.282594] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-31T18:50:46.282722] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-31T18:50:46.283790] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-31T18:50:46.283871] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-31T18:50:46.285348] [DEBUG] [LOCAL ] FSK: Trimmed 72206 records to 50109 (keeping 200 days of data) [2025-10-31T18:50:46.532835] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T18:50:46.632846] [DEBUG] [LOCAL ] FSK: Primary data saved (50109 records). [2025-10-31T18:50:46.632964] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-31T18:50:46.633608] [INFO ] [MAIN ] Update Progress: 873/2365 symbols completed. FSK took 31.5s. Estimated remaining: 3h 9m 12s. Rate: 7.9 symbols/min [2025-10-31T18:50:46.662806] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-31T18:50:46.813092] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:46.835097] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T18:50:46.844694] [DEBUG] [LOCAL ] FT: Loaded 6756 existing records from primary storage. [2025-10-31T18:50:46.844868] [INFO ] [MAIN ] FT: Loaded 6756 existing records. [2025-10-31T18:50:47.016699] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:50:47.016945] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-31T18:50:47.016998] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-31T18:50:47.017138] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-31T18:50:47.017174] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-31T18:50:47.365912] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:47.457638] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-31T18:50:47.928322] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T18:50:48.108685] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T18:50:48.257670] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-31T18:50:49.057726] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-31T18:50:49.525715] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T18:50:49.857697] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-31T18:50:50.339833] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T18:50:50.657631] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-31T18:50:50.774156] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T18:50:51.045706] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-31T18:50:51.457690] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-31T18:50:52.257690] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-31T18:50:53.062793] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-31T18:50:53.081220] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T18:50:53.093672] [INFO ] [REMOTE ] FSLY: Full fetch complete (74858 records). [2025-10-31T18:50:53.093797] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-31T18:50:53.488944] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-31T18:50:53.489046] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-31T18:50:53.490146] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-31T18:50:53.497916] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-31T18:50:53.513890] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T18:50:53.522167] [DEBUG] [LOCAL ] FSLY: Trimmed 74858 records to 51958 (keeping 200 days of data) [2025-10-31T18:50:53.845474] [DEBUG] [LOCAL ] FSLY: Primary data saved (51958 records). [2025-10-31T18:50:53.845629] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-31T18:50:53.845753] [INFO ] [MAIN ] Update Progress: 874/2365 symbols completed. FSLY took 30.3s. Estimated remaining: 3h 9m 4s. Rate: 7.9 symbols/min [2025-10-31T18:50:53.862754] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-31T18:50:54.042839] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:50:54.057496] [DEBUG] [LOCAL ] FTHY: Loaded 12003 existing records from primary storage. [2025-10-31T18:50:54.057831] [INFO ] [MAIN ] FTHY: Loaded 12003 existing records. [2025-10-31T18:50:54.275838] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:50:54.276352] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-31T18:50:54.281979] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-31T18:50:54.282211] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-31T18:50:54.285147] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-31T18:50:54.285219] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-31T18:50:54.642462] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T18:50:54.659470] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-31T18:50:54.738471] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:50:55.457701] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-31T18:50:55.761239] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T18:50:55.924433] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-31T18:50:56.257739] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-31T18:50:56.838139] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-31T18:50:57.057699] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-31T18:50:57.857691] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-31T18:50:58.657635] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-31T18:50:58.693832] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T18:50:58.885317] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T18:50:59.135349] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-31T18:50:59.457662] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-31T18:50:59.857170] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-31T18:51:00.257700] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-31T18:51:01.057688] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-31T18:51:01.416505] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T18:51:01.857690] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-31T18:51:02.478811] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T18:51:02.657678] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-31T18:51:02.848061] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-31T18:51:03.457690] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-31T18:51:04.048379] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T18:51:04.098281] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-31T18:51:04.257619] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-31T18:51:05.057719] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-31T18:51:05.597361] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T18:51:05.656502] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-31T18:51:05.857622] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-31T18:51:06.657726] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-31T18:51:07.194470] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T18:51:07.371984] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T18:51:07.457612] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-31T18:51:08.257670] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-31T18:51:08.485394] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T18:51:08.723878] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-31T18:51:09.057689] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-31T18:51:09.566898] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-31T18:51:09.857681] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-31T18:51:10.657674] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-31T18:51:11.278987] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-31T18:51:11.457624] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-31T18:51:11.665459] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T18:51:11.672627] [INFO ] [REMOTE ] FSS: Full fetch complete (48761 records). [2025-10-31T18:51:11.672747] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-31T18:51:12.043982] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-31T18:51:12.044067] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-31T18:51:12.044784] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-31T18:51:12.044845] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-31T18:51:12.045845] [DEBUG] [LOCAL ] FSS: Trimmed 48761 records to 33268 (keeping 200 days of data) [2025-10-31T18:51:12.244169] [DEBUG] [LOCAL ] FSS: Primary data saved (33268 records). [2025-10-31T18:51:12.244290] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-31T18:51:12.244366] [INFO ] [MAIN ] Update Progress: 875/2365 symbols completed. FSS took 27.1s. Estimated remaining: 3h 9m 14s. Rate: 7.9 symbols/min [2025-10-31T18:51:12.264817] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-31T18:51:12.420468] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:51:12.470857] [DEBUG] [LOCAL ] FTI: Loaded 53679 existing records from primary storage. [2025-10-31T18:51:12.471201] [INFO ] [MAIN ] FTI: Loaded 53679 existing records. [2025-10-31T18:51:12.649915] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:51:12.650145] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-31T18:51:12.650192] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-31T18:51:12.650579] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-31T18:51:12.650618] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-31T18:51:12.867696] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-31T18:51:13.018837] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:51:13.057622] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-31T18:51:13.143447] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-31T18:51:13.155717] [INFO ] [REMOTE ] FSM: Full fetch complete (77254 records). [2025-10-31T18:51:13.155856] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-31T18:51:13.539083] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-31T18:51:13.539203] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-31T18:51:13.540146] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-31T18:51:13.540207] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-31T18:51:13.541630] [DEBUG] [LOCAL ] FSM: Trimmed 77254 records to 54072 (keeping 200 days of data) [2025-10-31T18:51:13.739566] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T18:51:13.743616] [INFO ] [REMOTE ] FT: Full fetch complete (9389 records). [2025-10-31T18:51:13.744487] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-31T18:51:13.861003] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-31T18:51:14.125673] [DEBUG] [LOCAL ] FSM: Primary data saved (54072 records). [2025-10-31T18:51:14.141887] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-31T18:51:14.153587] [INFO ] [MAIN ] Update Progress: 876/2365 symbols completed. FSM took 35.1s. Estimated remaining: 3h 8m 57s. Rate: 7.9 symbols/min [2025-10-31T18:51:14.388265] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-31T18:51:14.411787] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-31T18:51:14.415923] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:51:14.416323] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-31T18:51:14.416906] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-31T18:51:14.417554] [DEBUG] [LOCAL ] FT: Trimmed 9389 records to 6799 (keeping 200 days of data) [2025-10-31T18:51:14.457226] [DEBUG] [LOCAL ] FT: Primary data saved (6799 records). [2025-10-31T18:51:14.457447] [INFO ] [MAIN ] FT: Full history saved. [2025-10-31T18:51:14.457544] [INFO ] [MAIN ] Update Progress: 877/2365 symbols completed. FT took 27.8s. Estimated remaining: 3h 8m 37s. Rate: 7.9 symbols/min [2025-10-31T18:51:14.484061] [DEBUG] [LOCAL ] FTK: Loaded 33430 existing records from primary storage. [2025-10-31T18:51:14.484330] [INFO ] [MAIN ] FTK: Loaded 33430 existing records. [2025-10-31T18:51:14.659865] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-31T18:51:14.663474] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:51:14.664571] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-31T18:51:14.664633] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-31T18:51:14.664892] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-31T18:51:14.664944] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-31T18:51:15.033891] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:51:15.324908] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T18:51:15.369313] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-31T18:51:15.457682] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-31T18:51:16.257687] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-31T18:51:16.615718] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T18:51:17.057626] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-31T18:51:17.113354] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T18:51:17.857618] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-31T18:51:18.285960] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T18:51:18.428818] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T18:51:18.657675] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-31T18:51:19.457707] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-31T18:51:19.993594] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T18:51:20.257700] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-31T18:51:20.298866] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T18:51:20.681082] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-31T18:51:21.057673] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-31T18:51:21.545347] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T18:51:21.857672] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-31T18:51:22.389393] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T18:51:22.657697] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-31T18:51:23.457669] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-31T18:51:24.022001] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T18:51:24.040598] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-31T18:51:24.257730] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-31T18:51:25.057706] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-31T18:51:25.492776] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T18:51:25.614577] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-31T18:51:25.857685] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-31T18:51:26.657673] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-31T18:51:27.160976] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:51:27.395560] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-31T18:51:27.457710] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-31T18:51:28.257683] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-31T18:51:28.569773] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T18:51:29.057686] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-31T18:51:29.504686] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T18:51:29.678730] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T18:51:29.682547] [INFO ] [REMOTE ] FTHY: Full fetch complete (17231 records). [2025-10-31T18:51:29.682686] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-31T18:51:29.863479] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-31T18:51:30.071131] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-31T18:51:30.071207] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-31T18:51:30.071583] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-31T18:51:30.071621] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-31T18:51:30.072139] [DEBUG] [LOCAL ] FTHY: Trimmed 17231 records to 12074 (keeping 200 days of data) [2025-10-31T18:51:30.143409] [DEBUG] [LOCAL ] FTHY: Primary data saved (12074 records). [2025-10-31T18:51:30.143547] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-31T18:51:30.143625] [INFO ] [MAIN ] Update Progress: 878/2365 symbols completed. FTHY took 36.3s. Estimated remaining: 3h 8m 43s. Rate: 7.9 symbols/min [2025-10-31T18:51:30.657722] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-31T18:51:30.991235] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T18:51:31.457770] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-31T18:51:31.975064] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T18:51:32.257709] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-31T18:51:32.514877] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T18:51:33.057619] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-31T18:51:33.801380] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-31T18:51:33.813558] [INFO ] [REMOTE ] FTI: Full fetch complete (77338 records). [2025-10-31T18:51:33.813731] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-31T18:51:34.225870] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-31T18:51:34.226055] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-31T18:51:34.227010] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-31T18:51:34.233581] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-31T18:51:34.246705] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T18:51:34.254694] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-31T18:51:34.255823] [DEBUG] [LOCAL ] FTI: Trimmed 77338 records to 54069 (keeping 200 days of data) [2025-10-31T18:51:34.574467] [DEBUG] [LOCAL ] FTI: Primary data saved (54069 records). [2025-10-31T18:51:34.574590] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-31T18:51:34.574688] [INFO ] [MAIN ] Update Progress: 879/2365 symbols completed. FTI took 22.3s. Estimated remaining: 3h 8m 30s. Rate: 7.9 symbols/min [2025-10-31T18:51:35.273237] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T18:51:35.280755] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-31T18:51:36.454777] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T18:51:36.462426] [INFO ] [REMOTE ] FTK: Full fetch complete (44331 records). [2025-10-31T18:51:36.462552] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-31T18:51:36.829514] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-31T18:51:36.829613] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-31T18:51:36.830344] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-31T18:51:36.830394] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-31T18:51:36.831336] [DEBUG] [LOCAL ] FTK: Trimmed 44331 records to 33716 (keeping 200 days of data) [2025-10-31T18:51:37.020221] [DEBUG] [LOCAL ] FTK: Primary data saved (33716 records). [2025-10-31T18:51:37.020372] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-31T18:51:37.020447] [INFO ] [MAIN ] Update Progress: 880/2365 symbols completed. FTK took 22.9s. Estimated remaining: 3h 8m 14s. Rate: 7.9 symbols/min [2025-10-31T18:51:37.648397] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:51:37.755115] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:51:37.752200] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:51:37.749282] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:51:37.760037] [DEBUG] [LOCAL ] FTWO: Loaded 1949 existing records from primary storage. [2025-10-31T18:51:37.760497] [INFO ] [MAIN ] FTWO: Loaded 1949 existing records. [2025-10-31T18:51:37.970604] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:51:37.988216] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-31T18:51:37.988275] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-31T18:51:37.988458] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-31T18:51:37.988517] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-31T18:51:38.147031] [DEBUG] [LOCAL ] FUBO: Loaded 54104 existing records from primary storage. [2025-10-31T18:51:38.154664] [DEBUG] [LOCAL ] FTS: Loaded 42567 existing records from primary storage. [2025-10-31T18:51:38.165807] [DEBUG] [LOCAL ] FTV: Loaded 53391 existing records from primary storage. [2025-10-31T18:51:38.195391] [INFO ] [MAIN ] FTV: Loaded 53391 existing records. [2025-10-31T18:51:38.195674] [INFO ] [MAIN ] FTS: Loaded 42567 existing records. [2025-10-31T18:51:38.206931] [INFO ] [MAIN ] FUBO: Loaded 54104 existing records. [2025-10-31T18:51:39.053800] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:51:39.092731] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:51:39.101329] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-31T18:51:39.126386] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:51:39.126788] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-31T18:51:39.132432] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-31T18:51:39.137865] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-31T18:51:39.143281] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-31T18:51:39.143616] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-31T18:51:39.154375] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-31T18:51:39.154696] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-31T18:51:39.180548] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-31T18:51:39.191549] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-31T18:51:39.221353] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-31T18:51:39.295942] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-31T18:51:39.439025] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:51:39.550693] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-31T18:51:40.130252] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-31T18:51:40.172445] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-31T18:51:40.382082] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:51:40.436704] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:51:40.476628] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:51:40.447094] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-31T18:51:40.473847] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-31T18:51:40.476929] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-31T18:51:40.560262] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-31T18:51:40.561517] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-31T18:51:40.900378] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-31T18:51:40.902187] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-31T18:51:41.194243] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-31T18:51:41.195617] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-31T18:51:41.434844] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-31T18:51:41.475688] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-31T18:51:41.650421] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T18:51:41.857682] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-31T18:51:42.623111] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-31T18:51:42.657614] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-31T18:51:42.983716] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T18:51:43.457683] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-31T18:51:44.257666] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-31T18:51:44.506045] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-31T18:51:44.536925] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-31T18:51:44.690465] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T18:51:45.057628] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-31T18:51:45.857675] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-31T18:51:46.657706] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-31T18:51:46.791870] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-31T18:51:47.177563] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T18:51:47.457625] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-31T18:51:47.656163] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T18:51:48.257631] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-31T18:51:48.800990] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-31T18:51:49.057681] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-31T18:51:49.854101] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-31T18:51:49.865425] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-31T18:51:50.402316] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T18:51:50.657688] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-31T18:51:50.900716] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T18:51:51.010027] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-31T18:51:51.457720] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-31T18:51:51.863804] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-31T18:51:52.257693] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-31T18:51:53.057694] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-31T18:51:53.407609] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T18:51:53.857673] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-31T18:51:54.408112] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T18:51:54.657680] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-31T18:51:54.913335] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T18:51:55.457705] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-31T18:51:56.257690] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-31T18:51:56.345207] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-31T18:51:56.571370] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-31T18:51:56.575471] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T18:51:57.057707] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-31T18:51:57.590450] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T18:51:57.591617] [INFO ] [REMOTE ] FTWO: Full fetch complete (3268 records). [2025-10-31T18:51:57.591737] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-31T18:51:57.862864] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-31T18:51:57.958361] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-31T18:51:57.958443] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-31T18:51:57.958567] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-31T18:51:57.958605] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-31T18:51:57.958946] [DEBUG] [LOCAL ] FTWO: Trimmed 3268 records to 1959 (keeping 200 days of data) [2025-10-31T18:51:57.970962] [DEBUG] [LOCAL ] FTWO: Primary data saved (1959 records). [2025-10-31T18:51:57.971028] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-31T18:51:57.971094] [INFO ] [MAIN ] Update Progress: 881/2365 symbols completed. FTWO took 20.9s. Estimated remaining: 3h 8m 29s. Rate: 7.9 symbols/min [2025-10-31T18:51:58.137350] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:51:58.166997] [DEBUG] [LOCAL ] FUL: Loaded 31837 existing records from primary storage. [2025-10-31T18:51:58.167252] [INFO ] [MAIN ] FUL: Loaded 31837 existing records. [2025-10-31T18:51:58.342284] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:51:58.342514] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-31T18:51:58.342562] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-31T18:51:58.342886] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-31T18:51:58.342945] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-31T18:51:58.662807] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-31T18:51:58.700514] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:51:59.258531] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-31T18:51:59.457669] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-31T18:51:59.964185] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T18:52:00.257619] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-31T18:52:00.665133] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T18:52:01.057705] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-31T18:52:01.352878] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T18:52:01.857725] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-31T18:52:02.613970] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-31T18:52:02.657617] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-31T18:52:03.354880] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T18:52:03.367016] [INFO ] [REMOTE ] FTV: Full fetch complete (76657 records). [2025-10-31T18:52:03.367146] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-31T18:52:03.463757] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-31T18:52:03.753467] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-31T18:52:03.753542] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-31T18:52:03.754423] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-31T18:52:03.754486] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-31T18:52:03.755836] [DEBUG] [LOCAL ] FTV: Trimmed 76657 records to 53781 (keeping 200 days of data) [2025-10-31T18:52:04.080081] [DEBUG] [LOCAL ] FTV: Primary data saved (53781 records). [2025-10-31T18:52:04.080201] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-31T18:52:04.080276] [INFO ] [MAIN ] Update Progress: 882/2365 symbols completed. FTV took 27.1s. Estimated remaining: 3h 8m 19s. Rate: 7.9 symbols/min [2025-10-31T18:52:04.246294] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:52:04.257679] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-31T18:52:04.293822] [DEBUG] [LOCAL ] FUN: Loaded 52489 existing records from primary storage. [2025-10-31T18:52:04.294105] [INFO ] [MAIN ] FUN: Loaded 52489 existing records. [2025-10-31T18:52:04.472032] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:52:04.472393] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-31T18:52:04.472551] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-31T18:52:04.472829] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-31T18:52:04.472881] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-31T18:52:04.726607] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-31T18:52:04.888169] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-31T18:52:04.900974] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:52:05.057605] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-31T18:52:05.177607] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T18:52:05.857695] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-31T18:52:06.514315] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T18:52:06.524392] [INFO ] [REMOTE ] FTS: Full fetch complete (61071 records). [2025-10-31T18:52:06.524505] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-31T18:52:06.662840] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-31T18:52:06.901424] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-31T18:52:06.901503] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-31T18:52:06.902299] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-31T18:52:06.902362] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-31T18:52:06.903512] [DEBUG] [LOCAL ] FTS: Trimmed 61071 records to 42909 (keeping 200 days of data) [2025-10-31T18:52:07.154033] [DEBUG] [LOCAL ] FTS: Primary data saved (42909 records). [2025-10-31T18:52:07.154149] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-31T18:52:07.154224] [INFO ] [MAIN ] Update Progress: 883/2365 symbols completed. FTS took 30.1s. Estimated remaining: 3h 8m 3s. Rate: 7.9 symbols/min [2025-10-31T18:52:07.318620] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:52:07.339572] [DEBUG] [LOCAL ] FVR: Loaded 20569 existing records from primary storage. [2025-10-31T18:52:07.339834] [INFO ] [MAIN ] FVR: Loaded 20569 existing records. [2025-10-31T18:52:07.462862] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-31T18:52:07.519624] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:52:07.520003] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-31T18:52:07.520073] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-31T18:52:07.520271] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-31T18:52:07.520319] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-31T18:52:07.923694] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:52:07.932077] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-31T18:52:07.943036] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T18:52:08.257679] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-31T18:52:08.799766] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T18:52:09.057712] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-31T18:52:09.844816] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-31T18:52:09.857611] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-31T18:52:10.243872] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T18:52:10.657687] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-31T18:52:11.457763] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-31T18:52:11.728852] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-31T18:52:12.012780] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-31T18:52:12.024864] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-10-31T18:52:12.025014] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-31T18:52:12.269482] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-31T18:52:12.423319] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-31T18:52:12.423399] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-31T18:52:12.424324] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-31T18:52:12.424385] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-31T18:52:12.425778] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 54494 (keeping 200 days of data) [2025-10-31T18:52:12.658951] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T18:52:12.764817] [DEBUG] [LOCAL ] FUBO: Primary data saved (54494 records). [2025-10-31T18:52:12.764943] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-31T18:52:12.765737] [INFO ] [MAIN ] Update Progress: 884/2365 symbols completed. FUBO took 35.7s. Estimated remaining: 3h 7m 52s. Rate: 7.9 symbols/min [2025-10-31T18:52:12.930548] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:52:12.968064] [DEBUG] [LOCAL ] FVRR: Loaded 40809 existing records from primary storage. [2025-10-31T18:52:12.968349] [INFO ] [MAIN ] FVRR: Loaded 40809 existing records. [2025-10-31T18:52:13.064102] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-31T18:52:13.143309] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:52:13.143510] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-31T18:52:13.143580] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-31T18:52:13.144040] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-31T18:52:13.144099] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-31T18:52:13.527092] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:52:13.550875] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T18:52:13.857732] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-31T18:52:14.383267] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T18:52:14.657618] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-31T18:52:14.823099] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T18:52:15.457682] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-31T18:52:15.817509] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T18:52:16.257728] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-31T18:52:16.683919] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-31T18:52:17.057699] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-31T18:52:17.546079] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T18:52:17.857624] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-31T18:52:18.272293] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T18:52:18.657710] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-31T18:52:19.326802] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T18:52:19.457567] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-31T18:52:19.607008] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T18:52:20.257687] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-31T18:52:20.484199] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T18:52:21.057618] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-31T18:52:21.243582] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-31T18:52:21.857691] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-31T18:52:22.107759] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T18:52:22.657674] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-31T18:52:23.180838] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T18:52:23.457711] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-31T18:52:23.643771] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-31T18:52:24.257710] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-31T18:52:24.882778] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-31T18:52:24.930854] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-31T18:52:25.057616] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-31T18:52:25.644820] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T18:52:25.857699] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-31T18:52:26.657674] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-31T18:52:26.875466] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-31T18:52:27.457624] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-31T18:52:28.257633] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-31T18:52:28.376545] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T18:52:28.430308] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-31T18:52:28.442309] [INFO ] [REMOTE ] FUN: Full fetch complete (73858 records). [2025-10-31T18:52:28.442440] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-31T18:52:28.850032] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-31T18:52:28.850171] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-31T18:52:28.851122] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-31T18:52:28.851188] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-31T18:52:28.852566] [DEBUG] [LOCAL ] FUN: Trimmed 73858 records to 52877 (keeping 200 days of data) [2025-10-31T18:52:29.071786] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-31T18:52:29.153934] [DEBUG] [LOCAL ] FUN: Primary data saved (52877 records). [2025-10-31T18:52:29.154067] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-31T18:52:29.154148] [INFO ] [MAIN ] Update Progress: 885/2365 symbols completed. FUN took 25.1s. Estimated remaining: 3h 7m 59s. Rate: 7.9 symbols/min [2025-10-31T18:52:29.318216] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:52:29.321797] [DEBUG] [LOCAL ] FXED: Loaded 1222 existing records from primary storage. [2025-10-31T18:52:29.321959] [INFO ] [MAIN ] FXED: Loaded 1222 existing records. [2025-10-31T18:52:29.501150] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:52:29.501505] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-31T18:52:29.501583] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-31T18:52:29.501844] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-31T18:52:29.501952] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-31T18:52:29.857446] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-31T18:52:29.865944] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-31T18:52:29.896330] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:52:29.945622] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-31T18:52:30.657665] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-31T18:52:30.964280] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T18:52:31.251010] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-31T18:52:31.457699] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-31T18:52:32.257713] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-31T18:52:32.524936] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-31T18:52:32.703163] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-31T18:52:33.057691] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-31T18:52:33.857678] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-31T18:52:34.123885] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T18:52:34.132430] [INFO ] [REMOTE ] FUL: Full fetch complete (47908 records). [2025-10-31T18:52:34.132690] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-31T18:52:34.590255] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-31T18:52:34.590588] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-31T18:52:34.591457] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-31T18:52:34.591527] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-31T18:52:34.592702] [DEBUG] [LOCAL ] FUL: Trimmed 47908 records to 32065 (keeping 200 days of data) [2025-10-31T18:52:34.660418] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-31T18:52:34.824347] [DEBUG] [LOCAL ] FUL: Primary data saved (32065 records). [2025-10-31T18:52:34.825524] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-31T18:52:34.825432] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T18:52:34.825755] [INFO ] [MAIN ] Update Progress: 886/2365 symbols completed. FUL took 36.9s. Estimated remaining: 3h 7m 49s. Rate: 7.9 symbols/min [2025-10-31T18:52:35.001185] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:52:35.003956] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-31T18:52:35.048444] [DEBUG] [LOCAL ] G: Loaded 50412 existing records from primary storage. [2025-10-31T18:52:35.048773] [INFO ] [MAIN ] G: Loaded 50412 existing records. [2025-10-31T18:52:35.220711] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:52:35.220973] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-31T18:52:35.221027] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-31T18:52:35.221403] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-31T18:52:35.221461] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-31T18:52:35.462845] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-31T18:52:35.576138] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:52:36.257636] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-31T18:52:36.509449] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-31T18:52:36.709842] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T18:52:37.057693] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-31T18:52:37.857741] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-31T18:52:38.169094] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-31T18:52:38.419227] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T18:52:38.428835] [INFO ] [REMOTE ] FVRR: Full fetch complete (59347 records). [2025-10-31T18:52:38.428940] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-31T18:52:38.662834] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-31T18:52:38.811962] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-31T18:52:38.812036] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-31T18:52:38.812855] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-31T18:52:38.812916] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-31T18:52:38.814073] [DEBUG] [LOCAL ] FVRR: Trimmed 59347 records to 41100 (keeping 200 days of data) [2025-10-31T18:52:39.055071] [DEBUG] [LOCAL ] FVRR: Primary data saved (41100 records). [2025-10-31T18:52:39.055192] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-31T18:52:39.056019] [INFO ] [MAIN ] Update Progress: 887/2365 symbols completed. FVRR took 26.3s. Estimated remaining: 3h 7m 35s. Rate: 7.9 symbols/min [2025-10-31T18:52:39.223838] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:52:39.248974] [DEBUG] [LOCAL ] GAB: Loaded 26954 existing records from primary storage. [2025-10-31T18:52:39.249222] [INFO ] [MAIN ] GAB: Loaded 26954 existing records. [2025-10-31T18:52:39.424043] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:52:39.424258] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-31T18:52:39.424304] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-31T18:52:39.424945] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-31T18:52:39.425002] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-31T18:52:39.467162] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-31T18:52:39.791377] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:52:39.849958] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T18:52:40.264273] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T18:52:40.263118] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-31T18:52:40.511356] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-31T18:52:41.057682] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-31T18:52:41.332944] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-31T18:52:41.857687] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-31T18:52:42.620575] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T18:52:42.657612] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-31T18:52:42.951739] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-31T18:52:43.457678] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-31T18:52:44.263494] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-31T18:52:44.268677] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T18:52:45.006389] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-31T18:52:45.057624] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-31T18:52:45.731749] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T18:52:45.857674] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-31T18:52:46.600027] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T18:52:46.657705] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-31T18:52:47.384037] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-31T18:52:47.388198] [INFO ] [REMOTE ] FVR: Full fetch complete (29123 records). [2025-10-31T18:52:47.388281] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-31T18:52:47.462906] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-31T18:52:47.787828] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-31T18:52:47.787929] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-31T18:52:47.788474] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-31T18:52:47.788563] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-31T18:52:47.789269] [DEBUG] [LOCAL ] FVR: Trimmed 29123 records to 20674 (keeping 200 days of data) [2025-10-31T18:52:47.914639] [DEBUG] [LOCAL ] FVR: Primary data saved (20674 records). [2025-10-31T18:52:47.914800] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-31T18:52:47.914898] [INFO ] [MAIN ] Update Progress: 888/2365 symbols completed. FVR took 40.8s. Estimated remaining: 3h 7m 30s. Rate: 7.9 symbols/min [2025-10-31T18:52:48.098388] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:52:48.103975] [DEBUG] [LOCAL ] GAM: Loaded 3724 existing records from primary storage. [2025-10-31T18:52:48.104140] [INFO ] [MAIN ] GAM: Loaded 3724 existing records. [2025-10-31T18:52:48.271861] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-31T18:52:48.318726] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:52:48.319013] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-31T18:52:48.319155] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-31T18:52:48.319439] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-31T18:52:48.319505] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-31T18:52:48.668905] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T18:52:48.715004] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:52:49.057680] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-31T18:52:49.399574] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T18:52:49.468963] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-31T18:52:49.857684] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-31T18:52:50.131966] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-31T18:52:50.657677] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-31T18:52:51.457687] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-31T18:52:51.708796] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-31T18:52:51.862605] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T18:52:52.257663] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-31T18:52:52.620817] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-31T18:52:52.621637] [INFO ] [REMOTE ] FXED: Full fetch complete (1774 records). [2025-10-31T18:52:52.621735] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-31T18:52:52.971341] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-31T18:52:52.971416] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-31T18:52:52.971497] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-31T18:52:52.971535] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-31T18:52:52.971867] [DEBUG] [LOCAL ] FXED: Trimmed 1774 records to 1232 (keeping 200 days of data) [2025-10-31T18:52:52.979588] [DEBUG] [LOCAL ] FXED: Primary data saved (1232 records). [2025-10-31T18:52:52.979679] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-31T18:52:52.979761] [INFO ] [MAIN ] Update Progress: 889/2365 symbols completed. FXED took 23.8s. Estimated remaining: 3h 7m 18s. Rate: 7.9 symbols/min [2025-10-31T18:52:53.062796] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-31T18:52:53.149965] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:52:53.195969] [DEBUG] [LOCAL ] GAP: Loaded 54043 existing records from primary storage. [2025-10-31T18:52:53.196266] [INFO ] [MAIN ] GAP: Loaded 54043 existing records. [2025-10-31T18:52:53.373739] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:52:53.373972] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-31T18:52:53.374018] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-31T18:52:53.375054] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-31T18:52:53.375110] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-31T18:52:53.630697] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T18:52:53.734910] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:52:53.857625] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-31T18:52:54.657695] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-31T18:52:55.006538] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T18:52:55.160259] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T18:52:55.457666] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-31T18:52:56.257678] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-31T18:52:56.505390] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T18:52:57.057667] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-31T18:52:57.504167] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T18:52:57.857625] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-31T18:52:57.898364] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T18:52:58.657681] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-31T18:52:59.085757] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T18:52:59.457734] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-31T18:53:00.069460] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T18:53:00.257681] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-31T18:53:00.580370] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T18:53:01.057667] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-31T18:53:01.519026] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T18:53:01.649290] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-31T18:53:01.857690] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-31T18:53:02.243484] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T18:53:02.657688] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-31T18:53:03.457695] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-31T18:53:03.837321] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-31T18:53:04.045279] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T18:53:04.257700] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-31T18:53:05.057717] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-31T18:53:05.684853] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T18:53:05.857630] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-31T18:53:05.935227] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T18:53:06.657711] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-31T18:53:07.136036] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-31T18:53:07.215754] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T18:53:07.457667] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-31T18:53:08.257730] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-31T18:53:09.055777] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T18:53:09.060073] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-31T18:53:09.068635] [INFO ] [REMOTE ] G: Full fetch complete (72432 records). [2025-10-31T18:53:09.068789] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-31T18:53:09.458990] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-31T18:53:09.459102] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-31T18:53:09.460167] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-31T18:53:09.460233] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-31T18:53:09.461623] [DEBUG] [LOCAL ] G: Trimmed 72432 records to 50779 (keeping 200 days of data) [2025-10-31T18:53:09.553514] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-31T18:53:09.788120] [DEBUG] [LOCAL ] G: Primary data saved (50779 records). [2025-10-31T18:53:09.788407] [INFO ] [MAIN ] G: Full history saved. [2025-10-31T18:53:09.788719] [INFO ] [MAIN ] Update Progress: 890/2365 symbols completed. G took 35.0s. Estimated remaining: 3h 7m 26s. Rate: 7.9 symbols/min [2025-10-31T18:53:09.865398] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-31T18:53:09.997026] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-31T18:53:10.036006] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:53:10.060754] [DEBUG] [LOCAL ] GATX: Loaded 17837 existing records from primary storage. [2025-10-31T18:53:10.061190] [INFO ] [MAIN ] GATX: Loaded 17837 existing records. [2025-10-31T18:53:10.253116] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:53:10.253399] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-31T18:53:10.253449] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-31T18:53:10.253768] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-31T18:53:10.253826] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-31T18:53:10.642779] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:53:10.657681] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-31T18:53:10.740998] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T18:53:11.457695] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-31T18:53:12.049589] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-31T18:53:12.121356] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-31T18:53:12.257698] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-31T18:53:13.057690] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-31T18:53:13.705363] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T18:53:13.766555] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T18:53:13.857692] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-31T18:53:14.657715] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-31T18:53:15.325608] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T18:53:15.362846] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T18:53:15.457684] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-31T18:53:16.107785] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T18:53:16.257629] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-31T18:53:17.057673] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-31T18:53:17.076131] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-31T18:53:17.857667] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-31T18:53:18.573055] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T18:53:18.621079] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-31T18:53:18.657712] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-31T18:53:19.457734] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-31T18:53:19.677095] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-31T18:53:19.683352] [INFO ] [REMOTE ] GAB: Full fetch complete (39185 records). [2025-10-31T18:53:19.683454] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-31T18:53:19.902979] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-31T18:53:20.146569] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-31T18:53:20.146678] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-31T18:53:20.147440] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-31T18:53:20.147484] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-31T18:53:20.148540] [DEBUG] [LOCAL ] GAB: Trimmed 39185 records to 27147 (keeping 200 days of data) [2025-10-31T18:53:20.259425] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-31T18:53:20.327977] [DEBUG] [LOCAL ] GAB: Primary data saved (27147 records). [2025-10-31T18:53:20.328147] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-31T18:53:20.328309] [INFO ] [MAIN ] Update Progress: 891/2365 symbols completed. GAB took 41.3s. Estimated remaining: 3h 7m 23s. Rate: 7.9 symbols/min [2025-10-31T18:53:20.517242] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:53:20.529415] [DEBUG] [LOCAL ] GBAB: Loaded 12337 existing records from primary storage. [2025-10-31T18:53:20.529627] [INFO ] [MAIN ] GBAB: Loaded 12337 existing records. [2025-10-31T18:53:20.700835] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:53:20.701074] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-31T18:53:20.701124] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-31T18:53:20.701457] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-31T18:53:20.701514] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-31T18:53:21.046987] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:53:21.057617] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-31T18:53:21.581774] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-31T18:53:21.857698] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-31T18:53:21.931192] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-31T18:53:22.430681] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T18:53:22.657679] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-31T18:53:23.174460] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-31T18:53:23.457676] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-31T18:53:24.135689] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-31T18:53:24.257700] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-31T18:53:24.832478] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T18:53:25.057683] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-31T18:53:25.573469] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-31T18:53:25.574938] [INFO ] [REMOTE ] GAM: Full fetch complete (6395 records). [2025-10-31T18:53:25.575005] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-31T18:53:25.862882] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-31T18:53:25.964210] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-31T18:53:25.964293] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-31T18:53:25.964464] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-31T18:53:25.964501] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-31T18:53:25.964895] [DEBUG] [LOCAL ] GAM: Trimmed 6395 records to 3740 (keeping 200 days of data) [2025-10-31T18:53:25.985949] [DEBUG] [LOCAL ] GAM: Primary data saved (3740 records). [2025-10-31T18:53:25.986028] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-31T18:53:25.986100] [INFO ] [MAIN ] Update Progress: 892/2365 symbols completed. GAM took 38.1s. Estimated remaining: 3h 7m 12s. Rate: 7.9 symbols/min [2025-10-31T18:53:26.157165] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:53:26.192632] [DEBUG] [LOCAL ] GBCI: Loaded 41369 existing records from primary storage. [2025-10-31T18:53:26.192958] [INFO ] [MAIN ] GBCI: Loaded 41369 existing records. [2025-10-31T18:53:26.367315] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:53:26.367538] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-31T18:53:26.367585] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-31T18:53:26.368488] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-31T18:53:26.368546] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-31T18:53:26.658847] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-31T18:53:26.660031] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T18:53:26.741980] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:53:27.457666] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-31T18:53:27.474384] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-31T18:53:28.257704] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-31T18:53:28.871698] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-31T18:53:29.057731] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-31T18:53:29.111290] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T18:53:29.125558] [INFO ] [REMOTE ] GAP: Full fetch complete (77815 records). [2025-10-31T18:53:29.125807] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-31T18:53:29.542050] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-31T18:53:29.542164] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-31T18:53:29.543601] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-31T18:53:29.543695] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-31T18:53:29.545977] [DEBUG] [LOCAL ] GAP: Trimmed 77815 records to 54433 (keeping 200 days of data) [2025-10-31T18:53:29.858419] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-31T18:53:29.911298] [DEBUG] [LOCAL ] GAP: Primary data saved (54433 records). [2025-10-31T18:53:29.911509] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-31T18:53:29.911612] [INFO ] [MAIN ] Update Progress: 893/2365 symbols completed. GAP took 36.9s. Estimated remaining: 3h 6m 58s. Rate: 7.9 symbols/min [2025-10-31T18:53:30.090318] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:53:30.090595] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-31T18:53:30.090679] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-31T18:53:30.090810] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-31T18:53:30.090855] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-31T18:53:30.090898] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-31T18:53:30.090935] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-31T18:53:30.465409] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-31T18:53:30.495812] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:53:30.522777] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-31T18:53:30.657622] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-31T18:53:31.457665] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-31T18:53:31.686534] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T18:53:32.081395] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-31T18:53:32.257679] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-31T18:53:33.004713] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-31T18:53:33.057665] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-31T18:53:33.717221] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T18:53:33.857626] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-31T18:53:34.078018] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-31T18:53:34.657673] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-31T18:53:34.849303] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.19 seconds). [2025-10-31T18:53:35.457682] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-31T18:53:35.992487] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-31T18:53:36.257722] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-31T18:53:36.965082] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T18:53:36.967956] [INFO ] [REMOTE ] GBAB: Full fetch complete (18405 records). [2025-10-31T18:53:36.968064] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-31T18:53:37.063567] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-31T18:53:37.339369] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-31T18:53:37.339450] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-31T18:53:37.339913] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-31T18:53:37.339977] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-31T18:53:37.340622] [DEBUG] [LOCAL ] GBAB: Trimmed 18405 records to 12389 (keeping 200 days of data) [2025-10-31T18:53:37.425740] [DEBUG] [LOCAL ] GBAB: Primary data saved (12389 records). [2025-10-31T18:53:37.425867] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-31T18:53:37.425946] [INFO ] [MAIN ] Update Progress: 894/2365 symbols completed. GBAB took 17.1s. Estimated remaining: 3h 6m 50s. Rate: 7.9 symbols/min [2025-10-31T18:53:37.633389] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:53:37.667044] [DEBUG] [LOCAL ] GBTG: Loaded 40152 existing records from primary storage. [2025-10-31T18:53:37.667318] [INFO ] [MAIN ] GBTG: Loaded 40152 existing records. [2025-10-31T18:53:37.844622] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:53:37.845043] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-31T18:53:37.845113] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-31T18:53:37.850834] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-31T18:53:37.857826] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T18:53:37.857312] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-31T18:53:37.858028] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-31T18:53:38.217094] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:53:38.217281] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-31T18:53:38.657681] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-31T18:53:39.457681] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-31T18:53:39.713345] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T18:53:39.740053] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-31T18:53:40.257685] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-31T18:53:41.057638] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-31T18:53:41.173553] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T18:53:41.177800] [INFO ] [REMOTE ] GATX: Full fetch complete (25144 records). [2025-10-31T18:53:41.177927] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-31T18:53:41.544939] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-31T18:53:41.545014] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-31T18:53:41.545516] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-31T18:53:41.545555] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-31T18:53:41.546188] [DEBUG] [LOCAL ] GATX: Trimmed 25144 records to 17958 (keeping 200 days of data) [2025-10-31T18:53:41.656304] [DEBUG] [LOCAL ] GATX: Primary data saved (17958 records). [2025-10-31T18:53:41.656434] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-31T18:53:41.656510] [INFO ] [MAIN ] Update Progress: 895/2365 symbols completed. GATX took 31.9s. Estimated remaining: 3h 6m 37s. Rate: 7.9 symbols/min [2025-10-31T18:53:41.836969] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:53:41.861153] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-31T18:53:41.862352] [DEBUG] [LOCAL ] GBX: Loaded 27847 existing records from primary storage. [2025-10-31T18:53:41.862550] [INFO ] [MAIN ] GBX: Loaded 27847 existing records. [2025-10-31T18:53:42.037515] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:53:42.037787] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-31T18:53:42.037842] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-31T18:53:42.038560] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-31T18:53:42.038616] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-31T18:53:42.222282] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-31T18:53:42.407789] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:53:42.430727] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T18:53:42.657664] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-31T18:53:43.457638] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-31T18:53:43.619281] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-31T18:53:43.635705] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.18 seconds). [2025-10-31T18:53:44.257659] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-31T18:53:45.057723] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-31T18:53:45.228569] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T18:53:45.268236] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-31T18:53:45.857630] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-31T18:53:46.150478] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-31T18:53:46.657636] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-31T18:53:46.895080] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-31T18:53:47.457680] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-31T18:53:48.257679] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-31T18:53:48.496803] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T18:53:49.057611] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-31T18:53:49.168159] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T18:53:49.857731] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-31T18:53:50.162269] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-31T18:53:50.193098] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-31T18:53:50.193863] [INFO ] [REMOTE ] GBLI: Full fetch complete (1254 records). [2025-10-31T18:53:50.193929] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-31T18:53:50.366922] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-31T18:53:50.367083] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-31T18:53:50.367128] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-31T18:53:50.367189] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-31T18:53:50.367249] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-31T18:53:50.367290] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-31T18:53:50.367331] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-31T18:53:50.367423] [INFO ] [MAIN ] Update Progress: 896/2365 symbols completed. GBLI took 20.5s. Estimated remaining: 3h 6m 31s. Rate: 7.9 symbols/min [2025-10-31T18:53:50.531503] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:53:50.567564] [DEBUG] [LOCAL ] GCI: Loaded 43891 existing records from primary storage. [2025-10-31T18:53:50.567906] [INFO ] [MAIN ] GCI: Loaded 43891 existing records. [2025-10-31T18:53:50.662778] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-31T18:53:50.741715] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:53:50.741963] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-31T18:53:50.742009] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-31T18:53:50.742755] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-31T18:53:50.742812] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-31T18:53:51.102217] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:53:51.457606] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-31T18:53:51.626400] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T18:53:52.257695] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-31T18:53:52.606207] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T18:53:53.057709] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-31T18:53:53.156697] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-31T18:53:53.857672] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-31T18:53:54.139965] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T18:53:54.657633] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-31T18:53:54.699487] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-31T18:53:55.457682] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-31T18:53:55.636489] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T18:53:56.257678] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-31T18:53:56.572125] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T18:53:57.057613] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-31T18:53:57.195605] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T18:53:57.857717] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-31T18:53:58.532370] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-31T18:53:58.543483] [INFO ] [REMOTE ] GBCI: Full fetch complete (59517 records). [2025-10-31T18:53:58.543682] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-31T18:53:58.662745] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-31T18:53:58.951311] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-31T18:53:58.951395] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-31T18:53:58.952293] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-31T18:53:58.952355] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-31T18:53:58.953935] [DEBUG] [LOCAL ] GBCI: Trimmed 59517 records to 41725 (keeping 200 days of data) [2025-10-31T18:53:59.103917] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T18:53:59.241946] [DEBUG] [LOCAL ] GBCI: Primary data saved (41725 records). [2025-10-31T18:53:59.242075] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-31T18:53:59.242719] [INFO ] [MAIN ] Update Progress: 897/2365 symbols completed. GBCI took 33.3s. Estimated remaining: 3h 6m 26s. Rate: 7.9 symbols/min [2025-10-31T18:53:59.415516] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:53:59.435841] [DEBUG] [LOCAL ] GCO: Loaded 21824 existing records from primary storage. [2025-10-31T18:53:59.436079] [INFO ] [MAIN ] GCO: Loaded 21824 existing records. [2025-10-31T18:53:59.467349] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-31T18:53:59.627568] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:53:59.627868] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-31T18:53:59.627950] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-31T18:53:59.628354] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-31T18:53:59.628410] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-31T18:54:00.020584] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T18:54:00.024217] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:54:00.257627] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-31T18:54:00.293471] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T18:54:01.057638] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-31T18:54:01.344380] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T18:54:01.857665] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-31T18:54:02.145425] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T18:54:02.657689] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-31T18:54:02.706749] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T18:54:03.457624] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-31T18:54:03.486142] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T18:54:04.257695] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-31T18:54:04.558272] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T18:54:05.045535] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T18:54:05.057614] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-31T18:54:05.857709] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-31T18:54:06.213834] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T18:54:06.657619] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-31T18:54:06.863421] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T18:54:07.311424] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T18:54:07.457683] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-31T18:54:08.257689] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-31T18:54:08.635035] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T18:54:09.057724] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-31T18:54:09.620578] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T18:54:09.857678] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-31T18:54:10.271468] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T18:54:10.657711] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-31T18:54:10.843314] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-31T18:54:11.457669] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-31T18:54:11.775741] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T18:54:12.257697] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-31T18:54:12.345703] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T18:54:13.057740] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-31T18:54:13.311224] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T18:54:13.857698] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-31T18:54:14.042245] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-31T18:54:14.050529] [INFO ] [REMOTE ] GBX: Full fetch complete (42686 records). [2025-10-31T18:54:14.050841] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-31T18:54:14.444440] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-31T18:54:14.444526] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-31T18:54:14.445218] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-31T18:54:14.445281] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-31T18:54:14.446313] [DEBUG] [LOCAL ] GBX: Trimmed 42686 records to 28154 (keeping 200 days of data) [2025-10-31T18:54:14.611756] [DEBUG] [LOCAL ] GBX: Primary data saved (28154 records). [2025-10-31T18:54:14.611892] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-31T18:54:14.611970] [INFO ] [MAIN ] Update Progress: 898/2365 symbols completed. GBX took 33.0s. Estimated remaining: 3h 6m 31s. Rate: 7.9 symbols/min [2025-10-31T18:54:14.673558] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-31T18:54:14.785259] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:54:14.805774] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-31T18:54:14.828881] [DEBUG] [LOCAL ] GCTS: Loaded 20289 existing records from primary storage. [2025-10-31T18:54:14.829139] [INFO ] [MAIN ] GCTS: Loaded 20289 existing records. [2025-10-31T18:54:15.001129] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:54:15.001361] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-31T18:54:15.001408] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-31T18:54:15.001827] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-31T18:54:15.001889] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-31T18:54:15.350100] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:54:15.457608] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-31T18:54:15.772746] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T18:54:15.954710] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-31T18:54:16.257679] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-31T18:54:16.986041] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T18:54:17.057705] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-31T18:54:17.685030] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T18:54:17.857615] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-31T18:54:18.529950] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-31T18:54:18.657677] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-31T18:54:19.311475] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T18:54:19.457671] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-31T18:54:20.257692] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-31T18:54:20.568271] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T18:54:20.577372] [INFO ] [REMOTE ] GBTG: Full fetch complete (56943 records). [2025-10-31T18:54:20.577492] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-31T18:54:20.952400] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-31T18:54:20.952594] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-31T18:54:20.953416] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-31T18:54:20.953491] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-31T18:54:20.959989] [DEBUG] [LOCAL ] GBTG: Trimmed 56943 records to 40376 (keeping 200 days of data) [2025-10-31T18:54:20.967956] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T18:54:21.057785] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-31T18:54:21.192057] [DEBUG] [LOCAL ] GBTG: Primary data saved (40376 records). [2025-10-31T18:54:21.192189] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-31T18:54:21.192896] [INFO ] [MAIN ] Update Progress: 899/2365 symbols completed. GBTG took 43.8s. Estimated remaining: 3h 6m 21s. Rate: 7.9 symbols/min [2025-10-31T18:54:21.358132] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:54:21.367872] [DEBUG] [LOCAL ] GCV: Loaded 8048 existing records from primary storage. [2025-10-31T18:54:21.368120] [INFO ] [MAIN ] GCV: Loaded 8048 existing records. [2025-10-31T18:54:21.546313] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:54:21.546690] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-31T18:54:21.546748] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-31T18:54:21.547081] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-31T18:54:21.547141] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-31T18:54:21.865234] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-31T18:54:21.929680] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:54:21.945675] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T18:54:22.657613] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-31T18:54:22.700628] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T18:54:23.033694] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-31T18:54:23.457700] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-31T18:54:24.257670] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-31T18:54:24.569271] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T18:54:24.883173] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T18:54:24.886980] [INFO ] [REMOTE ] GCO: Full fetch complete (34216 records). [2025-10-31T18:54:24.887073] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-31T18:54:25.059062] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-31T18:54:25.257120] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-31T18:54:25.257222] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-31T18:54:25.257831] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-31T18:54:25.257919] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-31T18:54:25.258718] [DEBUG] [LOCAL ] GCO: Trimmed 34216 records to 21932 (keeping 200 days of data) [2025-10-31T18:54:25.385249] [DEBUG] [LOCAL ] GCO: Primary data saved (21932 records). [2025-10-31T18:54:25.385374] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-31T18:54:25.385453] [INFO ] [MAIN ] Update Progress: 900/2365 symbols completed. GCO took 26.1s. Estimated remaining: 3h 6m 8s. Rate: 7.9 symbols/min [2025-10-31T18:54:25.535881] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-31T18:54:25.568340] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:54:25.607822] [DEBUG] [LOCAL ] GD: Loaded 46662 existing records from primary storage. [2025-10-31T18:54:25.608149] [INFO ] [MAIN ] GD: Loaded 46662 existing records. [2025-10-31T18:54:25.779811] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:54:25.780035] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-31T18:54:25.780081] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-31T18:54:25.780913] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-31T18:54:25.780969] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-31T18:54:25.862858] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-31T18:54:26.135986] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:54:26.657633] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-31T18:54:26.847523] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-31T18:54:27.053277] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T18:54:27.457690] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-31T18:54:28.257746] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-31T18:54:28.951441] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T18:54:29.056749] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T18:54:29.060788] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-31T18:54:29.570390] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-31T18:54:29.857677] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-31T18:54:30.657696] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-31T18:54:31.417377] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T18:54:31.457612] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-31T18:54:31.514371] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-31T18:54:32.233863] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T18:54:32.257685] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-31T18:54:32.679469] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-31T18:54:33.057659] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-31T18:54:33.857710] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-31T18:54:34.281512] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-31T18:54:34.343538] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T18:54:34.657678] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-31T18:54:35.225158] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-31T18:54:35.457689] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-31T18:54:36.257700] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-31T18:54:36.865816] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T18:54:37.057733] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-31T18:54:37.775758] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-31T18:54:37.857606] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-31T18:54:37.886508] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-31T18:54:37.891050] [INFO ] [REMOTE ] GCTS: Full fetch complete (26830 records). [2025-10-31T18:54:37.891133] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-31T18:54:38.258942] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-31T18:54:38.259024] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-31T18:54:38.259543] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-31T18:54:38.259584] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-31T18:54:38.260317] [DEBUG] [LOCAL ] GCTS: Trimmed 26830 records to 20490 (keeping 200 days of data) [2025-10-31T18:54:38.370805] [DEBUG] [LOCAL ] GCTS: Primary data saved (20490 records). [2025-10-31T18:54:38.370919] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-31T18:54:38.370991] [INFO ] [MAIN ] Update Progress: 901/2365 symbols completed. GCTS took 23.8s. Estimated remaining: 3h 6m 9s. Rate: 7.9 symbols/min [2025-10-31T18:54:38.538675] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:54:38.581571] [DEBUG] [LOCAL ] GDDY: Loaded 49749 existing records from primary storage. [2025-10-31T18:54:38.581935] [INFO ] [MAIN ] GDDY: Loaded 49749 existing records. [2025-10-31T18:54:38.662747] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-31T18:54:38.767063] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:54:38.767287] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-31T18:54:38.767335] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-31T18:54:38.768414] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-31T18:54:38.768473] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-31T18:54:39.131772] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:54:39.402789] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T18:54:39.457680] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-31T18:54:39.819161] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T18:54:39.933392] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T18:54:40.257690] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-31T18:54:41.057757] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-31T18:54:41.525703] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-31T18:54:41.857710] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-31T18:54:42.376493] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T18:54:42.386551] [INFO ] [REMOTE ] GCI: Full fetch complete (63500 records). [2025-10-31T18:54:42.386706] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-31T18:54:42.663316] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-31T18:54:42.785938] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-31T18:54:42.786017] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-31T18:54:42.786923] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-31T18:54:42.786987] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-31T18:54:42.788239] [DEBUG] [LOCAL ] GCI: Trimmed 63500 records to 44280 (keeping 200 days of data) [2025-10-31T18:54:43.092326] [DEBUG] [LOCAL ] GCI: Primary data saved (44280 records). [2025-10-31T18:54:43.094275] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-31T18:54:43.094147] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T18:54:43.094477] [INFO ] [MAIN ] Update Progress: 902/2365 symbols completed. GCI took 52.7s. Estimated remaining: 3h 5m 57s. Rate: 7.9 symbols/min [2025-10-31T18:54:43.286292] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:54:43.287284] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-31T18:54:43.294898] [DEBUG] [LOCAL ] GDIV: Loaded 3418 existing records from primary storage. [2025-10-31T18:54:43.295113] [INFO ] [MAIN ] GDIV: Loaded 3418 existing records. [2025-10-31T18:54:43.471161] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-31T18:54:43.518991] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:54:43.519364] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-31T18:54:43.519417] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-31T18:54:43.519607] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-31T18:54:43.519689] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-31T18:54:43.872665] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:54:44.257728] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-31T18:54:45.057615] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-31T18:54:45.165177] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-31T18:54:45.520259] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T18:54:45.601282] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-31T18:54:45.604100] [INFO ] [REMOTE ] GCV: Full fetch complete (10339 records). [2025-10-31T18:54:45.604173] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-31T18:54:45.862925] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-31T18:54:45.952898] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-31T18:54:45.952963] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-31T18:54:45.953187] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-31T18:54:45.953225] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-31T18:54:45.953625] [DEBUG] [LOCAL ] GCV: Trimmed 10339 records to 8074 (keeping 200 days of data) [2025-10-31T18:54:45.998048] [DEBUG] [LOCAL ] GCV: Primary data saved (8074 records). [2025-10-31T18:54:45.998164] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-31T18:54:45.998241] [INFO ] [MAIN ] Update Progress: 903/2365 symbols completed. GCV took 24.8s. Estimated remaining: 3h 5m 42s. Rate: 7.9 symbols/min [2025-10-31T18:54:46.163112] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:54:46.167676] [DEBUG] [LOCAL ] GDL: Loaded 2535 existing records from primary storage. [2025-10-31T18:54:46.167823] [INFO ] [MAIN ] GDL: Loaded 2535 existing records. [2025-10-31T18:54:46.342737] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:54:46.343020] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-31T18:54:46.343091] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-31T18:54:46.343235] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-31T18:54:46.343289] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-31T18:54:46.662757] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-31T18:54:46.691166] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:54:47.443119] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-31T18:54:47.457598] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-31T18:54:47.917359] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T18:54:48.257634] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-31T18:54:48.982738] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-31T18:54:49.057622] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-31T18:54:49.555107] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T18:54:49.857624] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-31T18:54:50.217318] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-31T18:54:50.340171] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T18:54:50.657694] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-31T18:54:51.105691] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-31T18:54:51.457660] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-31T18:54:52.257731] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-31T18:54:52.674780] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T18:54:52.697828] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-31T18:54:53.057609] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-31T18:54:53.390025] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-31T18:54:53.857693] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-31T18:54:54.497288] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T18:54:54.507363] [INFO ] [REMOTE ] GD: Full fetch complete (69489 records). [2025-10-31T18:54:54.507476] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-31T18:54:54.666024] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-31T18:54:54.896541] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-31T18:54:54.896629] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-31T18:54:54.897516] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-31T18:54:54.897612] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-31T18:54:54.899047] [DEBUG] [LOCAL ] GD: Trimmed 69489 records to 46959 (keeping 200 days of data) [2025-10-31T18:54:55.212753] [DEBUG] [LOCAL ] GD: Primary data saved (46959 records). [2025-10-31T18:54:55.212916] [INFO ] [MAIN ] GD: Full history saved. [2025-10-31T18:54:55.213737] [INFO ] [MAIN ] Update Progress: 904/2365 symbols completed. GD took 29.8s. Estimated remaining: 3h 5m 37s. Rate: 7.9 symbols/min [2025-10-31T18:54:55.340676] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T18:54:55.410527] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:54:55.418456] [DEBUG] [LOCAL ] GDO: Loaded 5787 existing records from primary storage. [2025-10-31T18:54:55.418681] [INFO ] [MAIN ] GDO: Loaded 5787 existing records. [2025-10-31T18:54:55.462717] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-31T18:54:55.600026] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:54:55.600221] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-31T18:54:55.600276] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-31T18:54:55.600507] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-31T18:54:55.600562] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-31T18:54:55.949834] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T18:54:55.954727] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:54:56.257632] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-31T18:54:56.623085] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T18:54:57.057666] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-31T18:54:57.857686] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-31T18:54:58.259131] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T18:54:58.288401] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-31T18:54:58.657670] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-31T18:54:59.457666] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-31T18:54:59.824031] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-31T18:55:00.111240] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-31T18:55:00.257609] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-31T18:55:01.057686] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-31T18:55:01.593745] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T18:55:01.718096] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-31T18:55:01.857722] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-31T18:55:02.192952] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-31T18:55:02.657689] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-31T18:55:03.092091] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T18:55:03.457677] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-31T18:55:03.775957] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-31T18:55:04.257675] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-31T18:55:05.057691] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-31T18:55:05.516381] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-31T18:55:05.686509] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-31T18:55:05.857676] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-31T18:55:06.657685] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-31T18:55:07.033415] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-31T18:55:07.426783] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T18:55:07.438049] [INFO ] [REMOTE ] GDDY: Full fetch complete (72062 records). [2025-10-31T18:55:07.438213] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-31T18:55:07.467758] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-31T18:55:07.834588] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-31T18:55:07.834703] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-31T18:55:07.835578] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-31T18:55:07.835620] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-31T18:55:07.836914] [DEBUG] [LOCAL ] GDDY: Trimmed 72062 records to 50122 (keeping 200 days of data) [2025-10-31T18:55:07.898719] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-31T18:55:08.143050] [DEBUG] [LOCAL ] GDDY: Primary data saved (50122 records). [2025-10-31T18:55:08.143222] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-31T18:55:08.143307] [INFO ] [MAIN ] Update Progress: 905/2365 symbols completed. GDDY took 29.8s. Estimated remaining: 3h 5m 38s. Rate: 7.9 symbols/min [2025-10-31T18:55:08.262808] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-31T18:55:08.310062] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:55:08.342873] [DEBUG] [LOCAL ] GDOT: Loaded 37482 existing records from primary storage. [2025-10-31T18:55:08.343154] [INFO ] [MAIN ] GDOT: Loaded 37482 existing records. [2025-10-31T18:55:08.520818] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:55:08.521045] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-31T18:55:08.521092] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-31T18:55:08.521750] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-31T18:55:08.521808] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-31T18:55:08.705191] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-31T18:55:08.892188] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:55:09.057661] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-31T18:55:09.405330] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-31T18:55:09.857671] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-31T18:55:10.184687] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-31T18:55:10.657621] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-31T18:55:11.186410] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T18:55:11.187634] [INFO ] [REMOTE ] GDIV: Full fetch complete (5356 records). [2025-10-31T18:55:11.187725] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-31T18:55:11.462774] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-31T18:55:11.544958] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-31T18:55:11.545046] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-31T18:55:11.545236] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-31T18:55:11.545276] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-31T18:55:11.545685] [DEBUG] [LOCAL ] GDIV: Trimmed 5356 records to 3436 (keeping 200 days of data) [2025-10-31T18:55:11.567155] [DEBUG] [LOCAL ] GDIV: Primary data saved (3436 records). [2025-10-31T18:55:11.567278] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-31T18:55:11.567353] [INFO ] [MAIN ] Update Progress: 906/2365 symbols completed. GDIV took 28.5s. Estimated remaining: 3h 5m 23s. Rate: 7.9 symbols/min [2025-10-31T18:55:11.737261] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:55:11.754356] [DEBUG] [LOCAL ] GDV: Loaded 18819 existing records from primary storage. [2025-10-31T18:55:11.754628] [INFO ] [MAIN ] GDV: Loaded 18819 existing records. [2025-10-31T18:55:11.931899] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:55:11.932104] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-31T18:55:11.932151] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-31T18:55:11.932591] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-31T18:55:11.932686] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-31T18:55:12.268236] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-31T18:55:12.294128] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:55:12.312214] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T18:55:12.698996] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-31T18:55:13.057673] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-31T18:55:13.808944] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T18:55:13.857608] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-31T18:55:14.546526] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-31T18:55:14.657614] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-31T18:55:15.457730] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-31T18:55:15.550110] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-31T18:55:16.153136] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T18:55:16.257625] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-31T18:55:16.976141] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-31T18:55:17.057665] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-31T18:55:17.462319] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T18:55:17.857670] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-31T18:55:18.633902] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T18:55:18.657665] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-31T18:55:19.457632] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-31T18:55:19.509175] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-31T18:55:20.012710] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-31T18:55:20.013805] [INFO ] [REMOTE ] GDL: Full fetch complete (3461 records). [2025-10-31T18:55:20.013894] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-31T18:55:20.262851] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-31T18:55:20.379344] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-31T18:55:20.379429] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-31T18:55:20.379576] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-31T18:55:20.379664] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-31T18:55:20.380026] [DEBUG] [LOCAL ] GDL: Trimmed 3461 records to 2544 (keeping 200 days of data) [2025-10-31T18:55:20.394988] [DEBUG] [LOCAL ] GDL: Primary data saved (2544 records). [2025-10-31T18:55:20.395052] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-31T18:55:20.395120] [INFO ] [MAIN ] Update Progress: 907/2365 symbols completed. GDL took 34.4s. Estimated remaining: 3h 5m 18s. Rate: 7.9 symbols/min [2025-10-31T18:55:20.589871] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:55:20.636862] [DEBUG] [LOCAL ] GE: Loaded 54076 existing records from primary storage. [2025-10-31T18:55:20.637156] [INFO ] [MAIN ] GE: Loaded 54076 existing records. [2025-10-31T18:55:20.817971] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-31T18:55:20.821716] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:55:20.824316] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-31T18:55:20.824372] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-31T18:55:20.825365] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-31T18:55:20.825425] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-31T18:55:21.062902] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-31T18:55:21.174523] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:55:21.588407] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T18:55:21.857638] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-31T18:55:22.657674] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-31T18:55:23.457623] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-31T18:55:23.593441] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-31T18:55:23.791578] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-31T18:55:24.257741] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-31T18:55:24.401270] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-31T18:55:24.580079] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-31T18:55:25.057694] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-31T18:55:25.469107] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T18:55:25.857712] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-31T18:55:26.565302] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T18:55:26.657743] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-31T18:55:27.005405] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-31T18:55:27.457731] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-31T18:55:28.257680] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-31T18:55:29.057682] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-31T18:55:29.090087] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-31T18:55:29.421714] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T18:55:29.466571] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T18:55:29.857677] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-31T18:55:30.657725] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-31T18:55:31.457624] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-31T18:55:31.599420] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-31T18:55:31.720120] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T18:55:32.063955] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T18:55:32.065770] [INFO ] [REMOTE ] GDO: Full fetch complete (8378 records). [2025-10-31T18:55:32.065838] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-31T18:55:32.257797] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-31T18:55:32.422555] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-31T18:55:32.422627] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-31T18:55:32.422873] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-31T18:55:32.422921] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-31T18:55:32.423296] [DEBUG] [LOCAL ] GDO: Trimmed 8378 records to 5846 (keeping 200 days of data) [2025-10-31T18:55:32.457176] [DEBUG] [LOCAL ] GDO: Primary data saved (5846 records). [2025-10-31T18:55:32.457263] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-31T18:55:32.457335] [INFO ] [MAIN ] Update Progress: 908/2365 symbols completed. GDO took 37.2s. Estimated remaining: 3h 5m 17s. Rate: 7.9 symbols/min [2025-10-31T18:55:32.624439] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:55:32.643099] [DEBUG] [LOCAL ] GEF: Loaded 20694 existing records from primary storage. [2025-10-31T18:55:32.643349] [INFO ] [MAIN ] GEF: Loaded 20694 existing records. [2025-10-31T18:55:32.822463] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:55:32.822722] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-31T18:55:32.822775] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-31T18:55:32.823201] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-31T18:55:32.823257] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-31T18:55:33.062850] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-31T18:55:33.178270] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:55:33.838791] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T18:55:33.857611] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-31T18:55:34.289873] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-31T18:55:34.657618] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-31T18:55:34.688490] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-31T18:55:34.693466] [INFO ] [REMOTE ] GDV: Full fetch complete (28076 records). [2025-10-31T18:55:34.693564] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-31T18:55:35.057587] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-31T18:55:35.057687] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-31T18:55:35.058215] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-31T18:55:35.058276] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-31T18:55:35.058931] [DEBUG] [LOCAL ] GDV: Trimmed 28076 records to 18916 (keeping 200 days of data) [2025-10-31T18:55:35.168427] [DEBUG] [LOCAL ] GDV: Primary data saved (18916 records). [2025-10-31T18:55:35.168544] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-31T18:55:35.168619] [INFO ] [MAIN ] Update Progress: 909/2365 symbols completed. GDV took 23.6s. Estimated remaining: 3h 5m 2s. Rate: 7.9 symbols/min [2025-10-31T18:55:35.333327] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:55:35.361755] [DEBUG] [LOCAL ] GEL: Loaded 30810 existing records from primary storage. [2025-10-31T18:55:35.362020] [INFO ] [MAIN ] GEL: Loaded 30810 existing records. [2025-10-31T18:55:35.460665] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-31T18:55:35.540902] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:55:35.541118] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-31T18:55:35.541169] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-31T18:55:35.541760] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-31T18:55:35.541815] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-31T18:55:35.886338] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:55:36.241782] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T18:55:36.257630] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-31T18:55:36.471087] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-31T18:55:36.951319] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-31T18:55:37.057631] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-31T18:55:37.655910] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-31T18:55:37.857634] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-31T18:55:38.657682] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-31T18:55:39.014609] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T18:55:39.457692] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-31T18:55:39.661087] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T18:55:40.257716] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-31T18:55:40.667175] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T18:55:41.057917] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-31T18:55:41.061348] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-31T18:55:41.857713] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-31T18:55:42.123980] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T18:55:42.657720] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-31T18:55:42.900770] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T18:55:43.134868] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-31T18:55:43.457665] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-31T18:55:44.257686] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-31T18:55:44.754445] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T18:55:45.057676] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-31T18:55:45.462864] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T18:55:45.857629] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-31T18:55:46.031710] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T18:55:46.657717] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-31T18:55:46.890693] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-31T18:55:47.457681] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-31T18:55:47.864673] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-31T18:55:47.873145] [INFO ] [REMOTE ] GDOT: Full fetch complete (53658 records). [2025-10-31T18:55:47.873252] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-31T18:55:48.260472] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-31T18:55:48.299795] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-31T18:55:48.299987] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-31T18:55:48.300939] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-31T18:55:48.301265] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-31T18:55:48.302536] [DEBUG] [LOCAL ] GDOT: Trimmed 53658 records to 37727 (keeping 200 days of data) [2025-10-31T18:55:48.436541] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T18:55:48.556715] [DEBUG] [LOCAL ] GDOT: Primary data saved (37727 records). [2025-10-31T18:55:48.556870] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-31T18:55:48.556957] [INFO ] [MAIN ] Update Progress: 910/2365 symbols completed. GDOT took 40.4s. Estimated remaining: 3h 5m 3s. Rate: 7.9 symbols/min [2025-10-31T18:55:48.766588] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:55:48.818660] [DEBUG] [LOCAL ] GENI: Loaded 53245 existing records from primary storage. [2025-10-31T18:55:48.818999] [INFO ] [MAIN ] GENI: Loaded 53245 existing records. [2025-10-31T18:55:48.998164] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:55:48.998421] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-31T18:55:48.998510] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-31T18:55:48.999574] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-31T18:55:48.999639] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-31T18:55:49.062910] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-31T18:55:49.356172] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:55:49.487789] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T18:55:49.857630] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-31T18:55:49.986506] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T18:55:50.657683] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-31T18:55:51.457724] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-31T18:55:51.472537] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-31T18:55:51.653493] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-31T18:55:52.257676] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-31T18:55:52.489548] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T18:55:53.057680] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-31T18:55:53.624210] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T18:55:53.857690] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-31T18:55:54.657729] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-31T18:55:54.968319] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-31T18:55:55.150841] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T18:55:55.457677] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-31T18:55:55.681084] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T18:55:56.257636] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-31T18:55:57.057631] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-31T18:55:57.125685] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T18:55:57.131787] [INFO ] [REMOTE ] GEF: Full fetch complete (29391 records). [2025-10-31T18:55:57.132085] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-31T18:55:57.509773] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-31T18:55:57.509878] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-31T18:55:57.510434] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-31T18:55:57.510558] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-31T18:55:57.539894] [DEBUG] [LOCAL ] GEF: Trimmed 29391 records to 20833 (keeping 200 days of data) [2025-10-31T18:55:57.542164] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-31T18:55:57.674153] [DEBUG] [LOCAL ] GEF: Primary data saved (20833 records). [2025-10-31T18:55:57.674276] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-31T18:55:57.674351] [INFO ] [MAIN ] Update Progress: 911/2365 symbols completed. GEF took 25.2s. Estimated remaining: 3h 4m 58s. Rate: 7.9 symbols/min [2025-10-31T18:55:57.837992] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:55:57.864254] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-31T18:55:57.886076] [DEBUG] [LOCAL ] GEO: Loaded 51899 existing records from primary storage. [2025-10-31T18:55:57.886378] [INFO ] [MAIN ] GEO: Loaded 51899 existing records. [2025-10-31T18:55:58.062049] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:55:58.062377] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-31T18:55:58.062435] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-31T18:55:58.062827] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-31T18:55:58.062893] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-31T18:55:58.393877] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T18:55:58.453411] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:55:58.657669] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-31T18:55:59.359675] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-31T18:55:59.457623] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-31T18:56:00.257617] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-31T18:56:00.289094] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-31T18:56:01.057705] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-31T18:56:01.400669] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T18:56:01.643015] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-31T18:56:01.857693] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-31T18:56:02.509043] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T18:56:02.657631] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-31T18:56:02.724282] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T18:56:02.730145] [INFO ] [REMOTE ] GEL: Full fetch complete (47819 records). [2025-10-31T18:56:02.730289] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-31T18:56:03.103386] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-31T18:56:03.103466] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-31T18:56:03.104169] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-31T18:56:03.104231] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-31T18:56:03.105248] [DEBUG] [LOCAL ] GEL: Trimmed 47819 records to 31075 (keeping 200 days of data) [2025-10-31T18:56:03.291092] [DEBUG] [LOCAL ] GEL: Primary data saved (31075 records). [2025-10-31T18:56:03.291223] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-31T18:56:03.291302] [INFO ] [MAIN ] Update Progress: 912/2365 symbols completed. GEL took 28.1s. Estimated remaining: 3h 4m 47s. Rate: 7.9 symbols/min [2025-10-31T18:56:03.458217] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:03.458303] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-31T18:56:03.493223] [DEBUG] [LOCAL ] GES: Loaded 37552 existing records from primary storage. [2025-10-31T18:56:03.493493] [INFO ] [MAIN ] GES: Loaded 37552 existing records. [2025-10-31T18:56:03.671329] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:03.671535] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-31T18:56:03.671600] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-31T18:56:03.672335] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-31T18:56:03.672393] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-31T18:56:04.027573] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:56:04.057539] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:56:04.257630] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-31T18:56:04.916112] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T18:56:05.057676] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-31T18:56:05.512712] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T18:56:05.722054] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-31T18:56:05.734550] [INFO ] [REMOTE ] GE: Full fetch complete (77852 records). [2025-10-31T18:56:05.734724] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-31T18:56:05.862841] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-31T18:56:06.130864] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-31T18:56:06.131017] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-31T18:56:06.131990] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-31T18:56:06.132051] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-31T18:56:06.133676] [DEBUG] [LOCAL ] GE: Trimmed 77852 records to 54463 (keeping 200 days of data) [2025-10-31T18:56:06.465188] [DEBUG] [LOCAL ] GE: Primary data saved (54463 records). [2025-10-31T18:56:06.465312] [INFO ] [MAIN ] GE: Full history saved. [2025-10-31T18:56:06.466038] [INFO ] [MAIN ] Update Progress: 913/2365 symbols completed. GE took 46.1s. Estimated remaining: 3h 4m 32s. Rate: 7.9 symbols/min [2025-10-31T18:56:06.641500] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:06.660143] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-31T18:56:06.675731] [DEBUG] [LOCAL ] GETY: Loaded 35161 existing records from primary storage. [2025-10-31T18:56:06.676082] [INFO ] [MAIN ] GETY: Loaded 35161 existing records. [2025-10-31T18:56:06.852160] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:06.852370] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-31T18:56:06.852417] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-31T18:56:06.852985] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-31T18:56:06.853041] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-31T18:56:07.206871] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:56:07.457696] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-31T18:56:07.547109] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-31T18:56:07.973077] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T18:56:08.257683] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-31T18:56:09.062974] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-31T18:56:09.096750] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-31T18:56:09.490156] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T18:56:09.857674] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-31T18:56:10.400690] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T18:56:10.657725] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-31T18:56:11.260730] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-31T18:56:11.457670] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-31T18:56:12.081929] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-31T18:56:12.257666] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-31T18:56:12.754984] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T18:56:13.057693] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-31T18:56:13.576118] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T18:56:13.857682] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-31T18:56:14.575297] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-31T18:56:14.657715] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-31T18:56:15.034880] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T18:56:15.457706] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-31T18:56:16.257674] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-31T18:56:16.624001] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-31T18:56:16.635872] [INFO ] [REMOTE ] GENI: Full fetch complete (76085 records). [2025-10-31T18:56:16.636027] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-31T18:56:17.031877] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-31T18:56:17.032009] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-31T18:56:17.033058] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-31T18:56:17.033160] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-31T18:56:17.059627] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-31T18:56:17.064961] [DEBUG] [LOCAL ] GENI: Trimmed 76085 records to 53633 (keeping 200 days of data) [2025-10-31T18:56:17.068277] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-31T18:56:17.412790] [DEBUG] [LOCAL ] GENI: Primary data saved (53633 records). [2025-10-31T18:56:17.414162] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T18:56:17.414256] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-31T18:56:17.422061] [INFO ] [MAIN ] Update Progress: 914/2365 symbols completed. GENI took 28.9s. Estimated remaining: 3h 4m 30s. Rate: 7.9 symbols/min [2025-10-31T18:56:17.589907] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:17.636348] [DEBUG] [LOCAL ] GEV: Loaded 53365 existing records from primary storage. [2025-10-31T18:56:17.636675] [INFO ] [MAIN ] GEV: Loaded 53365 existing records. [2025-10-31T18:56:17.825314] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:17.825516] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-31T18:56:17.825562] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-31T18:56:17.826624] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-31T18:56:17.826715] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-31T18:56:17.862867] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-31T18:56:18.175106] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:56:18.396991] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T18:56:18.657708] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-31T18:56:18.933417] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T18:56:19.457694] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-31T18:56:20.110240] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T18:56:20.257638] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-31T18:56:20.576594] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T18:56:21.057706] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-31T18:56:21.857727] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-31T18:56:22.077495] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T18:56:22.350407] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-31T18:56:22.657729] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-31T18:56:22.992142] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T18:56:23.457711] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-31T18:56:24.257700] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-31T18:56:24.481164] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-31T18:56:24.521368] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T18:56:25.057752] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-31T18:56:25.532204] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T18:56:25.540434] [INFO ] [REMOTE ] GES: Full fetch complete (57814 records). [2025-10-31T18:56:25.540566] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-31T18:56:25.862739] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-31T18:56:25.936796] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-31T18:56:25.936873] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-31T18:56:25.937747] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-31T18:56:25.937812] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-31T18:56:25.939140] [DEBUG] [LOCAL ] GES: Trimmed 57814 records to 37766 (keeping 200 days of data) [2025-10-31T18:56:26.188387] [DEBUG] [LOCAL ] GES: Primary data saved (37766 records). [2025-10-31T18:56:26.188504] [INFO ] [MAIN ] GES: Full history saved. [2025-10-31T18:56:26.188593] [INFO ] [MAIN ] Update Progress: 915/2365 symbols completed. GES took 22.9s. Estimated remaining: 3h 4m 24s. Rate: 7.9 symbols/min [2025-10-31T18:56:26.380993] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:26.385843] [DEBUG] [LOCAL ] GF: Loaded 2527 existing records from primary storage. [2025-10-31T18:56:26.386066] [INFO ] [MAIN ] GF: Loaded 2527 existing records. [2025-10-31T18:56:26.625372] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-31T18:56:26.629817] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:26.639518] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-31T18:56:26.639748] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-31T18:56:26.640509] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-31T18:56:26.640574] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-31T18:56:26.665739] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-31T18:56:27.029558] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:56:27.457750] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-31T18:56:27.852154] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-31T18:56:28.252444] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T18:56:28.262830] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-31T18:56:28.655734] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T18:56:29.057741] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-31T18:56:29.857731] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-31T18:56:30.199212] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-31T18:56:30.232260] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T18:56:30.657677] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-31T18:56:31.048682] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-31T18:56:31.376679] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T18:56:31.457636] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-31T18:56:32.257633] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-31T18:56:33.057699] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-31T18:56:33.474401] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-31T18:56:33.474172] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-31T18:56:33.538563] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T18:56:33.857635] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-31T18:56:34.657675] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-31T18:56:35.457677] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-31T18:56:35.687501] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T18:56:35.750842] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-31T18:56:35.851898] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-31T18:56:36.257744] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-31T18:56:37.057694] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-31T18:56:37.857715] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-31T18:56:37.896895] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T18:56:37.908224] [INFO ] [REMOTE ] GEO: Full fetch complete (75343 records). [2025-10-31T18:56:37.908349] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-31T18:56:38.256501] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T18:56:38.290361] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T18:56:38.342902] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-31T18:56:38.342985] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-31T18:56:38.343956] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-31T18:56:38.344021] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-31T18:56:38.345609] [DEBUG] [LOCAL ] GEO: Trimmed 75343 records to 52272 (keeping 200 days of data) [2025-10-31T18:56:38.646409] [DEBUG] [LOCAL ] GEO: Primary data saved (52272 records). [2025-10-31T18:56:38.646537] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-31T18:56:38.647142] [INFO ] [MAIN ] Update Progress: 916/2365 symbols completed. GEO took 41.0s. Estimated remaining: 3h 4m 24s. Rate: 7.9 symbols/min [2025-10-31T18:56:38.667463] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-31T18:56:38.834683] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:38.865238] [DEBUG] [LOCAL ] GFF: Loaded 28909 existing records from primary storage. [2025-10-31T18:56:38.865495] [INFO ] [MAIN ] GFF: Loaded 28909 existing records. [2025-10-31T18:56:39.043675] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:39.043882] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-31T18:56:39.043930] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-31T18:56:39.044217] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-31T18:56:39.044256] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-31T18:56:39.407741] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:56:39.457621] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-31T18:56:40.257615] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-31T18:56:40.441472] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T18:56:40.667133] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-31T18:56:40.958907] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-31T18:56:41.057619] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-31T18:56:41.857681] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-31T18:56:42.299815] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-31T18:56:42.657749] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-31T18:56:43.040364] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-31T18:56:43.175612] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-31T18:56:43.457673] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-31T18:56:44.257632] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-31T18:56:44.461283] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T18:56:45.057719] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-31T18:56:45.670464] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T18:56:45.679248] [INFO ] [REMOTE ] GETY: Full fetch complete (54936 records). [2025-10-31T18:56:45.679379] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-31T18:56:45.862429] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-31T18:56:46.074468] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-31T18:56:46.074553] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-31T18:56:46.075311] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-31T18:56:46.075378] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-31T18:56:46.076485] [DEBUG] [LOCAL ] GETY: Trimmed 54936 records to 35551 (keeping 200 days of data) [2025-10-31T18:56:46.276191] [DEBUG] [LOCAL ] GETY: Primary data saved (35551 records). [2025-10-31T18:56:46.276557] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-31T18:56:46.276359] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-31T18:56:46.277618] [INFO ] [MAIN ] Update Progress: 917/2365 symbols completed. GETY took 39.8s. Estimated remaining: 3h 4m 16s. Rate: 7.9 symbols/min [2025-10-31T18:56:46.657638] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-31T18:56:46.825676] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-31T18:56:46.951436] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-31T18:56:47.457718] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-31T18:56:48.257631] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-31T18:56:48.285890] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-31T18:56:48.637942] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-31T18:56:48.638909] [INFO ] [REMOTE ] GF: Full fetch complete (4808 records). [2025-10-31T18:56:48.638976] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-31T18:56:48.987237] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-31T18:56:48.987385] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-31T18:56:48.987543] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-31T18:56:48.987610] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-31T18:56:48.988140] [DEBUG] [LOCAL ] GF: Trimmed 4808 records to 2537 (keeping 200 days of data) [2025-10-31T18:56:49.004097] [DEBUG] [LOCAL ] GF: Primary data saved (2537 records). [2025-10-31T18:56:49.004175] [INFO ] [MAIN ] GF: Full history saved. [2025-10-31T18:56:49.004245] [INFO ] [MAIN ] Update Progress: 918/2365 symbols completed. GF took 22.8s. Estimated remaining: 3h 4m 1s. Rate: 7.9 symbols/min [2025-10-31T18:56:49.057708] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-31T18:56:49.857672] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-31T18:56:50.126485] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-31T18:56:50.657723] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-31T18:56:51.677237] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T18:56:51.684276] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-31T18:56:51.959847] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-31T18:56:51.972291] [INFO ] [REMOTE ] GEV: Full fetch complete (77056 records). [2025-10-31T18:56:51.972462] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-31T18:56:52.387464] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-31T18:56:52.387575] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-31T18:56:52.388689] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-31T18:56:52.388868] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-31T18:56:52.406297] [DEBUG] [LOCAL ] GEV: Trimmed 77056 records to 53749 (keeping 200 days of data) [2025-10-31T18:56:52.408130] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T18:56:52.415448] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-31T18:56:52.753495] [DEBUG] [LOCAL ] GEV: Primary data saved (53749 records). [2025-10-31T18:56:52.753920] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-31T18:56:52.754006] [INFO ] [MAIN ] Update Progress: 919/2365 symbols completed. GEV took 35.3s. Estimated remaining: 3h 3m 47s. Rate: 7.9 symbols/min [2025-10-31T18:56:53.218892] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T18:56:53.225068] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-31T18:56:54.283384] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T18:56:54.290900] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-31T18:56:55.058372] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T18:56:55.064155] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-31T18:56:56.107340] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T18:56:56.117156] [INFO ] [REMOTE ] GFF: Full fetch complete (43215 records). [2025-10-31T18:56:56.117313] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-31T18:56:56.598759] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-31T18:56:56.598886] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-31T18:56:56.600351] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-31T18:56:56.600439] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-31T18:56:56.601877] [DEBUG] [LOCAL ] GFF: Trimmed 43215 records to 29081 (keeping 200 days of data) [2025-10-31T18:56:56.850790] [DEBUG] [LOCAL ] GFF: Primary data saved (29081 records). [2025-10-31T18:56:56.850937] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-31T18:56:56.851020] [INFO ] [MAIN ] Update Progress: 920/2365 symbols completed. GFF took 18.2s. Estimated remaining: 3h 3m 34s. Rate: 7.9 symbols/min [2025-10-31T18:56:57.597021] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:57.664308] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:57.723799] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:57.721797] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:56:57.730052] [DEBUG] [LOCAL ] GFR: Loaded 6884 existing records from primary storage. [2025-10-31T18:56:57.730444] [INFO ] [MAIN ] GFR: Loaded 6884 existing records. [2025-10-31T18:56:57.954822] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:57.985186] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-31T18:56:57.985479] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-31T18:56:58.000828] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-31T18:56:58.000611] [DEBUG] [LOCAL ] GFI: Loaded 53502 existing records from primary storage. [2025-10-31T18:56:58.001084] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-31T18:56:58.007228] [INFO ] [MAIN ] GFI: Loaded 53502 existing records. [2025-10-31T18:56:58.067108] [DEBUG] [LOCAL ] GFL: Loaded 47591 existing records from primary storage. [2025-10-31T18:56:58.139443] [INFO ] [MAIN ] GFL: Loaded 47591 existing records. [2025-10-31T18:56:58.207905] [DEBUG] [LOCAL ] GGB: Loaded 51927 existing records from primary storage. [2025-10-31T18:56:58.229082] [INFO ] [MAIN ] GGB: Loaded 51927 existing records. [2025-10-31T18:56:58.607788] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:58.682111] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-31T18:56:58.709956] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-31T18:56:58.805440] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-31T18:56:58.861046] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-31T18:56:58.915558] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:58.988166] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-31T18:56:59.023178] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:56:59.037480] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-31T18:56:59.018537] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-31T18:56:59.102768] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-31T18:56:59.102967] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-31T18:56:59.131950] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-31T18:56:59.137363] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-31T18:56:59.156744] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:56:59.143609] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-31T18:56:59.176530] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-31T18:56:59.948767] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:56:59.970270] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-31T18:57:00.084126] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:57:00.084517] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-31T18:57:00.091523] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T18:57:00.099497] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-31T18:57:00.171181] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:57:00.171628] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-31T18:57:00.685224] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T18:57:00.691427] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-31T18:57:01.336527] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T18:57:01.339779] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-31T18:57:01.533935] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T18:57:01.543513] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-31T18:57:01.593481] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T18:57:01.642054] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-31T18:57:01.857635] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-31T18:57:01.890817] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-31T18:57:02.657705] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-31T18:57:02.908867] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T18:57:03.285411] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-31T18:57:03.466301] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-31T18:57:03.471526] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-31T18:57:04.257685] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-31T18:57:04.881540] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-31T18:57:05.057688] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-31T18:57:05.857691] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-31T18:57:05.965705] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-31T18:57:06.188353] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T18:57:06.657690] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-31T18:57:07.149008] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T18:57:07.150783] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T18:57:07.457692] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-31T18:57:08.257682] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-31T18:57:09.026183] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-31T18:57:09.057608] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-31T18:57:09.665522] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T18:57:09.857700] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-31T18:57:10.592134] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T18:57:10.657681] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-31T18:57:11.051110] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T18:57:11.457619] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-31T18:57:11.855674] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-31T18:57:12.107989] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T18:57:12.257668] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-31T18:57:13.057717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-31T18:57:13.449228] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-31T18:57:13.532692] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T18:57:13.857632] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-31T18:57:14.657724] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-31T18:57:15.075424] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T18:57:15.411265] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T18:57:15.457688] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-31T18:57:16.257714] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-31T18:57:16.594731] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-31T18:57:17.057676] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-31T18:57:17.857760] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-31T18:57:18.024508] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-31T18:57:18.177919] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T18:57:18.657731] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-31T18:57:19.055367] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T18:57:19.457669] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-31T18:57:20.058481] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:57:20.257675] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-31T18:57:20.665472] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T18:57:21.057628] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-31T18:57:21.616317] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T18:57:21.857622] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-31T18:57:22.557209] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T18:57:22.567842] [INFO ] [REMOTE ] GFL: Full fetch complete (69604 records). [2025-10-31T18:57:22.567977] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-31T18:57:22.664966] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-31T18:57:22.951577] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-31T18:57:22.951689] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-31T18:57:22.952521] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-31T18:57:22.952563] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-31T18:57:22.953820] [DEBUG] [LOCAL ] GFL: Trimmed 69604 records to 47928 (keeping 200 days of data) [2025-10-31T18:57:23.104931] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-31T18:57:23.276541] [DEBUG] [LOCAL ] GFL: Primary data saved (47928 records). [2025-10-31T18:57:23.276712] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-31T18:57:23.276798] [INFO ] [MAIN ] Update Progress: 921/2365 symbols completed. GFL took 26.4s. Estimated remaining: 3h 3m 56s. Rate: 7.9 symbols/min [2025-10-31T18:57:23.445740] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:57:23.464506] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-31T18:57:23.481399] [DEBUG] [LOCAL ] GGG: Loaded 40635 existing records from primary storage. [2025-10-31T18:57:23.481702] [INFO ] [MAIN ] GGG: Loaded 40635 existing records. [2025-10-31T18:57:23.654111] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:57:23.654320] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-31T18:57:23.654377] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-31T18:57:23.655168] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-31T18:57:23.655226] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-31T18:57:24.031332] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:57:24.042284] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T18:57:24.044002] [INFO ] [REMOTE ] GFR: Full fetch complete (11784 records). [2025-10-31T18:57:24.044069] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-31T18:57:24.260558] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-31T18:57:24.401731] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-31T18:57:24.401909] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-31T18:57:24.402281] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-31T18:57:24.402356] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-31T18:57:24.403011] [DEBUG] [LOCAL ] GFR: Trimmed 11784 records to 6941 (keeping 200 days of data) [2025-10-31T18:57:24.440401] [DEBUG] [LOCAL ] GFR: Primary data saved (6941 records). [2025-10-31T18:57:24.440661] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-31T18:57:24.440765] [INFO ] [MAIN ] Update Progress: 922/2365 symbols completed. GFR took 27.6s. Estimated remaining: 3h 3m 38s. Rate: 7.9 symbols/min [2025-10-31T18:57:24.559076] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-31T18:57:24.646028] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:57:24.659896] [DEBUG] [LOCAL ] GGT: Loaded 14552 existing records from primary storage. [2025-10-31T18:57:24.660136] [INFO ] [MAIN ] GGT: Loaded 14552 existing records. [2025-10-31T18:57:24.832453] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:57:24.832620] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-31T18:57:24.832693] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-31T18:57:24.833065] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-31T18:57:24.833120] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-31T18:57:25.065901] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-31T18:57:25.179499] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:57:25.505404] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T18:57:25.857628] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-31T18:57:26.343976] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T18:57:26.657615] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-31T18:57:26.839180] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T18:57:27.146923] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-31T18:57:27.457664] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-31T18:57:28.257675] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-31T18:57:29.057753] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-31T18:57:29.449281] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-31T18:57:29.461811] [INFO ] [REMOTE ] GFI: Full fetch complete (77055 records). [2025-10-31T18:57:29.479891] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-31T18:57:29.491669] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T18:57:29.865965] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-31T18:57:29.890255] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-31T18:57:29.890317] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-31T18:57:29.891245] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-31T18:57:29.891406] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-31T18:57:29.892819] [DEBUG] [LOCAL ] GFI: Trimmed 77055 records to 53891 (keeping 200 days of data) [2025-10-31T18:57:30.263832] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T18:57:30.265323] [DEBUG] [LOCAL ] GFI: Primary data saved (53891 records). [2025-10-31T18:57:30.274403] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-31T18:57:30.275455] [INFO ] [MAIN ] Update Progress: 923/2365 symbols completed. GFI took 33.4s. Estimated remaining: 3h 3m 28s. Rate: 7.9 symbols/min [2025-10-31T18:57:30.439969] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:57:30.444271] [DEBUG] [LOCAL ] GGZ: Loaded 2297 existing records from primary storage. [2025-10-31T18:57:30.444438] [INFO ] [MAIN ] GGZ: Loaded 2297 existing records. [2025-10-31T18:57:30.615968] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:57:30.616185] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-31T18:57:30.616231] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-31T18:57:30.616387] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-31T18:57:30.616425] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-31T18:57:30.669604] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-31T18:57:30.968753] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:57:31.242263] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T18:57:31.457690] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-31T18:57:31.719313] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-31T18:57:31.731812] [INFO ] [REMOTE ] GGB: Full fetch complete (74380 records). [2025-10-31T18:57:31.731958] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-31T18:57:32.084318] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-31T18:57:32.134943] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-31T18:57:32.135018] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-31T18:57:32.135920] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-31T18:57:32.135985] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-31T18:57:32.137434] [DEBUG] [LOCAL ] GGB: Trimmed 74380 records to 52315 (keeping 200 days of data) [2025-10-31T18:57:32.295180] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-31T18:57:32.434578] [DEBUG] [LOCAL ] GGB: Primary data saved (52315 records). [2025-10-31T18:57:32.434754] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-31T18:57:32.435215] [INFO ] [MAIN ] Update Progress: 924/2365 symbols completed. GGB took 35.6s. Estimated remaining: 3h 3m 12s. Rate: 7.9 symbols/min [2025-10-31T18:57:32.604196] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:57:32.608290] [DEBUG] [LOCAL ] GHC: Loaded 2984 existing records from primary storage. [2025-10-31T18:57:32.608433] [INFO ] [MAIN ] GHC: Loaded 2984 existing records. [2025-10-31T18:57:32.733083] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-31T18:57:32.797727] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:57:32.797997] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-31T18:57:32.798049] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-31T18:57:32.798254] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-31T18:57:32.798310] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-31T18:57:33.062835] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-31T18:57:33.150576] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:57:33.421052] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T18:57:33.857695] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-31T18:57:34.657686] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-31T18:57:35.227614] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T18:57:35.388415] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-31T18:57:35.457690] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-31T18:57:35.824579] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-31T18:57:36.257685] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-31T18:57:36.650995] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-31T18:57:37.057704] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-31T18:57:37.385744] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-31T18:57:37.857695] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-31T18:57:38.207809] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-31T18:57:38.657675] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-31T18:57:39.004589] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-31T18:57:39.457678] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-31T18:57:40.239356] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T18:57:40.257605] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-31T18:57:40.939377] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T18:57:41.057614] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-31T18:57:41.416723] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-31T18:57:41.857685] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-31T18:57:42.139982] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-31T18:57:42.657696] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-31T18:57:42.957098] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-31T18:57:43.457670] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-31T18:57:44.257710] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-31T18:57:44.493780] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-31T18:57:44.955457] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T18:57:45.057614] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-31T18:57:45.658673] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-31T18:57:45.857675] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-31T18:57:46.657628] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-31T18:57:46.863101] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T18:57:47.086783] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T18:57:47.457683] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-31T18:57:48.257671] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-31T18:57:48.573791] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-31T18:57:48.592886] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-31T18:57:49.057674] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-31T18:57:49.527527] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-31T18:57:49.857689] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-31T18:57:50.462212] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-31T18:57:50.657683] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-31T18:57:50.946134] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-31T18:57:51.457693] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-31T18:57:52.257676] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-31T18:57:52.528636] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T18:57:52.885413] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T18:57:52.889163] [INFO ] [REMOTE ] GGT: Full fetch complete (19267 records). [2025-10-31T18:57:52.889241] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-31T18:57:53.061931] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-31T18:57:53.250165] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-31T18:57:53.250239] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-31T18:57:53.250639] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-31T18:57:53.250720] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-31T18:57:53.251335] [DEBUG] [LOCAL ] GGT: Trimmed 19267 records to 14636 (keeping 200 days of data) [2025-10-31T18:57:53.333712] [DEBUG] [LOCAL ] GGT: Primary data saved (14636 records). [2025-10-31T18:57:53.333835] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-31T18:57:53.333909] [INFO ] [MAIN ] Update Progress: 925/2365 symbols completed. GGT took 28.9s. Estimated remaining: 3h 3m 25s. Rate: 7.9 symbols/min [2025-10-31T18:57:53.501569] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:57:53.505107] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-31T18:57:53.510696] [DEBUG] [LOCAL ] GHG: Loaded 3291 existing records from primary storage. [2025-10-31T18:57:53.510858] [INFO ] [MAIN ] GHG: Loaded 3291 existing records. [2025-10-31T18:57:53.692323] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:57:53.692524] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-31T18:57:53.692570] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-31T18:57:53.692784] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-31T18:57:53.692840] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-31T18:57:53.863948] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-31T18:57:54.044190] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:57:54.374763] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-31T18:57:54.375858] [INFO ] [REMOTE ] GGZ: Full fetch complete (3704 records). [2025-10-31T18:57:54.375924] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-31T18:57:54.662775] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-31T18:57:54.736264] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-31T18:57:54.736338] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-31T18:57:54.736482] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-31T18:57:54.736521] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-31T18:57:54.736924] [DEBUG] [LOCAL ] GGZ: Trimmed 3704 records to 2309 (keeping 200 days of data) [2025-10-31T18:57:54.751227] [DEBUG] [LOCAL ] GGZ: Primary data saved (2309 records). [2025-10-31T18:57:54.751298] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-31T18:57:54.751365] [INFO ] [MAIN ] Update Progress: 926/2365 symbols completed. GGZ took 24.5s. Estimated remaining: 3h 3m 7s. Rate: 7.9 symbols/min [2025-10-31T18:57:54.915183] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:57:54.924454] [DEBUG] [LOCAL ] GHI: Loaded 8257 existing records from primary storage. [2025-10-31T18:57:54.924684] [INFO ] [MAIN ] GHI: Loaded 8257 existing records. [2025-10-31T18:57:55.104104] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:57:55.108133] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-31T18:57:55.109681] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-31T18:57:55.110104] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-31T18:57:55.110420] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-31T18:57:55.110498] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-31T18:57:55.471355] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-31T18:57:55.476890] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:57:56.257689] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-31T18:57:56.603207] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-31T18:57:56.630066] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T18:57:57.057663] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-31T18:57:57.385830] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-31T18:57:57.857718] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-31T18:57:58.273597] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T18:57:58.657677] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-31T18:57:59.457732] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-31T18:57:59.985959] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T18:57:59.987449] [INFO ] [REMOTE ] GHC: Full fetch complete (3781 records). [2025-10-31T18:57:59.987515] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-31T18:58:00.259076] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-31T18:58:00.353544] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-31T18:58:00.353712] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-31T18:58:00.353858] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-31T18:58:00.353926] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-31T18:58:00.368185] [DEBUG] [LOCAL ] GHC: Trimmed 3781 records to 3031 (keeping 200 days of data) [2025-10-31T18:58:00.379151] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-31T18:58:00.407074] [DEBUG] [LOCAL ] GHC: Primary data saved (3031 records). [2025-10-31T18:58:00.407306] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-31T18:58:00.407418] [INFO ] [MAIN ] Update Progress: 927/2365 symbols completed. GHC took 28.0s. Estimated remaining: 3h 2m 57s. Rate: 7.9 symbols/min [2025-10-31T18:58:00.407242] [INFO ] [REMOTE ] GGG: Full fetch complete (59757 records). [2025-10-31T18:58:00.438749] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-31T18:58:00.754705] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:58:00.891891] [DEBUG] [LOCAL ] GHLD: Loaded 4428 existing records from primary storage. [2025-10-31T18:58:00.908552] [INFO ] [MAIN ] GHLD: Loaded 4428 existing records. [2025-10-31T18:58:01.070625] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-31T18:58:01.089795] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-31T18:58:01.094391] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-31T18:58:01.111347] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-31T18:58:01.152571] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-31T18:58:01.182485] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:58:01.184146] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-31T18:58:01.184377] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-31T18:58:01.187552] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-31T18:58:01.188138] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-31T18:58:01.188098] [DEBUG] [LOCAL ] GGG: Trimmed 59757 records to 40957 (keeping 200 days of data) [2025-10-31T18:58:01.188260] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-31T18:58:01.522933] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-31T18:58:01.798257] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:58:01.834909] [DEBUG] [LOCAL ] GGG: Primary data saved (40957 records). [2025-10-31T18:58:01.835078] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-31T18:58:01.835191] [INFO ] [MAIN ] Update Progress: 928/2365 symbols completed. GGG took 38.6s. Estimated remaining: 3h 2m 39s. Rate: 7.9 symbols/min [2025-10-31T18:58:01.862737] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-31T18:58:02.011238] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:58:02.025275] [DEBUG] [LOCAL ] GHM: Loaded 14436 existing records from primary storage. [2025-10-31T18:58:02.025487] [INFO ] [MAIN ] GHM: Loaded 14436 existing records. [2025-10-31T18:58:02.203427] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:58:02.203726] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-31T18:58:02.203779] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-31T18:58:02.204138] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-31T18:58:02.204195] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-31T18:58:02.308043] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-31T18:58:02.556398] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:58:02.657613] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-31T18:58:03.208257] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-31T18:58:03.457671] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-31T18:58:03.779422] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-31T18:58:04.257668] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-31T18:58:04.989869] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-31T18:58:05.057620] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-31T18:58:05.772149] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T18:58:05.857715] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-31T18:58:06.395194] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T18:58:06.657693] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-31T18:58:06.922473] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-31T18:58:07.457679] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-31T18:58:08.040249] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-31T18:58:08.257670] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-31T18:58:08.659501] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T18:58:09.057672] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-31T18:58:09.558179] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T18:58:09.857665] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-31T18:58:10.215752] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-31T18:58:10.657671] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-31T18:58:11.427179] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-31T18:58:11.457596] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-31T18:58:12.175063] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T18:58:12.257616] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-31T18:58:12.895557] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T18:58:13.057673] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-31T18:58:13.563341] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-31T18:58:13.857682] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-31T18:58:14.286587] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T18:58:14.657688] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-31T18:58:15.093677] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-31T18:58:15.457663] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-31T18:58:15.943262] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T18:58:16.257682] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-31T18:58:16.908363] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T18:58:17.057702] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-31T18:58:17.590938] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T18:58:17.857617] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-31T18:58:18.379698] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-31T18:58:18.657721] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-31T18:58:19.457683] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-31T18:58:19.647603] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T18:58:19.651839] [INFO ] [REMOTE ] GHM: Full fetch complete (22010 records). [2025-10-31T18:58:19.651930] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-31T18:58:19.769091] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-31T18:58:20.035752] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-31T18:58:20.035858] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-31T18:58:20.036358] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-31T18:58:20.036429] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-31T18:58:20.037052] [DEBUG] [LOCAL ] GHM: Trimmed 22010 records to 14541 (keeping 200 days of data) [2025-10-31T18:58:20.119329] [DEBUG] [LOCAL ] GHM: Primary data saved (14541 records). [2025-10-31T18:58:20.119463] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-31T18:58:20.119542] [INFO ] [MAIN ] Update Progress: 929/2365 symbols completed. GHM took 18.3s. Estimated remaining: 3h 2m 48s. Rate: 7.9 symbols/min [2025-10-31T18:58:20.265162] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-31T18:58:20.291282] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:58:20.311063] [DEBUG] [LOCAL ] GHY: Loaded 20749 existing records from primary storage. [2025-10-31T18:58:20.311291] [INFO ] [MAIN ] GHY: Loaded 20749 existing records. [2025-10-31T18:58:20.484354] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:58:20.484552] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-31T18:58:20.484603] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-31T18:58:20.485063] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-31T18:58:20.485120] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-31T18:58:20.667968] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-31T18:58:20.857715] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:58:21.057685] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-31T18:58:21.357590] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-31T18:58:21.857684] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-31T18:58:22.359921] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-31T18:58:22.657675] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-31T18:58:23.457630] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-31T18:58:23.587306] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-31T18:58:23.771613] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-31T18:58:24.257690] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-31T18:58:24.646308] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-31T18:58:25.057678] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-31T18:58:25.828620] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-31T18:58:25.832390] [INFO ] [REMOTE ] GHI: Full fetch complete (11533 records). [2025-10-31T18:58:25.832463] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-31T18:58:25.857678] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-31T18:58:26.188311] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-31T18:58:26.198296] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-31T18:58:26.198378] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-31T18:58:26.198729] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-31T18:58:26.198801] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-31T18:58:26.199296] [DEBUG] [LOCAL ] GHI: Trimmed 11533 records to 8355 (keeping 200 days of data) [2025-10-31T18:58:26.250579] [DEBUG] [LOCAL ] GHI: Primary data saved (8355 records). [2025-10-31T18:58:26.250761] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-31T18:58:26.250855] [INFO ] [MAIN ] Update Progress: 930/2365 symbols completed. GHI took 31.5s. Estimated remaining: 3h 2m 38s. Rate: 7.9 symbols/min [2025-10-31T18:58:26.418401] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:58:26.447254] [DEBUG] [LOCAL ] GIB: Loaded 31104 existing records from primary storage. [2025-10-31T18:58:26.447570] [INFO ] [MAIN ] GIB: Loaded 31104 existing records. [2025-10-31T18:58:26.619302] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:58:26.619506] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-31T18:58:26.619551] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-31T18:58:26.620123] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-31T18:58:26.620179] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-31T18:58:26.662830] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-31T18:58:26.966471] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:58:27.199260] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-31T18:58:27.457677] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-31T18:58:27.754331] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-31T18:58:28.257669] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-31T18:58:28.911971] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-31T18:58:29.057633] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-31T18:58:29.839362] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-31T18:58:29.857610] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-31T18:58:30.657626] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-31T18:58:30.698283] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-31T18:58:30.958244] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-31T18:58:31.457729] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-31T18:58:32.257730] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-31T18:58:32.411031] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T18:58:32.713738] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-31T18:58:33.057666] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-31T18:58:33.857667] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-31T18:58:34.038411] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T18:58:34.370183] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-31T18:58:34.371477] [INFO ] [REMOTE ] GHG: Full fetch complete (4272 records). [2025-10-31T18:58:34.371544] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-31T18:58:34.662768] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-31T18:58:34.728041] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-31T18:58:34.728114] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-31T18:58:34.728283] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-31T18:58:34.728321] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-31T18:58:34.728686] [DEBUG] [LOCAL ] GHG: Trimmed 4272 records to 3320 (keeping 200 days of data) [2025-10-31T18:58:34.748680] [DEBUG] [LOCAL ] GHG: Primary data saved (3320 records). [2025-10-31T18:58:34.748783] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-31T18:58:34.748860] [INFO ] [MAIN ] Update Progress: 931/2365 symbols completed. GHG took 41.4s. Estimated remaining: 3h 2m 32s. Rate: 7.9 symbols/min [2025-10-31T18:58:34.914763] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:58:34.927994] [DEBUG] [LOCAL ] GIC: Loaded 13224 existing records from primary storage. [2025-10-31T18:58:34.928221] [INFO ] [MAIN ] GIC: Loaded 13224 existing records. [2025-10-31T18:58:35.104180] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:58:35.104384] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-31T18:58:35.104447] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-31T18:58:35.104862] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-31T18:58:35.104922] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-31T18:58:35.200546] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-31T18:58:35.471234] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-31T18:58:35.476884] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:58:36.257687] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-31T18:58:36.401468] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T18:58:36.982538] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-31T18:58:37.057609] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-31T18:58:37.690335] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-31T18:58:37.857631] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-31T18:58:38.588358] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T18:58:38.657630] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-31T18:58:39.326834] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-31T18:58:39.457673] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-31T18:58:39.956571] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-31T18:58:39.958996] [INFO ] [REMOTE ] GHLD: Full fetch complete (5278 records). [2025-10-31T18:58:39.959085] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-31T18:58:40.262721] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-31T18:58:40.315689] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-31T18:58:40.315775] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-31T18:58:40.315954] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-31T18:58:40.315991] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-31T18:58:40.316351] [DEBUG] [LOCAL ] GHLD: Trimmed 5278 records to 4448 (keeping 200 days of data) [2025-10-31T18:58:40.343189] [DEBUG] [LOCAL ] GHLD: Primary data saved (4448 records). [2025-10-31T18:58:40.343306] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-31T18:58:40.343384] [INFO ] [MAIN ] Update Progress: 932/2365 symbols completed. GHLD took 39.9s. Estimated remaining: 3h 2m 21s. Rate: 7.9 symbols/min [2025-10-31T18:58:40.507411] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:58:40.546274] [DEBUG] [LOCAL ] GIL: Loaded 44190 existing records from primary storage. [2025-10-31T18:58:40.546557] [INFO ] [MAIN ] GIL: Loaded 44190 existing records. [2025-10-31T18:58:40.717632] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:58:40.717851] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-31T18:58:40.717924] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-31T18:58:40.718734] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-31T18:58:40.718790] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-31T18:58:41.005492] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T18:58:41.065611] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-31T18:58:41.088528] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:58:41.859533] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-31T18:58:41.862461] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T18:58:42.657685] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-31T18:58:42.857267] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-31T18:58:43.466511] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-31T18:58:43.467691] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T18:58:44.257690] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-31T18:58:44.568818] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-31T18:58:44.772547] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-31T18:58:45.057630] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-31T18:58:45.857624] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-31T18:58:45.987073] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T18:58:45.992597] [INFO ] [REMOTE ] GHY: Full fetch complete (31876 records). [2025-10-31T18:58:45.992724] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-31T18:58:46.358896] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-31T18:58:46.358969] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-31T18:58:46.359545] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-31T18:58:46.359584] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-31T18:58:46.360264] [DEBUG] [LOCAL ] GHY: Trimmed 31876 records to 20844 (keeping 200 days of data) [2025-10-31T18:58:46.485311] [DEBUG] [LOCAL ] GHY: Primary data saved (20844 records). [2025-10-31T18:58:46.485422] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-31T18:58:46.485493] [INFO ] [MAIN ] Update Progress: 933/2365 symbols completed. GHY took 26.4s. Estimated remaining: 3h 2m 11s. Rate: 7.9 symbols/min [2025-10-31T18:58:46.658537] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:58:46.658672] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-31T18:58:46.706700] [DEBUG] [LOCAL ] GIS: Loaded 54065 existing records from primary storage. [2025-10-31T18:58:46.707042] [INFO ] [MAIN ] GIS: Loaded 54065 existing records. [2025-10-31T18:58:46.819633] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-31T18:58:46.899555] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:58:46.899776] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-31T18:58:46.899824] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-31T18:58:46.900770] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-31T18:58:46.900826] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-31T18:58:47.244899] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:58:47.360129] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T18:58:47.457610] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-31T18:58:48.257630] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-31T18:58:48.338037] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-31T18:58:49.057723] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-31T18:58:49.598973] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-31T18:58:49.598629] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T18:58:49.857631] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-31T18:58:50.657669] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-31T18:58:50.871835] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T18:58:51.457722] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-31T18:58:51.863983] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T18:58:52.257737] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-31T18:58:52.480835] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T18:58:53.057672] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-31T18:58:53.807099] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-31T18:58:53.857729] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-31T18:58:53.925602] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-31T18:58:54.388314] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T18:58:54.657670] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-31T18:58:55.202375] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-31T18:58:55.457697] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-31T18:58:56.112678] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-31T18:58:56.257621] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-31T18:58:56.845496] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-31T18:58:57.057697] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-31T18:58:57.857636] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-31T18:58:58.231855] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T18:58:58.585234] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-31T18:58:58.588593] [INFO ] [REMOTE ] GIC: Full fetch complete (19841 records). [2025-10-31T18:58:58.588697] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-31T18:58:58.662996] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-31T18:58:58.974740] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-31T18:58:58.974821] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-31T18:58:58.975226] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-31T18:58:58.975266] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-31T18:58:58.975930] [DEBUG] [LOCAL ] GIC: Trimmed 19841 records to 13374 (keeping 200 days of data) [2025-10-31T18:58:59.054903] [DEBUG] [LOCAL ] GIC: Primary data saved (13374 records). [2025-10-31T18:58:59.055037] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-31T18:58:59.055111] [INFO ] [MAIN ] Update Progress: 934/2365 symbols completed. GIC took 24.3s. Estimated remaining: 3h 2m 11s. Rate: 7.9 symbols/min [2025-10-31T18:58:59.236542] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:58:59.277016] [DEBUG] [LOCAL ] GKOS: Loaded 42780 existing records from primary storage. [2025-10-31T18:58:59.277305] [INFO ] [MAIN ] GKOS: Loaded 42780 existing records. [2025-10-31T18:58:59.456269] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:58:59.456497] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-31T18:58:59.456545] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-31T18:58:59.457015] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-31T18:58:59.457073] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-31T18:58:59.462748] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-31T18:58:59.823103] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:59:00.166707] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T18:59:00.257618] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-31T18:59:00.539404] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T18:59:01.057663] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-31T18:59:01.283694] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T18:59:01.857750] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-31T18:59:02.460072] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T18:59:02.657679] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-31T18:59:03.055745] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T18:59:03.457702] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-31T18:59:04.060686] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-31T18:59:04.257689] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-31T18:59:04.482584] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T18:59:05.057627] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-31T18:59:05.268758] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T18:59:05.857674] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-31T18:59:06.090086] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T18:59:06.657689] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-31T18:59:07.457689] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-31T18:59:08.170693] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-31T18:59:08.257617] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-31T18:59:08.663405] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T18:59:09.057624] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-31T18:59:09.315058] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-31T18:59:09.322135] [INFO ] [REMOTE ] GIB: Full fetch complete (46655 records). [2025-10-31T18:59:09.322219] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-31T18:59:09.694422] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-31T18:59:09.694500] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-31T18:59:09.695202] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-31T18:59:09.695358] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-31T18:59:09.696638] [DEBUG] [LOCAL ] GIB: Trimmed 46655 records to 31325 (keeping 200 days of data) [2025-10-31T18:59:09.834902] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-31T18:59:09.860460] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-31T18:59:09.925525] [DEBUG] [LOCAL ] GIB: Primary data saved (31325 records). [2025-10-31T18:59:09.925630] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-31T18:59:09.926509] [INFO ] [MAIN ] Update Progress: 935/2365 symbols completed. GIB took 43.7s. Estimated remaining: 3h 2m 9s. Rate: 7.9 symbols/min [2025-10-31T18:59:10.099110] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:59:10.099397] [DEBUG] [LOCAL ] GL: No existing data file found in primary storage. [2025-10-31T18:59:10.099452] [WARN ] [MAIN ] GL: No existing data found, performing full refresh instead. [2025-10-31T18:59:10.099629] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-31T18:59:10.099760] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-31T18:59:10.099876] [DEBUG] [LOCAL ] GL: No primary data file found to delete. [2025-10-31T18:59:10.100123] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-31T18:59:10.507858] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T18:59:10.512630] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:59:10.657625] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-31T18:59:11.142244] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T18:59:11.457689] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-31T18:59:11.807395] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T18:59:12.257727] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-31T18:59:12.753922] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T18:59:13.057694] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-31T18:59:13.671429] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T18:59:13.857712] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-31T18:59:14.545742] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T18:59:14.556359] [INFO ] [REMOTE ] GIL: Full fetch complete (62809 records). [2025-10-31T18:59:14.556467] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-31T18:59:14.662826] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-31T18:59:14.938900] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-31T18:59:14.938987] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-31T18:59:14.939839] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-31T18:59:14.939915] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-31T18:59:14.941140] [DEBUG] [LOCAL ] GIL: Trimmed 62809 records to 44535 (keeping 200 days of data) [2025-10-31T18:59:15.231849] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T18:59:15.245457] [DEBUG] [LOCAL ] GIL: Primary data saved (44535 records). [2025-10-31T18:59:15.245943] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-31T18:59:15.246742] [INFO ] [MAIN ] Update Progress: 936/2365 symbols completed. GIL took 34.9s. Estimated remaining: 3h 1m 57s. Rate: 7.9 symbols/min [2025-10-31T18:59:15.414515] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:59:15.457318] [DEBUG] [LOCAL ] GLOB: Loaded 48411 existing records from primary storage. [2025-10-31T18:59:15.457704] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-31T18:59:15.457618] [INFO ] [MAIN ] GLOB: Loaded 48411 existing records. [2025-10-31T18:59:15.634476] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:59:15.634720] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-31T18:59:15.634775] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-31T18:59:15.635568] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-31T18:59:15.635626] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-31T18:59:15.986364] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:59:16.257736] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-31T18:59:16.378360] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-31T18:59:16.677411] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T18:59:17.057720] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-31T18:59:17.422210] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T18:59:17.857735] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-31T18:59:18.105136] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-31T18:59:18.657730] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-31T18:59:19.019366] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T18:59:19.314488] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-31T18:59:19.329347] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-31T18:59:19.329624] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-31T18:59:19.462833] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-31T18:59:19.848389] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-31T18:59:19.848506] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-31T18:59:19.850297] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-31T18:59:19.850370] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-31T18:59:19.852518] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 54455 (keeping 200 days of data) [2025-10-31T18:59:20.209808] [DEBUG] [LOCAL ] GIS: Primary data saved (54455 records). [2025-10-31T18:59:20.209999] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-31T18:59:20.210103] [INFO ] [MAIN ] Update Progress: 937/2365 symbols completed. GIS took 33.7s. Estimated remaining: 3h 1m 46s. Rate: 7.9 symbols/min [2025-10-31T18:59:20.267390] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-31T18:59:20.393577] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:59:20.404985] [DEBUG] [LOCAL ] GLP: Loaded 9115 existing records from primary storage. [2025-10-31T18:59:20.405313] [INFO ] [MAIN ] GLP: Loaded 9115 existing records. [2025-10-31T18:59:20.600385] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:59:20.600874] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-31T18:59:20.600961] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-31T18:59:20.601334] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-31T18:59:20.601489] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-31T18:59:20.729753] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T18:59:20.993501] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:59:21.057669] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-31T18:59:21.530879] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T18:59:21.566900] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T18:59:21.857719] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-31T18:59:22.657705] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-31T18:59:23.192935] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T18:59:23.457726] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-31T18:59:23.805332] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T18:59:24.257745] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-31T18:59:24.676273] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T18:59:25.057679] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-31T18:59:25.487306] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T18:59:25.857718] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-31T18:59:26.169179] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T18:59:26.657712] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-31T18:59:27.099218] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T18:59:27.457619] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-31T18:59:27.615784] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T18:59:28.257671] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-31T18:59:28.807308] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T18:59:29.057700] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-31T18:59:29.533579] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T18:59:29.857715] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-31T18:59:30.554446] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T18:59:30.568848] [INFO ] [REMOTE ] GKOS: Full fetch complete (60996 records). [2025-10-31T18:59:30.569066] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-31T18:59:30.662804] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-31T18:59:30.981822] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-31T18:59:30.981939] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-31T18:59:30.982930] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-31T18:59:30.983105] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-31T18:59:30.984794] [DEBUG] [LOCAL ] GKOS: Trimmed 60996 records to 43144 (keeping 200 days of data) [2025-10-31T18:59:31.071809] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T18:59:31.296102] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T18:59:31.301508] [DEBUG] [LOCAL ] GKOS: Primary data saved (43144 records). [2025-10-31T18:59:31.301854] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-31T18:59:31.304620] [INFO ] [MAIN ] Update Progress: 938/2365 symbols completed. GKOS took 32.2s. Estimated remaining: 3h 1m 43s. Rate: 7.9 symbols/min [2025-10-31T18:59:31.468367] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-31T18:59:31.506286] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:59:31.557247] [DEBUG] [LOCAL ] GLW: Loaded 54025 existing records from primary storage. [2025-10-31T18:59:31.557665] [INFO ] [MAIN ] GLW: Loaded 54025 existing records. [2025-10-31T18:59:31.764115] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:59:31.764311] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-31T18:59:31.764360] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-31T18:59:31.765222] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-31T18:59:31.765279] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-31T18:59:32.115050] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:59:32.257689] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-31T18:59:32.706467] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T18:59:32.800630] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-31T18:59:33.057671] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-31T18:59:33.857704] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-31T18:59:34.313255] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T18:59:34.340188] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T18:59:34.657635] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-31T18:59:35.457722] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-31T18:59:35.935543] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-31T18:59:36.257713] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-31T18:59:36.798314] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T18:59:36.806933] [INFO ] [REMOTE ] GL: Full fetch complete (54741 records). [2025-10-31T18:59:36.807033] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-31T18:59:37.063507] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-31T18:59:37.177816] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-31T18:59:37.177915] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-31T18:59:37.178696] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-31T18:59:37.178756] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-31T18:59:37.179798] [DEBUG] [LOCAL ] GL: Trimmed 54741 records to 37656 (keeping 200 days of data) [2025-10-31T18:59:37.408988] [DEBUG] [LOCAL ] GL: Primary data saved (37656 records). [2025-10-31T18:59:37.409112] [INFO ] [MAIN ] GL: Full history saved. [2025-10-31T18:59:37.409178] [INFO ] [MAIN ] Update Progress: 939/2365 symbols completed. GL took 27.5s. Estimated remaining: 3h 1m 33s. Rate: 7.9 symbols/min [2025-10-31T18:59:37.578033] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:59:37.616126] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T18:59:37.653990] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T18:59:37.675632] [DEBUG] [LOCAL ] GM: Loaded 54119 existing records from primary storage. [2025-10-31T18:59:37.676022] [INFO ] [MAIN ] GM: Loaded 54119 existing records. [2025-10-31T18:59:37.846717] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:59:37.846896] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-31T18:59:37.846946] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-31T18:59:37.847900] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-31T18:59:37.847959] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-31T18:59:37.867582] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-31T18:59:38.193742] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:59:38.657737] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-31T18:59:39.201949] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T18:59:39.457717] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-31T18:59:39.981493] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T18:59:40.056882] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-31T18:59:40.257734] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-31T18:59:41.057634] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-31T18:59:41.857691] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-31T18:59:41.968605] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-31T18:59:41.979713] [INFO ] [REMOTE ] GLOB: Full fetch complete (66978 records). [2025-10-31T18:59:41.979827] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-31T18:59:42.347244] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-31T18:59:42.370816] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-31T18:59:42.370887] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-31T18:59:42.371760] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-31T18:59:42.371822] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-31T18:59:42.373047] [DEBUG] [LOCAL ] GLOB: Trimmed 66978 records to 48768 (keeping 200 days of data) [2025-10-31T18:59:42.652057] [DEBUG] [LOCAL ] GLOB: Primary data saved (48768 records). [2025-10-31T18:59:42.652199] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-31T18:59:42.652906] [INFO ] [MAIN ] Update Progress: 940/2365 symbols completed. GLOB took 27.4s. Estimated remaining: 3h 1m 22s. Rate: 7.9 symbols/min [2025-10-31T18:59:42.664113] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-31T18:59:42.824854] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T18:59:42.856228] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-31T18:59:42.910756] [DEBUG] [LOCAL ] GME: Loaded 54164 existing records from primary storage. [2025-10-31T18:59:42.911068] [INFO ] [MAIN ] GME: Loaded 54164 existing records. [2025-10-31T18:59:43.082610] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T18:59:43.082821] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-31T18:59:43.082867] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-31T18:59:43.083175] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-31T18:59:43.083230] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-31T18:59:43.423148] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T18:59:43.457607] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-31T18:59:44.251426] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-31T18:59:44.261016] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-31T18:59:45.057730] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-31T18:59:45.322778] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-31T18:59:45.538505] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T18:59:45.833557] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-31T18:59:45.857690] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-31T18:59:46.657717] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-31T18:59:47.453857] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-31T18:59:47.464145] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-31T18:59:48.257681] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-31T18:59:48.733544] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-31T18:59:49.029988] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-31T18:59:49.057606] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-31T18:59:49.520347] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T18:59:49.857678] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-31T18:59:50.657699] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-31T18:59:50.697394] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T18:59:51.353548] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-31T18:59:51.457709] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-31T18:59:51.974245] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-31T18:59:52.257729] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-31T18:59:52.550454] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-31T18:59:53.057742] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-31T18:59:53.857682] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-31T18:59:53.981670] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-31T18:59:54.657698] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-31T18:59:55.126897] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-31T18:59:55.176710] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-31T18:59:55.457696] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-31T18:59:56.107057] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T18:59:56.257726] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-31T18:59:57.057716] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-31T18:59:57.370608] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-31T18:59:57.857695] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-31T18:59:57.963600] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-31T18:59:58.326123] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T18:59:58.657673] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-31T18:59:59.457679] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-31T18:59:59.808749] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-31T19:00:00.239846] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-31T19:00:00.257612] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-31T19:00:01.057680] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-31T19:00:01.364371] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-31T19:00:01.749897] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-31T19:00:01.857674] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-31T19:00:02.657725] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-31T19:00:03.186508] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-31T19:00:03.332707] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T19:00:03.335468] [INFO ] [REMOTE ] GLP: Full fetch complete (14161 records). [2025-10-31T19:00:03.335564] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-31T19:00:03.462718] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-31T19:00:03.753337] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-31T19:00:03.753501] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-31T19:00:03.754065] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-31T19:00:03.754152] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-31T19:00:03.754961] [DEBUG] [LOCAL ] GLP: Trimmed 14161 records to 9170 (keeping 200 days of data) [2025-10-31T19:00:03.814896] [DEBUG] [LOCAL ] GLP: Primary data saved (9170 records). [2025-10-31T19:00:03.815155] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-31T19:00:03.815333] [INFO ] [MAIN ] Update Progress: 941/2365 symbols completed. GLP took 43.6s. Estimated remaining: 3h 1m 35s. Rate: 7.8 symbols/min [2025-10-31T19:00:04.030942] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-31T19:00:04.048538] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:00:04.108948] [DEBUG] [LOCAL ] GMED: Loaded 48384 existing records from primary storage. [2025-10-31T19:00:04.109356] [INFO ] [MAIN ] GMED: Loaded 48384 existing records. [2025-10-31T19:00:04.262716] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-31T19:00:04.308707] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:00:04.308993] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-31T19:00:04.309045] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-31T19:00:04.309307] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-31T19:00:04.309365] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-31T19:00:04.668954] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:00:05.057702] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-31T19:00:05.168531] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T19:00:05.182146] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-31T19:00:05.182379] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-31T19:00:05.628386] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-31T19:00:05.628517] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-31T19:00:05.630032] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-31T19:00:05.630129] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-31T19:00:05.649216] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 54509 (keeping 200 days of data) [2025-10-31T19:00:05.668427] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-31T19:00:05.867087] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-31T19:00:06.050384] [DEBUG] [LOCAL ] GM: Primary data saved (54509 records). [2025-10-31T19:00:06.050634] [INFO ] [MAIN ] GM: Full history saved. [2025-10-31T19:00:06.051694] [INFO ] [MAIN ] Update Progress: 942/2365 symbols completed. GM took 28.6s. Estimated remaining: 3h 1m 19s. Rate: 7.8 symbols/min [2025-10-31T19:00:06.282995] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T19:00:06.285058] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:00:06.298430] [INFO ] [REMOTE ] GLW: Full fetch complete (77801 records). [2025-10-31T19:00:06.298592] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-31T19:00:06.633245] [DEBUG] [LOCAL ] GMRE: Loaded 35477 existing records from primary storage. [2025-10-31T19:00:06.654727] [INFO ] [MAIN ] GMRE: Loaded 35477 existing records. [2025-10-31T19:00:06.672639] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-31T19:00:06.873578] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-31T19:00:06.874036] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-31T19:00:06.880867] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-31T19:00:06.896517] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-31T19:00:06.966376] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:00:06.967018] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-31T19:00:06.967079] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-31T19:00:06.967431] [DEBUG] [LOCAL ] GLW: Trimmed 77801 records to 54415 (keeping 200 days of data) [2025-10-31T19:00:06.968156] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-31T19:00:06.968610] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-31T19:00:07.593556] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:00:07.596098] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-31T19:00:07.637045] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-31T19:00:07.767404] [DEBUG] [LOCAL ] GLW: Primary data saved (54415 records). [2025-10-31T19:00:07.767564] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-31T19:00:07.767697] [INFO ] [MAIN ] Update Progress: 943/2365 symbols completed. GLW took 36.5s. Estimated remaining: 3h 1m 2s. Rate: 7.9 symbols/min [2025-10-31T19:00:07.962118] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:00:07.981197] [DEBUG] [LOCAL ] GNE: Loaded 18223 existing records from primary storage. [2025-10-31T19:00:07.981434] [INFO ] [MAIN ] GNE: Loaded 18223 existing records. [2025-10-31T19:00:08.160714] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:00:08.160954] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-31T19:00:08.161003] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-31T19:00:08.161172] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-31T19:00:08.161233] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-31T19:00:08.263213] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-31T19:00:08.545887] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:00:08.592885] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-31T19:00:08.807840] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T19:00:09.057705] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-31T19:00:09.747469] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T19:00:09.857622] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-31T19:00:09.968914] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T19:00:10.657700] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-31T19:00:11.208813] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T19:00:11.457696] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-31T19:00:12.257729] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-31T19:00:12.628691] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T19:00:12.823500] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-31T19:00:12.914155] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-31T19:00:12.927522] [INFO ] [REMOTE ] GME: Full fetch complete (77916 records). [2025-10-31T19:00:12.927827] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-31T19:00:13.062887] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-31T19:00:13.350204] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-31T19:00:13.350292] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-31T19:00:13.351297] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-31T19:00:13.351363] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-31T19:00:13.352904] [DEBUG] [LOCAL ] GME: Trimmed 77916 records to 54554 (keeping 200 days of data) [2025-10-31T19:00:13.691475] [DEBUG] [LOCAL ] GME: Primary data saved (54554 records). [2025-10-31T19:00:13.692320] [INFO ] [MAIN ] GME: Full history saved. [2025-10-31T19:00:13.692991] [INFO ] [MAIN ] Update Progress: 944/2365 symbols completed. GME took 31.0s. Estimated remaining: 3h 0m 52s. Rate: 7.9 symbols/min [2025-10-31T19:00:13.693345] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-31T19:00:13.864157] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-31T19:00:13.868075] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:00:13.907315] [DEBUG] [LOCAL ] GNK: Loaded 38918 existing records from primary storage. [2025-10-31T19:00:13.907601] [INFO ] [MAIN ] GNK: Loaded 38918 existing records. [2025-10-31T19:00:14.090627] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:00:14.090863] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-31T19:00:14.090911] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-31T19:00:14.091224] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-31T19:00:14.091282] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-31T19:00:14.465217] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:00:14.657672] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-31T19:00:14.821144] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T19:00:15.251391] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T19:00:15.457716] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-31T19:00:16.257680] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-31T19:00:16.501204] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T19:00:16.779863] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-31T19:00:17.057726] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-31T19:00:17.857730] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-31T19:00:18.085031] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T19:00:18.657681] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-31T19:00:18.782593] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T19:00:19.457702] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-31T19:00:20.075514] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-31T19:00:20.257690] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-31T19:00:20.418423] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T19:00:21.057639] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-31T19:00:21.311755] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T19:00:21.683594] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-31T19:00:21.857674] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-31T19:00:22.589627] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T19:00:22.657682] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-31T19:00:23.289702] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T19:00:23.457673] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-31T19:00:24.257675] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-31T19:00:24.441235] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T19:00:25.057720] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-31T19:00:25.431602] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T19:00:25.857677] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-31T19:00:26.209045] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T19:00:26.583221] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:00:26.657624] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-31T19:00:27.332257] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T19:00:27.457696] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-31T19:00:28.257705] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-31T19:00:28.443825] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T19:00:29.057669] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-31T19:00:29.122277] [DEBUG] [REMOTE ] GNE: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-31T19:00:29.122575] [WARN ] [REMOTE ] GNE: No data returned for month 2025-10 [2025-10-31T19:00:29.122692] [FATAL] [REMOTE ] GNE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:00:29.122771] [FATAL] [MAIN ] GNE: Failed to fetch primary data. [2025-10-31T19:00:29.122833] [WARN ] [MAIN ] GNE: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:00:29.122902] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-31T19:00:29.122965] [DEBUG] [LOCAL ] GNE: No primary data file found to delete. [2025-10-31T19:00:29.123000] [INFO ] [LOCAL ] GNE: Starting deletion of derivative data. [2025-10-31T19:00:29.123165] [DEBUG] [LOCAL ] GNE: Deleted derivative data file. [2025-10-31T19:00:29.123248] [INFO ] [MAIN ] Update Progress: 945/2365 symbols completed. GNE took 21.4s. Estimated remaining: 3h 0m 56s. Rate: 7.8 symbols/min [2025-10-31T19:00:29.303481] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:00:29.341891] [DEBUG] [LOCAL ] GNL: Loaded 46453 existing records from primary storage. [2025-10-31T19:00:29.342196] [INFO ] [MAIN ] GNL: Loaded 46453 existing records. [2025-10-31T19:00:29.518372] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:00:29.518604] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-31T19:00:29.518702] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-31T19:00:29.528869] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-31T19:00:29.542554] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-31T19:00:29.622090] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T19:00:29.867134] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-31T19:00:29.906583] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:00:30.657748] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-31T19:00:30.942007] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T19:00:31.457706] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-31T19:00:31.903723] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T19:00:32.257670] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-31T19:00:32.558971] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T19:00:33.057712] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-31T19:00:33.405595] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T19:00:33.857633] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-31T19:00:34.280133] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T19:00:34.657722] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-31T19:00:35.007529] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T19:00:35.457703] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-31T19:00:35.663678] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T19:00:35.669378] [INFO ] [REMOTE ] GMRE: Full fetch complete (50693 records). [2025-10-31T19:00:35.669497] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-31T19:00:36.039637] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-31T19:00:36.039754] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-31T19:00:36.040492] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-31T19:00:36.040531] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-31T19:00:36.041529] [DEBUG] [LOCAL ] GMRE: Trimmed 50693 records to 35602 (keeping 200 days of data) [2025-10-31T19:00:36.247591] [DEBUG] [LOCAL ] GMRE: Primary data saved (35602 records). [2025-10-31T19:00:36.247755] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-31T19:00:36.248481] [INFO ] [MAIN ] Update Progress: 946/2365 symbols completed. GMRE took 30.2s. Estimated remaining: 3h 0m 48s. Rate: 7.8 symbols/min [2025-10-31T19:00:36.262881] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-31T19:00:36.417539] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:00:36.459703] [DEBUG] [LOCAL ] GNRC: Loaded 45582 existing records from primary storage. [2025-10-31T19:00:36.460008] [INFO ] [MAIN ] GNRC: Loaded 45582 existing records. [2025-10-31T19:00:36.632694] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:00:36.632917] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-31T19:00:36.632965] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-31T19:00:36.633797] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-31T19:00:36.633856] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-31T19:00:36.986221] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:00:37.057627] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-31T19:00:37.150526] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-31T19:00:37.857632] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-31T19:00:37.960357] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-31T19:00:37.971409] [INFO ] [REMOTE ] GMED: Full fetch complete (70044 records). [2025-10-31T19:00:37.971550] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-31T19:00:38.357790] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-31T19:00:38.357912] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-31T19:00:38.358913] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-31T19:00:38.359020] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-31T19:00:38.369106] [DEBUG] [LOCAL ] GMED: Trimmed 70044 records to 48725 (keeping 200 days of data) [2025-10-31T19:00:38.388990] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T19:00:38.658234] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-31T19:00:38.674052] [DEBUG] [LOCAL ] GMED: Primary data saved (48725 records). [2025-10-31T19:00:38.674147] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-31T19:00:38.674221] [INFO ] [MAIN ] Update Progress: 947/2365 symbols completed. GMED took 34.9s. Estimated remaining: 3h 0m 32s. Rate: 7.9 symbols/min [2025-10-31T19:00:38.841405] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:00:38.850375] [DEBUG] [LOCAL ] GNT: Loaded 8662 existing records from primary storage. [2025-10-31T19:00:38.850575] [INFO ] [MAIN ] GNT: Loaded 8662 existing records. [2025-10-31T19:00:39.026783] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:00:39.027040] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-31T19:00:39.027169] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-31T19:00:39.027500] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-31T19:00:39.027568] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-31T19:00:39.159991] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:00:39.412489] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:00:39.457639] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-31T19:00:39.832955] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-31T19:00:39.873634] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T19:00:40.257669] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-31T19:00:41.057727] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-31T19:00:41.508054] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:00:41.857686] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-31T19:00:42.166411] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T19:00:42.309818] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-31T19:00:42.657714] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-31T19:00:43.159054] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T19:00:43.457667] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-31T19:00:43.987499] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T19:00:44.257691] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-31T19:00:44.717639] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-31T19:00:45.057726] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-31T19:00:45.857747] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-31T19:00:46.224578] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T19:00:46.657722] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-31T19:00:46.991397] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T19:00:47.190337] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T19:00:47.457733] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-31T19:00:48.257710] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-31T19:00:48.709585] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-31T19:00:48.767996] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T19:00:49.057672] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-31T19:00:49.857686] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-31T19:00:50.188756] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T19:00:50.657716] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-31T19:00:51.007401] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T19:00:51.457680] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-31T19:00:51.775497] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T19:00:52.257686] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-31T19:00:52.494760] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T19:00:53.057684] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-31T19:00:53.529303] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-31T19:00:53.531279] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T19:00:53.857668] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-31T19:00:54.657697] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-31T19:00:54.932993] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T19:00:55.457699] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-31T19:00:55.892113] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T19:00:56.257664] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-31T19:00:56.536311] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-31T19:00:56.909785] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T19:00:57.057680] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-31T19:00:57.857675] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-31T19:00:58.352577] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T19:00:58.657671] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-31T19:00:59.169364] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T19:00:59.324267] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T19:00:59.328840] [INFO ] [REMOTE ] GNT: Full fetch complete (11518 records). [2025-10-31T19:00:59.328927] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-31T19:00:59.473029] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-31T19:00:59.695923] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-31T19:00:59.696001] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-31T19:00:59.696291] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-31T19:00:59.696330] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-31T19:00:59.696813] [DEBUG] [LOCAL ] GNT: Trimmed 11518 records to 8714 (keeping 200 days of data) [2025-10-31T19:00:59.746672] [DEBUG] [LOCAL ] GNT: Primary data saved (8714 records). [2025-10-31T19:00:59.746805] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-31T19:00:59.746886] [INFO ] [MAIN ] Update Progress: 948/2365 symbols completed. GNT took 21.1s. Estimated remaining: 3h 0m 45s. Rate: 7.8 symbols/min [2025-10-31T19:00:59.915459] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:00:59.961800] [DEBUG] [LOCAL ] GNW: Loaded 51584 existing records from primary storage. [2025-10-31T19:00:59.962132] [INFO ] [MAIN ] GNW: Loaded 51584 existing records. [2025-10-31T19:01:00.141543] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:00.141851] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-31T19:01:00.141939] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-31T19:01:00.143128] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-31T19:01:00.143210] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-31T19:01:00.262885] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-31T19:01:00.550023] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:01.066462] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-31T19:01:01.072267] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T19:01:01.084868] [INFO ] [REMOTE ] GNL: Full fetch complete (67825 records). [2025-10-31T19:01:01.085014] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-31T19:01:01.611007] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-31T19:01:01.611093] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-31T19:01:01.611996] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-31T19:01:01.612087] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-31T19:01:01.613471] [DEBUG] [LOCAL ] GNL: Trimmed 67825 records to 46754 (keeping 200 days of data) [2025-10-31T19:01:01.859825] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-31T19:01:01.911524] [DEBUG] [LOCAL ] GNL: Primary data saved (46754 records). [2025-10-31T19:01:01.911705] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-31T19:01:01.911809] [INFO ] [MAIN ] Update Progress: 949/2365 symbols completed. GNL took 32.8s. Estimated remaining: 3h 0m 29s. Rate: 7.8 symbols/min [2025-10-31T19:01:02.106109] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:01:02.148371] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-31T19:01:02.192548] [DEBUG] [LOCAL ] GOF: Loaded 43073 existing records from primary storage. [2025-10-31T19:01:02.192883] [INFO ] [MAIN ] GOF: Loaded 43073 existing records. [2025-10-31T19:01:02.377099] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:02.377633] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-31T19:01:02.377734] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-31T19:01:02.387474] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-31T19:01:02.403961] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-31T19:01:02.464944] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T19:01:02.527747] [INFO ] [REMOTE ] GNK: Full fetch complete (57016 records). [2025-10-31T19:01:02.533633] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-31T19:01:02.678032] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-31T19:01:03.039572] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:03.200518] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-31T19:01:03.200854] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-31T19:01:03.201899] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-31T19:01:03.202050] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-31T19:01:03.203689] [DEBUG] [LOCAL ] GNK: Trimmed 57016 records to 39232 (keeping 200 days of data) [2025-10-31T19:01:03.316314] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T19:01:03.460006] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-31T19:01:03.474265] [DEBUG] [LOCAL ] GNK: Primary data saved (39232 records). [2025-10-31T19:01:03.474482] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-31T19:01:03.475119] [INFO ] [MAIN ] Update Progress: 950/2365 symbols completed. GNK took 49.8s. Estimated remaining: 3h 0m 12s. Rate: 7.9 symbols/min [2025-10-31T19:01:03.640446] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:01:03.676864] [DEBUG] [LOCAL ] GOLF: Loaded 29771 existing records from primary storage. [2025-10-31T19:01:03.677279] [INFO ] [MAIN ] GOLF: Loaded 29771 existing records. [2025-10-31T19:01:03.871814] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:03.872027] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-31T19:01:03.872075] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-31T19:01:03.872742] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-31T19:01:03.872803] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-31T19:01:04.253420] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:04.265325] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-31T19:01:04.282448] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-31T19:01:04.428161] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T19:01:05.057687] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-31T19:01:05.172617] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T19:01:05.857672] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-31T19:01:06.663679] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-31T19:01:06.669766] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-31T19:01:06.680816] [INFO ] [REMOTE ] GNRC: Full fetch complete (65897 records). [2025-10-31T19:01:06.680934] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-31T19:01:06.996027] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T19:01:07.103961] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-31T19:01:07.104052] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-31T19:01:07.104914] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-31T19:01:07.104978] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-31T19:01:07.106335] [DEBUG] [LOCAL ] GNRC: Trimmed 65897 records to 45935 (keeping 200 days of data) [2025-10-31T19:01:07.379023] [DEBUG] [LOCAL ] GNRC: Primary data saved (45935 records). [2025-10-31T19:01:07.379153] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-31T19:01:07.379832] [INFO ] [MAIN ] Update Progress: 951/2365 symbols completed. GNRC took 31.1s. Estimated remaining: 2h 59m 59s. Rate: 7.9 symbols/min [2025-10-31T19:01:07.468131] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-31T19:01:07.547109] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:01:07.590806] [DEBUG] [LOCAL ] GOOS: Loaded 43816 existing records from primary storage. [2025-10-31T19:01:07.591092] [INFO ] [MAIN ] GOOS: Loaded 43816 existing records. [2025-10-31T19:01:07.765112] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:07.765339] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-31T19:01:07.765385] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-31T19:01:07.766074] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-31T19:01:07.766131] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-31T19:01:08.118421] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:08.257682] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-31T19:01:08.329361] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-31T19:01:08.679177] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T19:01:09.057690] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-31T19:01:09.355291] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T19:01:09.857690] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-31T19:01:10.212565] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T19:01:10.657702] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-31T19:01:10.975812] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T19:01:11.457670] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-31T19:01:11.813455] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T19:01:12.257700] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-31T19:01:12.675118] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T19:01:13.057684] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-31T19:01:13.547907] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T19:01:13.857676] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-31T19:01:14.031901] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T19:01:14.657700] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-31T19:01:14.953735] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T19:01:15.457666] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-31T19:01:15.828762] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T19:01:16.257691] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-31T19:01:16.926801] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T19:01:17.057684] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-31T19:01:17.562816] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T19:01:17.857678] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-31T19:01:18.007556] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-31T19:01:18.657675] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-31T19:01:19.098497] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T19:01:19.457728] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-31T19:01:19.572706] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-31T19:01:20.257633] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-31T19:01:20.984783] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T19:01:21.057676] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-31T19:01:21.269013] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T19:01:21.857683] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-31T19:01:22.270318] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T19:01:22.657731] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-31T19:01:22.936244] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T19:01:23.458409] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-31T19:01:23.461202] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T19:01:24.257690] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-31T19:01:24.594465] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T19:01:25.057677] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-31T19:01:25.569582] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:01:25.857672] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-31T19:01:25.910938] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-31T19:01:26.657692] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-31T19:01:27.263233] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T19:01:27.457714] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-31T19:01:27.818773] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T19:01:28.257639] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-31T19:01:28.617106] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T19:01:29.057674] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-31T19:01:29.857623] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-31T19:01:30.009108] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-31T19:01:30.021971] [INFO ] [REMOTE ] GNW: Full fetch complete (73919 records). [2025-10-31T19:01:30.022177] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-31T19:01:30.447782] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-31T19:01:30.449394] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-31T19:01:30.449492] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-31T19:01:30.458599] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-31T19:01:30.459174] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-31T19:01:30.460636] [DEBUG] [LOCAL ] GNW: Trimmed 73919 records to 51966 (keeping 200 days of data) [2025-10-31T19:01:30.657837] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-31T19:01:30.756913] [DEBUG] [LOCAL ] GNW: Primary data saved (51966 records). [2025-10-31T19:01:30.757043] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-31T19:01:30.757118] [INFO ] [MAIN ] Update Progress: 952/2365 symbols completed. GNW took 31.0s. Estimated remaining: 3h 0m 15s. Rate: 7.8 symbols/min [2025-10-31T19:01:30.928462] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:01:30.962083] [DEBUG] [LOCAL ] GOTU: Loaded 36712 existing records from primary storage. [2025-10-31T19:01:30.962342] [INFO ] [MAIN ] GOTU: Loaded 36712 existing records. [2025-10-31T19:01:31.143364] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:31.143603] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-31T19:01:31.143756] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-31T19:01:31.144129] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-31T19:01:31.144202] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-31T19:01:31.295099] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T19:01:31.467486] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-31T19:01:31.580451] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:31.821393] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-31T19:01:31.830550] [INFO ] [REMOTE ] GOOS: Full fetch complete (64528 records). [2025-10-31T19:01:31.830720] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-31T19:01:32.224434] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-31T19:01:32.224515] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-31T19:01:32.225435] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-31T19:01:32.225499] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-31T19:01:32.226800] [DEBUG] [LOCAL ] GOOS: Trimmed 64528 records to 44119 (keeping 200 days of data) [2025-10-31T19:01:32.274775] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-31T19:01:32.488419] [DEBUG] [LOCAL ] GOOS: Primary data saved (44119 records). [2025-10-31T19:01:32.488578] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-31T19:01:32.488685] [INFO ] [MAIN ] Update Progress: 953/2365 symbols completed. GOOS took 25.1s. Estimated remaining: 2h 59m 58s. Rate: 7.8 symbols/min [2025-10-31T19:01:32.660405] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:01:32.701958] [DEBUG] [LOCAL ] GPC: Loaded 46012 existing records from primary storage. [2025-10-31T19:01:32.702314] [INFO ] [MAIN ] GPC: Loaded 46012 existing records. [2025-10-31T19:01:32.832754] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T19:01:32.911958] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:32.912178] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-31T19:01:32.912225] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-31T19:01:32.913041] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-31T19:01:32.913099] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-31T19:01:33.059735] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-31T19:01:33.268103] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:33.485785] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T19:01:33.852433] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T19:01:33.858964] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-31T19:01:34.657675] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-31T19:01:35.177028] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T19:01:35.457713] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-31T19:01:35.905279] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T19:01:36.257694] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-31T19:01:37.057686] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-31T19:01:37.365737] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T19:01:37.857685] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-31T19:01:38.247253] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T19:01:38.657671] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-31T19:01:38.854264] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-31T19:01:38.861985] [INFO ] [REMOTE ] GOLF: Full fetch complete (45265 records). [2025-10-31T19:01:38.862220] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-31T19:01:39.268176] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-31T19:01:39.268270] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-31T19:01:39.269133] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-31T19:01:39.269202] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-31T19:01:39.270275] [DEBUG] [LOCAL ] GOLF: Trimmed 45265 records to 29941 (keeping 200 days of data) [2025-10-31T19:01:39.452963] [DEBUG] [LOCAL ] GOLF: Primary data saved (29941 records). [2025-10-31T19:01:39.453118] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-31T19:01:39.453216] [INFO ] [MAIN ] Update Progress: 954/2365 symbols completed. GOLF took 36.0s. Estimated remaining: 2h 59m 50s. Rate: 7.8 symbols/min [2025-10-31T19:01:39.484744] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-31T19:01:39.640464] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:01:39.657594] [DEBUG] [LOCAL ] GPI: Loaded 14834 existing records from primary storage. [2025-10-31T19:01:39.657914] [INFO ] [MAIN ] GPI: Loaded 14834 existing records. [2025-10-31T19:01:39.859607] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:39.860220] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-31T19:01:39.860416] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-31T19:01:39.860777] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-31T19:01:39.860852] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-31T19:01:40.182616] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (4.72 seconds). [2025-10-31T19:01:40.226959] [INFO ] [REMOTE ] GOF: Full fetch complete (63013 records). [2025-10-31T19:01:40.261883] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-31T19:01:40.297782] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:40.315004] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-31T19:01:40.552115] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-31T19:01:40.725913] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-31T19:01:40.725995] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-31T19:01:40.726868] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-31T19:01:40.726930] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-31T19:01:40.728232] [DEBUG] [LOCAL ] GOF: Trimmed 63013 records to 43447 (keeping 200 days of data) [2025-10-31T19:01:41.010554] [DEBUG] [LOCAL ] GOF: Primary data saved (43447 records). [2025-10-31T19:01:41.011946] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-31T19:01:41.011834] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T19:01:41.015452] [INFO ] [MAIN ] Update Progress: 955/2365 symbols completed. GOF took 39.1s. Estimated remaining: 2h 59m 33s. Rate: 7.9 symbols/min [2025-10-31T19:01:41.061204] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-31T19:01:41.228583] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:01:41.230271] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-31T19:01:41.245577] [DEBUG] [LOCAL ] GPJA: Loaded 4055 existing records from primary storage. [2025-10-31T19:01:41.245800] [INFO ] [MAIN ] GPJA: Loaded 4055 existing records. [2025-10-31T19:01:41.427417] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:41.427664] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-31T19:01:41.427727] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-31T19:01:41.427916] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-31T19:01:41.427980] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-31T19:01:41.808610] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T19:01:41.813504] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:41.857615] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-31T19:01:42.597552] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T19:01:42.657606] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-31T19:01:43.457736] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-31T19:01:43.494689] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-31T19:01:44.257696] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-31T19:01:44.648424] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T19:01:45.057760] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-31T19:01:45.543443] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T19:01:45.857685] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-31T19:01:46.140872] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T19:01:46.464860] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-31T19:01:46.657711] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-31T19:01:47.457673] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-31T19:01:48.014828] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T19:01:48.049737] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-31T19:01:48.257705] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-31T19:01:48.878086] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-31T19:01:49.057716] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-31T19:01:49.857699] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-31T19:01:50.310306] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T19:01:50.657689] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-31T19:01:51.010008] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T19:01:51.457710] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-31T19:01:52.111300] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-31T19:01:52.129522] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-31T19:01:52.257631] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-31T19:01:53.057912] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-31T19:01:53.267333] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T19:01:53.748193] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-31T19:01:53.857665] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-31T19:01:54.458365] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-31T19:01:54.657697] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-31T19:01:55.457671] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-31T19:01:55.964706] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T19:01:56.257629] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-31T19:01:56.430634] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-31T19:01:56.435635] [INFO ] [REMOTE ] GPI: Full fetch complete (22348 records). [2025-10-31T19:01:56.435938] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-31T19:01:56.627169] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T19:01:56.816814] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-31T19:01:56.816938] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-31T19:01:56.817460] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-31T19:01:56.817502] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-31T19:01:56.818152] [DEBUG] [LOCAL ] GPI: Trimmed 22348 records to 14978 (keeping 200 days of data) [2025-10-31T19:01:56.911297] [DEBUG] [LOCAL ] GPI: Primary data saved (14978 records). [2025-10-31T19:01:56.911434] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-31T19:01:56.911511] [INFO ] [MAIN ] Update Progress: 956/2365 symbols completed. GPI took 17.5s. Estimated remaining: 2h 59m 38s. Rate: 7.8 symbols/min [2025-10-31T19:01:57.066934] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-31T19:01:57.093294] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:01:57.143134] [DEBUG] [LOCAL ] GPK: Loaded 53148 existing records from primary storage. [2025-10-31T19:01:57.143483] [INFO ] [MAIN ] GPK: Loaded 53148 existing records. [2025-10-31T19:01:57.329088] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:01:57.329337] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-31T19:01:57.329386] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-31T19:01:57.330299] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-31T19:01:57.330357] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-31T19:01:57.443387] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-31T19:01:57.706194] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:01:57.857668] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-31T19:01:58.657694] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-31T19:01:59.014566] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-31T19:01:59.016678] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T19:01:59.457732] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-31T19:02:00.257673] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-31T19:02:00.515871] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T19:02:01.057699] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-31T19:02:01.652112] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-31T19:02:01.857739] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-31T19:02:02.246841] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T19:02:02.409123] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T19:02:02.657686] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-31T19:02:03.457678] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-31T19:02:04.090813] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-31T19:02:04.099325] [INFO ] [REMOTE ] GOTU: Full fetch complete (57691 records). [2025-10-31T19:02:04.099465] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-31T19:02:04.274432] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-31T19:02:04.491703] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-31T19:02:04.491823] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-31T19:02:04.492635] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-31T19:02:04.492850] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-31T19:02:04.494187] [DEBUG] [LOCAL ] GOTU: Trimmed 57691 records to 36971 (keeping 200 days of data) [2025-10-31T19:02:04.695349] [DEBUG] [LOCAL ] GOTU: Primary data saved (36971 records). [2025-10-31T19:02:04.695756] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-31T19:02:04.696012] [INFO ] [MAIN ] Update Progress: 957/2365 symbols completed. GOTU took 33.9s. Estimated remaining: 2h 59m 30s. Rate: 7.8 symbols/min [2025-10-31T19:02:04.730157] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T19:02:04.762507] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T19:02:05.057600] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-31T19:02:05.857717] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-31T19:02:06.264027] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T19:02:06.418896] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T19:02:06.657671] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-31T19:02:07.457687] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-31T19:02:07.918565] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-31T19:02:08.075711] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T19:02:08.257691] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-31T19:02:08.615478] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-31T19:02:09.057713] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-31T19:02:09.857673] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-31T19:02:10.277076] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-31T19:02:10.278282] [INFO ] [REMOTE ] GPJA: Full fetch complete (6633 records). [2025-10-31T19:02:10.278348] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-31T19:02:10.640764] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-31T19:02:10.640948] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-31T19:02:10.641146] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-31T19:02:10.641221] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-31T19:02:10.641801] [DEBUG] [LOCAL ] GPJA: Trimmed 6633 records to 4090 (keeping 200 days of data) [2025-10-31T19:02:10.659729] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-31T19:02:10.667767] [DEBUG] [LOCAL ] GPJA: Primary data saved (4090 records). [2025-10-31T19:02:10.667931] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-31T19:02:10.668032] [INFO ] [MAIN ] Update Progress: 958/2365 symbols completed. GPJA took 29.7s. Estimated remaining: 2h 59m 20s. Rate: 7.8 symbols/min [2025-10-31T19:02:10.695912] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T19:02:10.706400] [INFO ] [REMOTE ] GPC: Full fetch complete (68504 records). [2025-10-31T19:02:10.706509] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-31T19:02:11.101204] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-31T19:02:11.101281] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-31T19:02:11.102149] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-31T19:02:11.102210] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-31T19:02:11.103390] [DEBUG] [LOCAL ] GPC: Trimmed 68504 records to 46337 (keeping 200 days of data) [2025-10-31T19:02:11.382475] [DEBUG] [LOCAL ] GPC: Primary data saved (46337 records). [2025-10-31T19:02:11.382589] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-31T19:02:11.383423] [INFO ] [MAIN ] Update Progress: 959/2365 symbols completed. GPC took 38.9s. Estimated remaining: 2h 59m 2s. Rate: 7.9 symbols/min [2025-10-31T19:02:12.074575] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T19:02:12.085602] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-31T19:02:13.376367] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T19:02:13.387060] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-31T19:02:14.734688] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T19:02:14.746053] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-31T19:02:16.219019] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T19:02:16.230461] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-31T19:02:17.692944] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T19:02:17.704413] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-31T19:02:19.334046] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-31T19:02:19.346929] [INFO ] [REMOTE ] GPK: Full fetch complete (76171 records). [2025-10-31T19:02:19.347083] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-31T19:02:19.770219] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-31T19:02:19.770312] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-31T19:02:19.771684] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-31T19:02:19.771748] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-31T19:02:19.773180] [DEBUG] [LOCAL ] GPK: Trimmed 76171 records to 53538 (keeping 200 days of data) [2025-10-31T19:02:20.092834] [DEBUG] [LOCAL ] GPK: Primary data saved (53538 records). [2025-10-31T19:02:20.092968] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-31T19:02:20.093556] [INFO ] [MAIN ] Update Progress: 960/2365 symbols completed. GPK took 23.2s. Estimated remaining: 2h 58m 56s. Rate: 7.9 symbols/min [2025-10-31T19:02:20.777049] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:02:20.852214] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:02:20.854106] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:02:20.850000] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:02:20.883739] [DEBUG] [LOCAL ] GPOR: Loaded 23510 existing records from primary storage. [2025-10-31T19:02:20.884061] [INFO ] [MAIN ] GPOR: Loaded 23510 existing records. [2025-10-31T19:02:20.993017] [DEBUG] [LOCAL ] GPMT: Loaded 25410 existing records from primary storage. [2025-10-31T19:02:21.035388] [DEBUG] [LOCAL ] GPRK: Loaded 40388 existing records from primary storage. [2025-10-31T19:02:21.034537] [INFO ] [MAIN ] GPMT: Loaded 25410 existing records. [2025-10-31T19:02:21.100323] [INFO ] [MAIN ] GPRK: Loaded 40388 existing records. [2025-10-31T19:02:21.223803] [DEBUG] [LOCAL ] GPN: Loaded 52081 existing records from primary storage. [2025-10-31T19:02:21.239391] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:02:21.327914] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-31T19:02:21.301563] [INFO ] [MAIN ] GPN: Loaded 52081 existing records. [2025-10-31T19:02:21.375217] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-31T19:02:21.535044] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-31T19:02:21.534954] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:02:21.581746] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-31T19:02:21.612024] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-31T19:02:21.572843] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-31T19:02:21.625930] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:02:21.651329] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-31T19:02:21.663058] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-31T19:02:21.760025] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-31T19:02:21.866161] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-31T19:02:21.961246] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-31T19:02:21.992957] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:02:22.008853] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-31T19:02:22.008992] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-31T19:02:22.008775] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-31T19:02:22.024592] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-31T19:02:22.161280] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-31T19:02:22.671406] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:02:22.707292] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-31T19:02:23.086231] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:02:23.111943] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-31T19:02:23.318044] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:02:23.329025] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-31T19:02:23.364510] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:02:23.364990] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-31T19:02:23.815314] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T19:02:23.821026] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-31T19:02:24.099022] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T19:02:24.105258] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-31T19:02:24.512162] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T19:02:24.521052] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-31T19:02:24.540066] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-31T19:02:24.545165] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-31T19:02:24.813486] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T19:02:24.823711] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-31T19:02:24.939573] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T19:02:24.945066] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-31T19:02:25.430527] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T19:02:25.458806] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-31T19:02:25.459153] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-31T19:02:25.465336] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-31T19:02:25.799410] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-31T19:02:25.806138] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-31T19:02:26.197023] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T19:02:26.207042] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-31T19:02:26.371984] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-31T19:02:26.480337] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T19:02:26.663263] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-31T19:02:26.672453] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T19:02:27.457628] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-31T19:02:27.590316] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T19:02:27.628703] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T19:02:28.145326] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-31T19:02:28.257714] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-31T19:02:29.057691] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-31T19:02:29.286140] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T19:02:29.857722] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-31T19:02:30.138314] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T19:02:30.591972] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T19:02:30.657680] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-31T19:02:31.457725] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-31T19:02:31.499393] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-31T19:02:32.257692] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-31T19:02:33.005306] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T19:02:33.057619] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-31T19:02:33.147007] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-31T19:02:33.857733] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-31T19:02:34.557608] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-31T19:02:34.558912] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T19:02:34.657689] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-31T19:02:35.442585] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T19:02:35.447719] [INFO ] [REMOTE ] GPMT: Full fetch complete (35802 records). [2025-10-31T19:02:35.447824] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-31T19:02:35.462812] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-31T19:02:35.860430] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-31T19:02:35.860540] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-31T19:02:35.861770] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-31T19:02:35.861853] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-31T19:02:35.863106] [DEBUG] [LOCAL ] GPMT: Trimmed 35802 records to 25509 (keeping 200 days of data) [2025-10-31T19:02:36.019138] [DEBUG] [LOCAL ] GPMT: Primary data saved (25509 records). [2025-10-31T19:02:36.019351] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-31T19:02:36.019462] [INFO ] [MAIN ] Update Progress: 961/2365 symbols completed. GPMT took 15.9s. Estimated remaining: 2h 59m 1s. Rate: 7.8 symbols/min [2025-10-31T19:02:36.222895] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:02:36.253126] [DEBUG] [LOCAL ] GRBK: Loaded 26380 existing records from primary storage. [2025-10-31T19:02:36.253560] [INFO ] [MAIN ] GRBK: Loaded 26380 existing records. [2025-10-31T19:02:36.265430] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-31T19:02:36.450333] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:02:36.450751] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-31T19:02:36.450817] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-31T19:02:36.451132] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-31T19:02:36.451226] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-31T19:02:36.848961] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:02:36.894567] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-31T19:02:37.057702] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-31T19:02:37.399271] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T19:02:37.857724] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-31T19:02:38.444582] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T19:02:38.657698] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-31T19:02:38.692209] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T19:02:39.457673] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-31T19:02:39.862605] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T19:02:40.221851] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T19:02:40.257670] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-31T19:02:41.057673] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-31T19:02:41.252207] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-31T19:02:41.857633] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-31T19:02:42.026473] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T19:02:42.657677] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-31T19:02:42.935518] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T19:02:42.942166] [INFO ] [REMOTE ] GPOR: Full fetch complete (34706 records). [2025-10-31T19:02:42.942315] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-31T19:02:43.313358] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-31T19:02:43.313433] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-31T19:02:43.314066] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-31T19:02:43.314127] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-31T19:02:43.314899] [DEBUG] [LOCAL ] GPOR: Trimmed 34706 records to 23683 (keeping 200 days of data) [2025-10-31T19:02:43.454910] [DEBUG] [LOCAL ] GPOR: Primary data saved (23683 records). [2025-10-31T19:02:43.455027] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-31T19:02:43.455101] [INFO ] [MAIN ] Update Progress: 962/2365 symbols completed. GPOR took 23.4s. Estimated remaining: 2h 58m 53s. Rate: 7.8 symbols/min [2025-10-31T19:02:43.465566] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-31T19:02:43.632560] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:02:43.649252] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T19:02:43.661627] [DEBUG] [LOCAL ] GRC: Loaded 9395 existing records from primary storage. [2025-10-31T19:02:43.661824] [INFO ] [MAIN ] GRC: Loaded 9395 existing records. [2025-10-31T19:02:43.837324] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:02:43.837522] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-31T19:02:43.837568] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-31T19:02:43.837730] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-31T19:02:43.837785] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-31T19:02:44.188058] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:02:44.257691] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-31T19:02:44.919515] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-31T19:02:45.057664] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-31T19:02:45.368795] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T19:02:45.525108] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T19:02:45.857696] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-31T19:02:46.370836] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-31T19:02:46.657690] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-31T19:02:47.174875] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-31T19:02:47.457695] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-31T19:02:47.959371] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T19:02:48.257692] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-31T19:02:49.057765] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-31T19:02:49.595044] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-31T19:02:49.857625] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-31T19:02:49.923631] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-31T19:02:49.935099] [INFO ] [REMOTE ] GPN: Full fetch complete (74984 records). [2025-10-31T19:02:49.935225] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-31T19:02:50.318611] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-31T19:02:50.318735] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-31T19:02:50.324232] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-31T19:02:50.324378] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-31T19:02:50.325432] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-31T19:02:50.328576] [DEBUG] [LOCAL ] GPN: Trimmed 74984 records to 52470 (keeping 200 days of data) [2025-10-31T19:02:50.645109] [DEBUG] [LOCAL ] GPN: Primary data saved (52470 records). [2025-10-31T19:02:50.645235] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-31T19:02:50.645309] [INFO ] [MAIN ] Update Progress: 963/2365 symbols completed. GPN took 30.6s. Estimated remaining: 2h 58m 44s. Rate: 7.8 symbols/min [2025-10-31T19:02:50.662854] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-31T19:02:50.821990] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:02:50.841219] [DEBUG] [LOCAL ] GRDN: Loaded 21901 existing records from primary storage. [2025-10-31T19:02:50.841450] [INFO ] [MAIN ] GRDN: Loaded 21901 existing records. [2025-10-31T19:02:51.016030] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:02:51.016226] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-31T19:02:51.016295] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-31T19:02:51.016809] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-31T19:02:51.016870] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-31T19:02:51.336934] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-31T19:02:51.390699] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:02:51.457613] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-31T19:02:52.039547] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-31T19:02:52.257694] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-31T19:02:52.953038] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T19:02:53.057690] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-31T19:02:53.857625] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-31T19:02:53.924818] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T19:02:54.391688] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T19:02:54.657687] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-31T19:02:55.268794] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-31T19:02:55.457683] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-31T19:02:56.257618] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-31T19:02:56.328276] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-31T19:02:56.811096] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T19:02:57.057665] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-31T19:02:57.754870] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-31T19:02:57.758283] [INFO ] [REMOTE ] GRC: Full fetch complete (13688 records). [2025-10-31T19:02:57.758362] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-31T19:02:57.862761] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-31T19:02:58.135129] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-31T19:02:58.135209] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-31T19:02:58.135510] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-31T19:02:58.135550] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-31T19:02:58.136078] [DEBUG] [LOCAL ] GRC: Trimmed 13688 records to 9457 (keeping 200 days of data) [2025-10-31T19:02:58.195698] [DEBUG] [LOCAL ] GRC: Primary data saved (9457 records). [2025-10-31T19:02:58.195826] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-31T19:02:58.195922] [INFO ] [MAIN ] Update Progress: 964/2365 symbols completed. GRC took 14.7s. Estimated remaining: 2h 58m 37s. Rate: 7.8 symbols/min [2025-10-31T19:02:58.361970] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:02:58.398747] [DEBUG] [LOCAL ] GRMN: Loaded 39779 existing records from primary storage. [2025-10-31T19:02:58.399062] [INFO ] [MAIN ] GRMN: Loaded 39779 existing records. [2025-10-31T19:02:58.574244] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:02:58.574443] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-31T19:02:58.574488] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-31T19:02:58.575258] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-31T19:02:58.575314] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-31T19:02:58.664742] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-31T19:02:58.937388] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:02:58.955134] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T19:02:59.338021] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T19:02:59.457680] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-31T19:03:00.257697] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-31T19:03:00.580715] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T19:03:01.057673] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-31T19:03:01.149085] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T19:03:01.857674] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-31T19:03:02.293263] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T19:03:02.604474] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-31T19:03:02.657631] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-31T19:03:03.457706] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-31T19:03:04.245454] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T19:03:04.256179] [INFO ] [REMOTE ] GPRK: Full fetch complete (58737 records). [2025-10-31T19:03:04.256318] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-31T19:03:04.268055] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-31T19:03:04.553992] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T19:03:04.692205] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-31T19:03:04.692305] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-31T19:03:04.693166] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-31T19:03:04.693237] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-31T19:03:04.694676] [DEBUG] [LOCAL ] GPRK: Trimmed 58737 records to 40767 (keeping 200 days of data) [2025-10-31T19:03:04.954366] [DEBUG] [LOCAL ] GPRK: Primary data saved (40767 records). [2025-10-31T19:03:04.954458] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-31T19:03:04.954554] [INFO ] [MAIN ] Update Progress: 965/2365 symbols completed. GPRK took 44.8s. Estimated remaining: 2h 58m 28s. Rate: 7.8 symbols/min [2025-10-31T19:03:05.059214] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-31T19:03:05.130789] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:03:05.178123] [DEBUG] [LOCAL ] GRND: Loaded 50547 existing records from primary storage. [2025-10-31T19:03:05.178423] [INFO ] [MAIN ] GRND: Loaded 50547 existing records. [2025-10-31T19:03:05.354956] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:03:05.355283] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-31T19:03:05.355344] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-31T19:03:05.355846] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-31T19:03:05.355905] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-31T19:03:05.716953] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:03:05.740985] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-31T19:03:05.857687] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-31T19:03:05.894401] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T19:03:06.657713] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-31T19:03:07.052677] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T19:03:07.457691] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-31T19:03:07.852779] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T19:03:08.091345] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T19:03:08.257710] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-31T19:03:09.057691] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-31T19:03:09.178817] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-31T19:03:09.857689] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-31T19:03:10.243997] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T19:03:10.550305] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-31T19:03:10.657665] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-31T19:03:11.457706] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-31T19:03:11.502620] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T19:03:12.210414] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T19:03:12.257689] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-31T19:03:13.057634] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-31T19:03:13.244271] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T19:03:13.250364] [INFO ] [REMOTE ] GRDN: Full fetch complete (27192 records). [2025-10-31T19:03:13.250466] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-31T19:03:13.620778] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-31T19:03:13.620863] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-31T19:03:13.621418] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-31T19:03:13.621458] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-31T19:03:13.622273] [DEBUG] [LOCAL ] GRDN: Trimmed 27192 records to 22039 (keeping 200 days of data) [2025-10-31T19:03:13.752816] [DEBUG] [LOCAL ] GRDN: Primary data saved (22039 records). [2025-10-31T19:03:13.753026] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-31T19:03:13.753137] [INFO ] [MAIN ] Update Progress: 966/2365 symbols completed. GRDN took 23.1s. Estimated remaining: 2h 58m 22s. Rate: 7.8 symbols/min [2025-10-31T19:03:13.862750] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-31T19:03:13.874811] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-31T19:03:13.957625] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:03:13.989021] [DEBUG] [LOCAL ] GRNT: Loaded 33700 existing records from primary storage. [2025-10-31T19:03:13.989319] [INFO ] [MAIN ] GRNT: Loaded 33700 existing records. [2025-10-31T19:03:14.170284] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:03:14.170596] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-31T19:03:14.170682] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-31T19:03:14.170979] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-31T19:03:14.171034] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-31T19:03:14.534207] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:03:14.657721] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-31T19:03:15.291564] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T19:03:15.457698] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-31T19:03:15.839426] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-31T19:03:15.849040] [INFO ] [REMOTE ] GRBK: Full fetch complete (39843 records). [2025-10-31T19:03:15.849214] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-31T19:03:16.218838] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-31T19:03:16.218912] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-31T19:03:16.219525] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-31T19:03:16.219564] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-31T19:03:16.220355] [DEBUG] [LOCAL ] GRBK: Trimmed 39843 records to 26587 (keeping 200 days of data) [2025-10-31T19:03:16.266927] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-31T19:03:16.375248] [DEBUG] [LOCAL ] GRBK: Primary data saved (26587 records). [2025-10-31T19:03:16.375382] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-31T19:03:16.375467] [INFO ] [MAIN ] Update Progress: 967/2365 symbols completed. GRBK took 40.4s. Estimated remaining: 2h 58m 7s. Rate: 7.8 symbols/min [2025-10-31T19:03:16.541158] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:03:16.541339] [DEBUG] [LOCAL ] GROV: No existing data file found in primary storage. [2025-10-31T19:03:16.541375] [WARN ] [MAIN ] GROV: No existing data found, performing full refresh instead. [2025-10-31T19:03:16.541486] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-31T19:03:16.541526] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-31T19:03:16.541566] [DEBUG] [LOCAL ] GROV: No primary data file found to delete. [2025-10-31T19:03:16.541597] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-31T19:03:16.907828] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:03:16.944381] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-31T19:03:17.057626] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-31T19:03:17.662175] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-31T19:03:17.682378] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T19:03:17.857677] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-31T19:03:18.354223] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T19:03:18.657674] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-31T19:03:19.437109] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T19:03:19.457619] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-31T19:03:20.257639] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-31T19:03:20.349497] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-31T19:03:21.057688] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-31T19:03:21.438353] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-31T19:03:21.857733] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-31T19:03:22.232352] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T19:03:22.657630] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-31T19:03:22.788433] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T19:03:23.457712] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-31T19:03:23.713593] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T19:03:24.257743] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-31T19:03:24.749696] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T19:03:25.057706] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-31T19:03:25.316258] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-31T19:03:25.857678] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-31T19:03:26.218522] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T19:03:26.657691] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-31T19:03:26.983900] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T19:03:27.457740] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-31T19:03:27.924302] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T19:03:28.004384] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T19:03:28.257704] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-31T19:03:28.742578] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-31T19:03:29.057692] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-31T19:03:29.857736] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-31T19:03:30.206496] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T19:03:30.657711] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-31T19:03:31.020872] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T19:03:31.457712] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-31T19:03:32.255692] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T19:03:32.267312] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-31T19:03:32.270237] [INFO ] [REMOTE ] GRND: Full fetch complete (72183 records). [2025-10-31T19:03:32.270455] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-31T19:03:32.688837] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-31T19:03:32.688983] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-31T19:03:32.690434] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-31T19:03:32.690553] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-31T19:03:32.701149] [DEBUG] [LOCAL ] GRND: Trimmed 72183 records to 50912 (keeping 200 days of data) [2025-10-31T19:03:32.716526] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T19:03:33.051107] [DEBUG] [LOCAL ] GRND: Primary data saved (50912 records). [2025-10-31T19:03:33.051317] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-31T19:03:33.051427] [INFO ] [MAIN ] Update Progress: 968/2365 symbols completed. GRND took 28.1s. Estimated remaining: 2h 58m 12s. Rate: 7.8 symbols/min [2025-10-31T19:03:33.063706] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-31T19:03:33.245199] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:03:33.270160] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T19:03:33.281131] [DEBUG] [LOCAL ] GRX: Loaded 4815 existing records from primary storage. [2025-10-31T19:03:33.281448] [INFO ] [MAIN ] GRX: Loaded 4815 existing records. [2025-10-31T19:03:33.462263] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:03:33.462554] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-31T19:03:33.462605] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-31T19:03:33.462883] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-31T19:03:33.462941] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-31T19:03:33.825131] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:03:33.857632] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-31T19:03:34.223304] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T19:03:34.255453] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-31T19:03:34.657692] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-31T19:03:35.457689] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-31T19:03:35.977989] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T19:03:35.987525] [INFO ] [REMOTE ] GRMN: Full fetch complete (59455 records). [2025-10-31T19:03:35.987715] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-31T19:03:36.106047] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-31T19:03:36.262758] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-31T19:03:36.395590] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-31T19:03:36.395695] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-31T19:03:36.396516] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-31T19:03:36.396558] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-31T19:03:36.397701] [DEBUG] [LOCAL ] GRMN: Trimmed 59455 records to 40108 (keeping 200 days of data) [2025-10-31T19:03:36.644907] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-31T19:03:36.649989] [DEBUG] [LOCAL ] GRMN: Primary data saved (40108 records). [2025-10-31T19:03:36.650075] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-31T19:03:36.650808] [INFO ] [MAIN ] Update Progress: 969/2365 symbols completed. GRMN took 38.5s. Estimated remaining: 2h 57m 59s. Rate: 7.8 symbols/min [2025-10-31T19:03:36.819329] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:03:36.872961] [DEBUG] [LOCAL ] GS: Loaded 52100 existing records from primary storage. [2025-10-31T19:03:36.873291] [INFO ] [MAIN ] GS: Loaded 52100 existing records. [2025-10-31T19:03:37.052732] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:03:37.052964] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-31T19:03:37.053020] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-31T19:03:37.053229] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-31T19:03:37.053285] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-31T19:03:37.064484] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-31T19:03:37.418108] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:03:37.857632] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-31T19:03:38.021132] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T19:03:38.221321] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-31T19:03:38.657722] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-31T19:03:39.457696] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-31T19:03:39.809295] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-31T19:03:40.209221] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T19:03:40.257613] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-31T19:03:41.057691] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-31T19:03:41.432538] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T19:03:41.636824] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-31T19:03:41.857623] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-31T19:03:42.556875] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T19:03:42.657628] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-31T19:03:43.204392] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-31T19:03:43.457672] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-31T19:03:43.821541] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-31T19:03:44.257631] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-31T19:03:44.682977] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-31T19:03:45.057679] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-31T19:03:45.857680] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-31T19:03:46.492708] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T19:03:46.495738] [INFO ] [REMOTE ] GROV: Full fetch complete (13433 records). [2025-10-31T19:03:46.495815] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-31T19:03:46.661017] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-31T19:03:46.932455] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-31T19:03:46.932560] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-31T19:03:46.932999] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-31T19:03:46.933158] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-31T19:03:46.933825] [DEBUG] [LOCAL ] GROV: Trimmed 13433 records to 8948 (keeping 200 days of data) [2025-10-31T19:03:47.020870] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-31T19:03:47.035134] [DEBUG] [LOCAL ] GROV: Primary data saved (8948 records). [2025-10-31T19:03:47.035396] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-31T19:03:47.035820] [INFO ] [MAIN ] Update Progress: 970/2365 symbols completed. GROV took 30.7s. Estimated remaining: 2h 57m 55s. Rate: 7.8 symbols/min [2025-10-31T19:03:47.174855] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-31T19:03:47.226243] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:03:47.264978] [DEBUG] [LOCAL ] GSBD: Loaded 39607 existing records from primary storage. [2025-10-31T19:03:47.265296] [INFO ] [MAIN ] GSBD: Loaded 39607 existing records. [2025-10-31T19:03:47.460864] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:03:47.461026] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-31T19:03:47.462787] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-31T19:03:47.462891] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-31T19:03:47.463162] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-31T19:03:47.463203] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-31T19:03:47.861268] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:03:48.257697] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-31T19:03:48.538915] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T19:03:48.650743] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-31T19:03:49.057677] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-31T19:03:49.857692] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-31T19:03:50.657620] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-31T19:03:50.768205] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-31T19:03:50.886638] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T19:03:51.457715] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-31T19:03:51.794747] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T19:03:52.257684] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-31T19:03:52.625240] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-31T19:03:53.057676] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-31T19:03:53.144113] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-31T19:03:53.619757] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-31T19:03:53.857725] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-31T19:03:54.657627] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-31T19:03:54.833126] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T19:03:55.457626] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-31T19:03:55.635195] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T19:03:56.257617] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-31T19:03:56.457902] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-31T19:03:56.465412] [INFO ] [REMOTE ] GRNT: Full fetch complete (48119 records). [2025-10-31T19:03:56.465512] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-31T19:03:56.840376] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-31T19:03:56.840457] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-31T19:03:56.841197] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-31T19:03:56.841259] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-31T19:03:56.842263] [DEBUG] [LOCAL ] GRNT: Trimmed 48119 records to 33903 (keeping 200 days of data) [2025-10-31T19:03:57.058039] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-31T19:03:57.058167] [DEBUG] [LOCAL ] GRNT: Primary data saved (33903 records). [2025-10-31T19:03:57.058706] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-31T19:03:57.059428] [INFO ] [MAIN ] Update Progress: 971/2365 symbols completed. GRNT took 43.3s. Estimated remaining: 2h 57m 51s. Rate: 7.8 symbols/min [2025-10-31T19:03:57.275632] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:03:57.329194] [DEBUG] [LOCAL ] GSK: Loaded 53900 existing records from primary storage. [2025-10-31T19:03:57.329512] [INFO ] [MAIN ] GSK: Loaded 53900 existing records. [2025-10-31T19:03:57.509176] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:03:57.509544] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-31T19:03:57.509775] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-31T19:03:57.510252] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-31T19:03:57.510323] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-31T19:03:57.865948] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:03:57.866087] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-31T19:03:57.895285] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-31T19:03:58.205416] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T19:03:58.377067] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-31T19:03:58.378806] [INFO ] [REMOTE ] GRX: Full fetch complete (6536 records). [2025-10-31T19:03:58.378874] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-31T19:03:58.662725] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-31T19:03:58.734220] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-31T19:03:58.734297] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-31T19:03:58.734480] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-31T19:03:58.734519] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-31T19:03:58.734973] [DEBUG] [LOCAL ] GRX: Trimmed 6536 records to 4850 (keeping 200 days of data) [2025-10-31T19:03:58.763035] [DEBUG] [LOCAL ] GRX: Primary data saved (4850 records). [2025-10-31T19:03:58.763139] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-31T19:03:58.763211] [INFO ] [MAIN ] Update Progress: 972/2365 symbols completed. GRX took 25.7s. Estimated remaining: 2h 57m 34s. Rate: 7.8 symbols/min [2025-10-31T19:03:58.932332] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:03:58.964416] [DEBUG] [LOCAL ] GSL: Loaded 32670 existing records from primary storage. [2025-10-31T19:03:58.964717] [INFO ] [MAIN ] GSL: Loaded 32670 existing records. [2025-10-31T19:03:59.139050] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:03:59.139304] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-31T19:03:59.139350] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-31T19:03:59.139538] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-31T19:03:59.139593] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-31T19:03:59.467676] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-31T19:03:59.487862] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:03:59.856180] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T19:04:00.257637] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-31T19:04:01.057626] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-31T19:04:01.175429] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-31T19:04:01.205416] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T19:04:01.857670] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-31T19:04:02.657617] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-31T19:04:02.777188] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-31T19:04:03.143423] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T19:04:03.457692] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-31T19:04:03.532820] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T19:04:04.257699] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-31T19:04:04.658125] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T19:04:05.057694] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-31T19:04:05.702958] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T19:04:05.857710] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-31T19:04:05.904940] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-31T19:04:06.657677] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-31T19:04:07.431661] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-31T19:04:07.457614] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-31T19:04:07.961936] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T19:04:08.257694] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-31T19:04:09.057674] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-31T19:04:09.159555] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-31T19:04:09.362450] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T19:04:09.857683] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-31T19:04:10.473740] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T19:04:10.657731] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-31T19:04:10.896365] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-31T19:04:11.430174] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-31T19:04:11.447839] [INFO ] [REMOTE ] GS: Full fetch complete (75802 records). [2025-10-31T19:04:11.448235] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-31T19:04:11.463081] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-31T19:04:11.956280] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-31T19:04:11.956377] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-31T19:04:11.957337] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-31T19:04:11.957402] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-31T19:04:11.958867] [DEBUG] [LOCAL ] GS: Trimmed 75802 records to 52476 (keeping 200 days of data) [2025-10-31T19:04:12.262903] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-31T19:04:12.285992] [DEBUG] [LOCAL ] GS: Primary data saved (52476 records). [2025-10-31T19:04:12.286145] [INFO ] [MAIN ] GS: Full history saved. [2025-10-31T19:04:12.286872] [INFO ] [MAIN ] Update Progress: 973/2365 symbols completed. GS took 35.6s. Estimated remaining: 2h 57m 35s. Rate: 7.8 symbols/min [2025-10-31T19:04:12.455096] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:04:12.502179] [DEBUG] [LOCAL ] GTES: Loaded 50623 existing records from primary storage. [2025-10-31T19:04:12.502492] [INFO ] [MAIN ] GTES: Loaded 50623 existing records. [2025-10-31T19:04:12.685263] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:04:12.685696] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-31T19:04:12.685814] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-31T19:04:12.686904] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-31T19:04:12.686971] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-31T19:04:12.902976] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T19:04:13.064897] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-31T19:04:13.106720] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:04:13.749366] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T19:04:13.857702] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-31T19:04:14.191558] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T19:04:14.657672] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-31T19:04:14.856028] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T19:04:15.457696] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-31T19:04:16.035312] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T19:04:16.257671] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-31T19:04:16.477391] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T19:04:17.057715] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-31T19:04:17.756194] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T19:04:17.857606] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-31T19:04:18.032975] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-31T19:04:18.657682] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-31T19:04:19.396174] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-31T19:04:19.457689] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-31T19:04:19.767546] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T19:04:20.257635] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-31T19:04:20.343750] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T19:04:21.057708] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-31T19:04:21.216046] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T19:04:21.857736] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-31T19:04:22.240789] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T19:04:22.657684] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-31T19:04:23.162250] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T19:04:23.169934] [INFO ] [REMOTE ] GSL: Full fetch complete (48285 records). [2025-10-31T19:04:23.170044] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-31T19:04:23.467029] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-31T19:04:23.573353] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-31T19:04:23.573452] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-31T19:04:23.574247] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-31T19:04:23.574311] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-31T19:04:23.575404] [DEBUG] [LOCAL ] GSL: Trimmed 48285 records to 32907 (keeping 200 days of data) [2025-10-31T19:04:23.780974] [DEBUG] [LOCAL ] GSL: Primary data saved (32907 records). [2025-10-31T19:04:23.781116] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-31T19:04:23.781195] [INFO ] [MAIN ] Update Progress: 974/2365 symbols completed. GSL took 25.0s. Estimated remaining: 2h 57m 33s. Rate: 7.8 symbols/min [2025-10-31T19:04:24.019352] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:04:24.060479] [DEBUG] [LOCAL ] GTLS: Loaded 43014 existing records from primary storage. [2025-10-31T19:04:24.061014] [INFO ] [MAIN ] GTLS: Loaded 43014 existing records. [2025-10-31T19:04:24.259697] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-31T19:04:24.263510] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-31T19:04:24.307180] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:04:24.319087] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-31T19:04:24.319334] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-31T19:04:24.319580] [INFO ] [REMOTE ] GSBD: Full fetch complete (58535 records). [2025-10-31T19:04:24.319902] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-31T19:04:24.319736] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-31T19:04:24.320336] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-31T19:04:25.073384] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:04:25.091767] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-31T19:04:25.164240] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-31T19:04:25.164425] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-31T19:04:25.165788] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-31T19:04:25.165953] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-31T19:04:25.168810] [DEBUG] [LOCAL ] GSBD: Trimmed 58535 records to 39977 (keeping 200 days of data) [2025-10-31T19:04:25.357815] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-31T19:04:25.492979] [DEBUG] [LOCAL ] GSBD: Primary data saved (39977 records). [2025-10-31T19:04:25.493199] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-31T19:04:25.493321] [INFO ] [MAIN ] Update Progress: 975/2365 symbols completed. GSBD took 38.5s. Estimated remaining: 2h 57m 17s. Rate: 7.8 symbols/min [2025-10-31T19:04:25.682082] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:04:25.714156] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T19:04:25.756598] [DEBUG] [LOCAL ] GTN: Loaded 44608 existing records from primary storage. [2025-10-31T19:04:25.756954] [INFO ] [MAIN ] GTN: Loaded 44608 existing records. [2025-10-31T19:04:25.862746] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-31T19:04:25.932792] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:04:25.932997] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-31T19:04:25.933044] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-31T19:04:25.933623] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-31T19:04:25.933734] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-31T19:04:26.295964] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:04:26.332787] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T19:04:26.657750] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-31T19:04:27.110112] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T19:04:27.457723] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-31T19:04:27.638917] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T19:04:28.257721] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-31T19:04:28.604702] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-31T19:04:29.057685] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-31T19:04:29.384587] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T19:04:29.857732] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-31T19:04:30.657621] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-31T19:04:30.799984] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-31T19:04:30.812601] [INFO ] [REMOTE ] GSK: Full fetch complete (77637 records). [2025-10-31T19:04:30.812778] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-31T19:04:31.276150] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-31T19:04:31.276018] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-31T19:04:31.276404] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-31T19:04:31.286989] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-31T19:04:31.287353] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-31T19:04:31.289263] [DEBUG] [LOCAL ] GSK: Trimmed 77637 records to 54290 (keeping 200 days of data) [2025-10-31T19:04:31.490723] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-31T19:04:31.659467] [DEBUG] [LOCAL ] GSK: Primary data saved (54290 records). [2025-10-31T19:04:31.659727] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-31T19:04:31.659856] [INFO ] [MAIN ] Update Progress: 976/2365 symbols completed. GSK took 34.6s. Estimated remaining: 2h 57m 7s. Rate: 7.8 symbols/min [2025-10-31T19:04:31.856924] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:04:31.881914] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T19:04:31.913458] [DEBUG] [LOCAL ] GTY: Loaded 29837 existing records from primary storage. [2025-10-31T19:04:31.913751] [INFO ] [MAIN ] GTY: Loaded 29837 existing records. [2025-10-31T19:04:32.084393] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:04:32.084605] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-31T19:04:32.084679] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-31T19:04:32.085269] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-31T19:04:32.085326] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-31T19:04:32.264427] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-31T19:04:32.465286] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:04:32.819120] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T19:04:33.057715] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-31T19:04:33.504919] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T19:04:33.857614] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-31T19:04:33.992079] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-31T19:04:34.657727] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-31T19:04:35.166171] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T19:04:35.457668] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-31T19:04:35.658966] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-31T19:04:36.257673] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-31T19:04:36.739468] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T19:04:37.057849] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-31T19:04:37.444499] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T19:04:37.857632] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-31T19:04:37.920364] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-31T19:04:38.657686] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-31T19:04:39.379968] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T19:04:39.392300] [INFO ] [REMOTE ] GTES: Full fetch complete (73867 records). [2025-10-31T19:04:39.392457] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-31T19:04:39.462738] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-31T19:04:39.781849] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-31T19:04:39.781951] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-31T19:04:39.783028] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-31T19:04:39.783091] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-31T19:04:39.784414] [DEBUG] [LOCAL ] GTES: Trimmed 73867 records to 51012 (keeping 200 days of data) [2025-10-31T19:04:40.024819] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T19:04:40.110867] [DEBUG] [LOCAL ] GTES: Primary data saved (51012 records). [2025-10-31T19:04:40.110992] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-31T19:04:40.111798] [INFO ] [MAIN ] Update Progress: 977/2365 symbols completed. GTES took 27.8s. Estimated remaining: 2h 57m 1s. Rate: 7.8 symbols/min [2025-10-31T19:04:40.260042] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-31T19:04:40.278809] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:04:40.293025] [DEBUG] [LOCAL ] GUG: Loaded 12042 existing records from primary storage. [2025-10-31T19:04:40.293238] [INFO ] [MAIN ] GUG: Loaded 12042 existing records. [2025-10-31T19:04:40.466497] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:04:40.466707] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-31T19:04:40.466761] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-31T19:04:40.467108] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-31T19:04:40.467165] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-31T19:04:40.821363] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:04:40.845390] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T19:04:41.057637] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-31T19:04:41.298726] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T19:04:41.808160] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T19:04:41.857618] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-31T19:04:42.409273] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-31T19:04:42.657668] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-31T19:04:43.457668] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-31T19:04:43.803933] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T19:04:44.257674] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-31T19:04:44.620416] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T19:04:45.057696] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-31T19:04:45.187782] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-31T19:04:45.857666] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-31T19:04:46.397863] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T19:04:46.409332] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T19:04:46.657679] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-31T19:04:47.261999] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-31T19:04:47.457703] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-31T19:04:48.257636] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-31T19:04:48.286630] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T19:04:49.057716] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-31T19:04:49.445870] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T19:04:49.857677] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-31T19:04:50.261678] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T19:04:50.360124] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-31T19:04:50.657674] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-31T19:04:51.457665] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-31T19:04:52.133366] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-31T19:04:52.257631] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-31T19:04:52.531399] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T19:04:53.057701] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-31T19:04:53.341726] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T19:04:53.867556] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-31T19:04:53.870037] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T19:04:54.657686] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-31T19:04:55.121044] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T19:04:55.130569] [INFO ] [REMOTE ] GTLS: Full fetch complete (61293 records). [2025-10-31T19:04:55.130730] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-31T19:04:55.462869] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-31T19:04:55.519661] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-31T19:04:55.519851] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-31T19:04:55.520962] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-31T19:04:55.521056] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-31T19:04:55.539002] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-31T19:04:55.539152] [DEBUG] [LOCAL ] GTLS: Trimmed 61293 records to 43254 (keeping 200 days of data) [2025-10-31T19:04:55.801742] [DEBUG] [LOCAL ] GTLS: Primary data saved (43254 records). [2025-10-31T19:04:55.801879] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-31T19:04:55.801958] [INFO ] [MAIN ] Update Progress: 978/2365 symbols completed. GTLS took 32.0s. Estimated remaining: 2h 57m 4s. Rate: 7.8 symbols/min [2025-10-31T19:04:55.966526] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:04:55.980763] [DEBUG] [LOCAL ] GUT: Loaded 15452 existing records from primary storage. [2025-10-31T19:04:55.981018] [INFO ] [MAIN ] GUT: Loaded 15452 existing records. [2025-10-31T19:04:56.152822] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:04:56.153032] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-31T19:04:56.153079] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-31T19:04:56.153452] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-31T19:04:56.153511] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-31T19:04:56.262770] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-31T19:04:56.501548] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:04:56.792777] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T19:04:57.057715] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-31T19:04:57.624214] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T19:04:57.632670] [INFO ] [REMOTE ] GTY: Full fetch complete (43819 records). [2025-10-31T19:04:57.632824] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-31T19:04:57.828853] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-31T19:04:57.862835] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-31T19:04:58.047027] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-31T19:04:58.047139] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-31T19:04:58.048164] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-31T19:04:58.048235] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-31T19:04:58.049785] [DEBUG] [LOCAL ] GTY: Trimmed 43819 records to 30005 (keeping 200 days of data) [2025-10-31T19:04:58.232912] [DEBUG] [LOCAL ] GTY: Primary data saved (30005 records). [2025-10-31T19:04:58.233063] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-31T19:04:58.233145] [INFO ] [MAIN ] Update Progress: 979/2365 symbols completed. GTY took 26.6s. Estimated remaining: 2h 56m 49s. Rate: 7.8 symbols/min [2025-10-31T19:04:58.399758] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:04:58.430931] [DEBUG] [LOCAL ] GVA: Loaded 32179 existing records from primary storage. [2025-10-31T19:04:58.431201] [INFO ] [MAIN ] GVA: Loaded 32179 existing records. [2025-10-31T19:04:58.618174] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:04:58.618601] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-31T19:04:58.618828] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-31T19:04:58.619040] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-31T19:04:58.619095] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-31T19:04:58.661276] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-31T19:04:58.736555] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T19:04:58.993920] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:04:59.457687] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-31T19:04:59.850209] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T19:05:00.059297] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T19:05:00.257662] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-31T19:05:01.057671] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-31T19:05:01.242534] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T19:05:01.857659] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-31T19:05:01.896073] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-31T19:05:02.434454] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-31T19:05:02.657712] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-31T19:05:03.457701] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-31T19:05:03.678387] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T19:05:04.257705] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-31T19:05:04.743089] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T19:05:05.057677] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-31T19:05:05.525085] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T19:05:05.857637] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-31T19:05:06.378395] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T19:05:06.388176] [INFO ] [REMOTE ] GTN: Full fetch complete (65362 records). [2025-10-31T19:05:06.388309] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-31T19:05:06.662844] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-31T19:05:06.776338] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-31T19:05:06.776415] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-31T19:05:06.777268] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-31T19:05:06.777330] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-31T19:05:06.778480] [DEBUG] [LOCAL ] GTN: Trimmed 65362 records to 44884 (keeping 200 days of data) [2025-10-31T19:05:07.027446] [DEBUG] [LOCAL ] GTN: Primary data saved (44884 records). [2025-10-31T19:05:07.027574] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-31T19:05:07.027672] [INFO ] [MAIN ] Update Progress: 980/2365 symbols completed. GTN took 41.5s. Estimated remaining: 2h 56m 43s. Rate: 7.8 symbols/min [2025-10-31T19:05:07.201895] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:05:07.227808] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T19:05:07.251683] [DEBUG] [LOCAL ] GWH: Loaded 21737 existing records from primary storage. [2025-10-31T19:05:07.251970] [INFO ] [MAIN ] GWH: Loaded 21737 existing records. [2025-10-31T19:05:07.412443] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-31T19:05:07.444925] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:05:07.445152] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-31T19:05:07.445199] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-31T19:05:07.445726] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-31T19:05:07.445784] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-31T19:05:07.465556] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-31T19:05:07.813809] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:05:08.083479] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-31T19:05:08.257717] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-31T19:05:08.936955] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T19:05:08.940336] [INFO ] [REMOTE ] GUG: Full fetch complete (18596 records). [2025-10-31T19:05:08.940443] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-31T19:05:09.062806] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-31T19:05:09.313867] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-31T19:05:09.313947] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-31T19:05:09.314380] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-31T19:05:09.314418] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-31T19:05:09.315003] [DEBUG] [LOCAL ] GUG: Trimmed 18596 records to 12157 (keeping 200 days of data) [2025-10-31T19:05:09.387380] [DEBUG] [LOCAL ] GUG: Primary data saved (12157 records). [2025-10-31T19:05:09.387505] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-31T19:05:09.387579] [INFO ] [MAIN ] Update Progress: 981/2365 symbols completed. GUG took 29.3s. Estimated remaining: 2h 56m 28s. Rate: 7.8 symbols/min [2025-10-31T19:05:09.557129] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:05:09.592573] [DEBUG] [LOCAL ] GWRE: Loaded 39496 existing records from primary storage. [2025-10-31T19:05:09.592884] [INFO ] [MAIN ] GWRE: Loaded 39496 existing records. [2025-10-31T19:05:09.774085] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:05:09.774297] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-31T19:05:09.774346] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-31T19:05:09.775054] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-31T19:05:09.775111] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-31T19:05:09.863454] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-31T19:05:10.137774] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:05:10.193991] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-31T19:05:10.464017] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-31T19:05:10.657677] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-31T19:05:11.457630] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-31T19:05:11.591705] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-31T19:05:11.974319] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-31T19:05:12.257627] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-31T19:05:13.057697] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-31T19:05:13.404013] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-31T19:05:13.738373] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T19:05:13.857680] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-31T19:05:14.657758] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-31T19:05:14.958372] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T19:05:15.457680] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-31T19:05:15.953399] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:05:15.999055] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T19:05:16.257750] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-31T19:05:17.057638] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-31T19:05:17.235227] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T19:05:17.857674] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-31T19:05:18.130420] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-31T19:05:18.229334] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-31T19:05:18.657710] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-31T19:05:19.138215] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-31T19:05:19.457745] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-31T19:05:20.257716] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-31T19:05:20.647768] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T19:05:21.057758] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-31T19:05:21.439992] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-31T19:05:21.451533] [INFO ] [REMOTE ] GVA: Full fetch complete (48459 records). [2025-10-31T19:05:21.451754] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-31T19:05:21.858101] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-31T19:05:21.975033] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-31T19:05:22.029278] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-31T19:05:22.029830] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-31T19:05:22.030625] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-31T19:05:22.030718] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-31T19:05:22.031966] [DEBUG] [LOCAL ] GVA: Trimmed 48459 records to 32378 (keeping 200 days of data) [2025-10-31T19:05:22.270052] [DEBUG] [LOCAL ] GVA: Primary data saved (32378 records). [2025-10-31T19:05:22.270245] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-31T19:05:22.270373] [INFO ] [MAIN ] Update Progress: 982/2365 symbols completed. GVA took 24.0s. Estimated remaining: 2h 56m 28s. Rate: 7.8 symbols/min [2025-10-31T19:05:22.517126] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:05:22.540589] [DEBUG] [LOCAL ] GWW: Loaded 19011 existing records from primary storage. [2025-10-31T19:05:22.540917] [INFO ] [MAIN ] GWW: Loaded 19011 existing records. [2025-10-31T19:05:22.662798] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-31T19:05:22.727960] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:05:22.728167] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-31T19:05:22.728214] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-31T19:05:22.728424] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-31T19:05:22.728479] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-31T19:05:23.122365] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:05:23.253013] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-31T19:05:23.457634] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-31T19:05:23.531791] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T19:05:24.265973] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-31T19:05:24.268457] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T19:05:25.057690] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-31T19:05:25.420229] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-31T19:05:25.822358] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T19:05:25.857680] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-31T19:05:26.658822] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-31T19:05:26.662998] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T19:05:27.293763] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-31T19:05:27.457630] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-31T19:05:28.185159] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T19:05:28.257634] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-31T19:05:28.994629] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T19:05:29.057664] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-31T19:05:29.794022] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T19:05:29.857627] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-31T19:05:30.657736] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-31T19:05:31.387039] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:05:31.457682] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-31T19:05:31.914365] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-31T19:05:31.924508] [INFO ] [REMOTE ] GWH: Full fetch complete (26325 records). [2025-10-31T19:05:31.924692] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-31T19:05:32.258936] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-31T19:05:32.296007] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-31T19:05:32.296148] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-31T19:05:32.296875] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-31T19:05:32.296939] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-31T19:05:32.298071] [DEBUG] [LOCAL ] GWH: Trimmed 26325 records to 22019 (keeping 200 days of data) [2025-10-31T19:05:32.424744] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T19:05:32.451750] [DEBUG] [LOCAL ] GWH: Primary data saved (22019 records). [2025-10-31T19:05:32.452369] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-31T19:05:32.452502] [INFO ] [MAIN ] Update Progress: 983/2365 symbols completed. GWH took 25.4s. Estimated remaining: 2h 56m 24s. Rate: 7.8 symbols/min [2025-10-31T19:05:32.619396] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:05:32.661010] [DEBUG] [LOCAL ] GXO: Loaded 46301 existing records from primary storage. [2025-10-31T19:05:32.661332] [INFO ] [MAIN ] GXO: Loaded 46301 existing records. [2025-10-31T19:05:32.838407] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:05:32.838697] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-31T19:05:32.838767] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-31T19:05:32.839692] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-31T19:05:32.839751] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-31T19:05:33.062798] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-31T19:05:33.201638] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:05:33.646097] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-31T19:05:33.667950] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-31T19:05:33.857680] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-31T19:05:34.657727] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-31T19:05:35.028076] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T19:05:35.377366] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-31T19:05:35.381635] [INFO ] [REMOTE ] GUT: Full fetch complete (22344 records). [2025-10-31T19:05:35.381761] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-31T19:05:35.462783] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-31T19:05:35.751252] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-31T19:05:35.751330] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-31T19:05:35.751799] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-31T19:05:35.751868] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-31T19:05:35.752416] [DEBUG] [LOCAL ] GUT: Trimmed 22344 records to 15540 (keeping 200 days of data) [2025-10-31T19:05:35.839254] [DEBUG] [LOCAL ] GUT: Primary data saved (15540 records). [2025-10-31T19:05:35.839380] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-31T19:05:35.839454] [INFO ] [MAIN ] Update Progress: 984/2365 symbols completed. GUT took 40.0s. Estimated remaining: 2h 56m 10s. Rate: 7.8 symbols/min [2025-10-31T19:05:36.022830] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:05:36.025745] [DEBUG] [LOCAL ] GYLD: Loaded 1521 existing records from primary storage. [2025-10-31T19:05:36.025894] [INFO ] [MAIN ] GYLD: Loaded 1521 existing records. [2025-10-31T19:05:36.202581] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:05:36.202825] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-31T19:05:36.202889] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-31T19:05:36.203060] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-31T19:05:36.203116] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-31T19:05:36.266413] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-31T19:05:36.488344] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-31T19:05:36.590888] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:05:37.057687] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-31T19:05:37.367849] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T19:05:37.785055] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T19:05:37.857606] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-31T19:05:38.387113] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T19:05:38.657688] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-31T19:05:39.457704] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-31T19:05:39.696887] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-31T19:05:39.772862] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T19:05:40.257685] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-31T19:05:41.057720] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-31T19:05:41.372234] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:05:41.372866] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T19:05:41.857698] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-31T19:05:42.657691] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-31T19:05:43.074734] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-31T19:05:43.083069] [INFO ] [REMOTE ] GWRE: Full fetch complete (59740 records). [2025-10-31T19:05:43.083185] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-31T19:05:43.465433] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-31T19:05:43.464629] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-31T19:05:43.465557] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-31T19:05:43.467296] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-31T19:05:43.467359] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-31T19:05:43.468558] [DEBUG] [LOCAL ] GWRE: Trimmed 59740 records to 39752 (keeping 200 days of data) [2025-10-31T19:05:43.702637] [DEBUG] [LOCAL ] GWRE: Primary data saved (39752 records). [2025-10-31T19:05:43.702798] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-31T19:05:43.703498] [INFO ] [MAIN ] Update Progress: 985/2365 symbols completed. GWRE took 34.3s. Estimated remaining: 2h 56m 3s. Rate: 7.8 symbols/min [2025-10-31T19:05:43.883319] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:05:43.910078] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:05:43.958416] [DEBUG] [LOCAL ] H: Loaded 44565 existing records from primary storage. [2025-10-31T19:05:43.958791] [INFO ] [MAIN ] H: Loaded 44565 existing records. [2025-10-31T19:05:44.145721] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:05:44.145973] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-31T19:05:44.146085] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-31T19:05:44.146970] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-31T19:05:44.147029] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-31T19:05:44.259761] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-31T19:05:44.472956] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T19:05:44.532551] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:05:45.057627] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-31T19:05:45.550800] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T19:05:45.857615] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-31T19:05:45.995419] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-31T19:05:46.657675] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-31T19:05:46.933274] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-31T19:05:47.147118] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T19:05:47.457677] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-31T19:05:48.159927] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T19:05:48.257611] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-31T19:05:49.030619] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T19:05:49.057608] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-31T19:05:49.857688] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-31T19:05:50.035495] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-31T19:05:50.040366] [INFO ] [REMOTE ] GWW: Full fetch complete (29086 records). [2025-10-31T19:05:50.040452] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-31T19:05:50.149444] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-31T19:05:50.422351] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-31T19:05:50.422429] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-31T19:05:50.423015] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-31T19:05:50.423083] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-31T19:05:50.423850] [DEBUG] [LOCAL ] GWW: Trimmed 29086 records to 19272 (keeping 200 days of data) [2025-10-31T19:05:50.546047] [DEBUG] [LOCAL ] GWW: Primary data saved (19272 records). [2025-10-31T19:05:50.546203] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-31T19:05:50.546281] [INFO ] [MAIN ] Update Progress: 986/2365 symbols completed. GWW took 28.3s. Estimated remaining: 2h 55m 54s. Rate: 7.8 symbols/min [2025-10-31T19:05:50.662763] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-31T19:05:50.716967] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:05:50.752856] [DEBUG] [LOCAL ] HAE: Loaded 39086 existing records from primary storage. [2025-10-31T19:05:50.753171] [INFO ] [MAIN ] HAE: Loaded 39086 existing records. [2025-10-31T19:05:50.933762] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:05:50.933990] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-31T19:05:50.934037] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-31T19:05:50.934685] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-31T19:05:50.934742] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-31T19:05:51.016204] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-31T19:05:51.314449] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:05:51.457683] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-31T19:05:52.257637] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-31T19:05:52.481926] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T19:05:53.057674] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-31T19:05:53.365724] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T19:05:53.857674] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-31T19:05:54.117208] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T19:05:54.657728] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-31T19:05:54.941156] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T19:05:55.457670] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-31T19:05:55.736741] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-31T19:05:55.910047] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T19:05:56.257629] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-31T19:05:57.057625] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-31T19:05:57.593354] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T19:05:57.857758] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-31T19:05:58.103379] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-31T19:05:58.231762] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T19:05:58.657686] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-31T19:05:58.971162] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-31T19:05:59.457722] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-31T19:06:00.257632] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-31T19:06:00.819032] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T19:06:01.057709] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-31T19:06:01.815634] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-31T19:06:01.857606] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-31T19:06:02.328769] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T19:06:02.657720] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-31T19:06:02.969906] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T19:06:03.457724] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-31T19:06:03.942230] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T19:06:04.257729] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-31T19:06:04.644468] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T19:06:05.057715] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-31T19:06:05.341790] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-31T19:06:05.564878] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T19:06:05.857744] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-31T19:06:06.657709] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-31T19:06:06.874763] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T19:06:07.052881] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-31T19:06:07.053812] [INFO ] [REMOTE ] GYLD: Full fetch complete (2118 records). [2025-10-31T19:06:07.053878] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-31T19:06:07.423831] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-31T19:06:07.423908] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-31T19:06:07.423999] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-31T19:06:07.424036] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-31T19:06:07.424341] [DEBUG] [LOCAL ] GYLD: Trimmed 2118 records to 1530 (keeping 200 days of data) [2025-10-31T19:06:07.433799] [DEBUG] [LOCAL ] GYLD: Primary data saved (1530 records). [2025-10-31T19:06:07.433856] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-31T19:06:07.433918] [INFO ] [MAIN ] Update Progress: 987/2365 symbols completed. GYLD took 31.6s. Estimated remaining: 2h 55m 59s. Rate: 7.8 symbols/min [2025-10-31T19:06:07.463411] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-31T19:06:07.608510] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:06:07.644998] [DEBUG] [LOCAL ] HAFN: Loaded 42646 existing records from primary storage. [2025-10-31T19:06:07.645283] [INFO ] [MAIN ] HAFN: Loaded 42646 existing records. [2025-10-31T19:06:07.828149] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:06:07.828384] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-31T19:06:07.828432] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-31T19:06:07.829197] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-31T19:06:07.829255] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-31T19:06:08.188826] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:06:08.257634] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-31T19:06:08.821095] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T19:06:09.057738] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-31T19:06:09.311600] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T19:06:09.857694] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-31T19:06:10.320699] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T19:06:10.657621] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-31T19:06:10.799724] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-31T19:06:11.457718] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-31T19:06:11.998833] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-31T19:06:12.257627] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-31T19:06:12.539831] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-31T19:06:13.057675] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-31T19:06:13.539478] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T19:06:13.857803] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-31T19:06:14.218821] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T19:06:14.657658] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-31T19:06:15.173366] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T19:06:15.184188] [INFO ] [REMOTE ] H: Full fetch complete (63836 records). [2025-10-31T19:06:15.184331] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-31T19:06:15.462760] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-31T19:06:15.581222] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-31T19:06:15.581309] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-31T19:06:15.582163] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-31T19:06:15.582224] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-31T19:06:15.583385] [DEBUG] [LOCAL ] H: Trimmed 63836 records to 44904 (keeping 200 days of data) [2025-10-31T19:06:15.854669] [DEBUG] [LOCAL ] H: Primary data saved (44904 records). [2025-10-31T19:06:15.854811] [INFO ] [MAIN ] H: Full history saved. [2025-10-31T19:06:15.855614] [INFO ] [MAIN ] Update Progress: 988/2365 symbols completed. H took 32.2s. Estimated remaining: 2h 55m 53s. Rate: 7.8 symbols/min [2025-10-31T19:06:16.030156] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:06:16.081887] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-10-31T19:06:16.082261] [INFO ] [MAIN ] HAL: Loaded 54108 existing records. [2025-10-31T19:06:16.264582] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-31T19:06:16.269257] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:06:16.270498] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-31T19:06:16.270734] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-31T19:06:16.271792] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-31T19:06:16.271854] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-31T19:06:16.427944] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-31T19:06:16.510905] [INFO ] [REMOTE ] GXO: Full fetch complete (68999 records). [2025-10-31T19:06:16.533006] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-31T19:06:16.844295] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:06:17.062740] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-31T19:06:17.062612] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-31T19:06:17.124314] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-31T19:06:17.124419] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-31T19:06:17.125884] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-31T19:06:17.125952] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-31T19:06:17.127261] [DEBUG] [LOCAL ] GXO: Trimmed 68999 records to 46626 (keeping 200 days of data) [2025-10-31T19:06:17.404101] [DEBUG] [LOCAL ] GXO: Primary data saved (46626 records). [2025-10-31T19:06:17.404345] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-31T19:06:17.404500] [INFO ] [MAIN ] Update Progress: 989/2365 symbols completed. GXO took 45.0s. Estimated remaining: 2h 55m 36s. Rate: 7.8 symbols/min [2025-10-31T19:06:17.616769] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:06:17.613866] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T19:06:17.664462] [DEBUG] [LOCAL ] HASI: Loaded 47673 existing records from primary storage. [2025-10-31T19:06:17.664890] [INFO ] [MAIN ] HASI: Loaded 47673 existing records. [2025-10-31T19:06:17.839868] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:06:17.840081] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-31T19:06:17.840135] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-31T19:06:17.841117] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-31T19:06:17.841176] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-31T19:06:17.862873] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-31T19:06:18.190507] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:06:18.565173] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T19:06:18.657719] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-31T19:06:19.004406] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T19:06:19.457705] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-31T19:06:19.789790] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-31T19:06:20.257705] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-31T19:06:20.833632] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-31T19:06:21.057695] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-31T19:06:21.423778] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T19:06:21.857697] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-31T19:06:22.024168] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T19:06:22.657681] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-31T19:06:23.063535] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T19:06:23.457676] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-31T19:06:24.090281] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T19:06:24.257629] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-31T19:06:24.752947] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T19:06:24.762096] [INFO ] [REMOTE ] HAE: Full fetch complete (59352 records). [2025-10-31T19:06:24.762246] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-31T19:06:25.065270] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-31T19:06:25.160109] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-31T19:06:25.160189] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-31T19:06:25.161016] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-31T19:06:25.161078] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-31T19:06:25.162223] [DEBUG] [LOCAL ] HAE: Trimmed 59352 records to 39312 (keeping 200 days of data) [2025-10-31T19:06:25.384391] [DEBUG] [LOCAL ] HAE: Primary data saved (39312 records). [2025-10-31T19:06:25.384525] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-31T19:06:25.384602] [INFO ] [MAIN ] Update Progress: 990/2365 symbols completed. HAE took 34.8s. Estimated remaining: 2h 55m 29s. Rate: 7.8 symbols/min [2025-10-31T19:06:25.563936] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:06:25.606415] [DEBUG] [LOCAL ] HAYW: Loaded 49130 existing records from primary storage. [2025-10-31T19:06:25.606756] [INFO ] [MAIN ] HAYW: Loaded 49130 existing records. [2025-10-31T19:06:25.785606] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:06:25.785873] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-31T19:06:25.786043] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-31T19:06:25.786938] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-31T19:06:25.786994] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-31T19:06:25.871462] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-31T19:06:25.967772] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-31T19:06:26.189628] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:06:26.238801] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T19:06:26.657685] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-31T19:06:27.051895] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T19:06:27.457631] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-31T19:06:27.849325] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T19:06:28.257679] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-31T19:06:28.560512] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T19:06:29.057678] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-31T19:06:29.347008] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T19:06:29.857703] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-31T19:06:30.608328] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-31T19:06:30.657691] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-31T19:06:31.106145] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:06:31.457708] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-31T19:06:32.219490] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-31T19:06:32.257608] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-31T19:06:32.797107] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-31T19:06:33.057728] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-31T19:06:33.775514] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T19:06:33.857626] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-31T19:06:34.289916] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T19:06:34.657670] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-31T19:06:35.340689] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T19:06:35.457621] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-31T19:06:35.849422] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-31T19:06:36.257716] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-31T19:06:36.987062] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-31T19:06:37.057675] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-31T19:06:37.620200] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T19:06:37.691024] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T19:06:37.703512] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-31T19:06:37.703741] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-31T19:06:37.863058] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-31T19:06:38.101309] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-31T19:06:38.101389] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-31T19:06:38.102340] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-31T19:06:38.102402] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-31T19:06:38.103781] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 54498 (keeping 200 days of data) [2025-10-31T19:06:38.422322] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-10-31T19:06:38.422451] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-31T19:06:38.423169] [INFO ] [MAIN ] Update Progress: 991/2365 symbols completed. HAL took 22.6s. Estimated remaining: 2h 55m 29s. Rate: 7.8 symbols/min [2025-10-31T19:06:38.590161] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:06:38.598261] [DEBUG] [LOCAL ] HBB: Loaded 5952 existing records from primary storage. [2025-10-31T19:06:38.598475] [INFO ] [MAIN ] HBB: Loaded 5952 existing records. [2025-10-31T19:06:38.662895] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-31T19:06:38.774073] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:06:38.774266] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-31T19:06:38.774311] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-31T19:06:38.774565] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-31T19:06:38.774621] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-31T19:06:39.141490] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:06:39.166635] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T19:06:39.457623] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-31T19:06:39.912905] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T19:06:39.941151] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-31T19:06:40.257636] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-31T19:06:41.057686] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-31T19:06:41.355429] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T19:06:41.370211] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T19:06:41.857686] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-31T19:06:42.657669] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-31T19:06:43.189858] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-31T19:06:43.199596] [INFO ] [REMOTE ] HAFN: Full fetch complete (64301 records). [2025-10-31T19:06:43.199785] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-31T19:06:43.462772] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-31T19:06:43.622855] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-31T19:06:43.622987] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-31T19:06:43.623866] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-31T19:06:43.624010] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-31T19:06:43.625635] [DEBUG] [LOCAL ] HAFN: Trimmed 64301 records to 42941 (keeping 200 days of data) [2025-10-31T19:06:43.751211] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T19:06:43.904196] [DEBUG] [LOCAL ] HAFN: Primary data saved (42941 records). [2025-10-31T19:06:43.904319] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-31T19:06:43.904940] [INFO ] [MAIN ] Update Progress: 992/2365 symbols completed. HAFN took 36.5s. Estimated remaining: 2h 55m 18s. Rate: 7.8 symbols/min [2025-10-31T19:06:44.072454] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:06:44.121639] [DEBUG] [LOCAL ] HBI: Loaded 53268 existing records from primary storage. [2025-10-31T19:06:44.122045] [INFO ] [MAIN ] HBI: Loaded 53268 existing records. [2025-10-31T19:06:44.262718] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-31T19:06:44.296581] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:06:44.296765] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-31T19:06:44.296812] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-31T19:06:44.297537] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-31T19:06:44.297594] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-31T19:06:44.645914] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:06:44.822079] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-31T19:06:44.874231] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T19:06:45.057682] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-31T19:06:45.857718] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-31T19:06:46.189974] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T19:06:46.657675] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-31T19:06:46.965523] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T19:06:47.457738] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-31T19:06:47.916788] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T19:06:48.257687] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-31T19:06:48.886007] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-31T19:06:49.057712] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-31T19:06:49.395259] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T19:06:49.857744] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-31T19:06:50.340586] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T19:06:50.352813] [INFO ] [REMOTE ] HAYW: Full fetch complete (70971 records). [2025-10-31T19:06:50.352995] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-31T19:06:50.659161] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-31T19:06:50.762827] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-31T19:06:50.762944] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-31T19:06:50.764581] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-31T19:06:50.764678] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-31T19:06:50.766622] [DEBUG] [LOCAL ] HAYW: Trimmed 70971 records to 49491 (keeping 200 days of data) [2025-10-31T19:06:51.055754] [DEBUG] [LOCAL ] HAYW: Primary data saved (49491 records). [2025-10-31T19:06:51.055908] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-31T19:06:51.073331] [INFO ] [MAIN ] Update Progress: 993/2365 symbols completed. HAYW took 25.7s. Estimated remaining: 2h 55m 10s. Rate: 7.8 symbols/min [2025-10-31T19:06:51.169056] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T19:06:51.280874] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:06:51.291426] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-31T19:06:51.341182] [DEBUG] [LOCAL ] HBM: Loaded 53368 existing records from primary storage. [2025-10-31T19:06:51.341530] [INFO ] [MAIN ] HBM: Loaded 53368 existing records. [2025-10-31T19:06:51.462838] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-31T19:06:51.516889] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:06:51.517117] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-31T19:06:51.517165] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-31T19:06:51.518102] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-31T19:06:51.518159] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-31T19:06:51.861220] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:06:52.257696] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-31T19:06:52.760453] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-31T19:06:52.807748] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T19:06:53.057694] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-31T19:06:53.348378] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-31T19:06:53.857695] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-31T19:06:54.335311] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-31T19:06:54.657699] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-31T19:06:55.457707] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-31T19:06:56.042025] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-31T19:06:56.053198] [INFO ] [REMOTE ] HASI: Full fetch complete (68204 records). [2025-10-31T19:06:56.053361] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-31T19:06:56.262972] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-31T19:06:56.446631] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-31T19:06:56.446762] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-31T19:06:56.447694] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-31T19:06:56.447758] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-31T19:06:56.449211] [DEBUG] [LOCAL ] HASI: Trimmed 68204 records to 47986 (keeping 200 days of data) [2025-10-31T19:06:56.740889] [DEBUG] [LOCAL ] HASI: Primary data saved (47986 records). [2025-10-31T19:06:56.741118] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-31T19:06:56.741237] [INFO ] [MAIN ] Update Progress: 994/2365 symbols completed. HASI took 39.3s. Estimated remaining: 2h 54m 60s. Rate: 7.8 symbols/min [2025-10-31T19:06:56.896584] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-31T19:06:56.967166] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T19:06:56.971225] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:06:57.024037] [DEBUG] [LOCAL ] HCA: Loaded 47150 existing records from primary storage. [2025-10-31T19:06:57.024352] [INFO ] [MAIN ] HCA: Loaded 47150 existing records. [2025-10-31T19:06:57.062876] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-31T19:06:57.200722] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:06:57.200969] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-31T19:06:57.201018] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-31T19:06:57.201965] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-31T19:06:57.202022] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-31T19:06:57.560127] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:06:57.857692] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-31T19:06:58.406272] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-31T19:06:58.657727] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-31T19:06:59.171189] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T19:06:59.457683] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-31T19:07:00.143625] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-31T19:07:00.257670] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-31T19:07:00.939201] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-31T19:07:01.057696] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-31T19:07:01.467718] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T19:07:01.581394] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-31T19:07:01.857764] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-31T19:07:02.441446] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T19:07:02.443322] [INFO ] [REMOTE ] HBB: Full fetch complete (9076 records). [2025-10-31T19:07:02.443415] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-31T19:07:02.662751] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-31T19:07:02.804219] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-31T19:07:02.804304] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-31T19:07:02.804546] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-31T19:07:02.804586] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-31T19:07:02.805040] [DEBUG] [LOCAL ] HBB: Trimmed 9076 records to 5971 (keeping 200 days of data) [2025-10-31T19:07:02.841252] [DEBUG] [LOCAL ] HBB: Primary data saved (5971 records). [2025-10-31T19:07:02.841381] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-31T19:07:02.841464] [INFO ] [MAIN ] Update Progress: 995/2365 symbols completed. HBB took 24.4s. Estimated remaining: 2h 54m 50s. Rate: 7.8 symbols/min [2025-10-31T19:07:03.014597] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:07:03.059392] [DEBUG] [LOCAL ] HCC: Loaded 44872 existing records from primary storage. [2025-10-31T19:07:03.059731] [INFO ] [MAIN ] HCC: Loaded 44872 existing records. [2025-10-31T19:07:03.246672] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:07:03.246887] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-31T19:07:03.246935] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-31T19:07:03.247190] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-31T19:07:03.247231] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-31T19:07:03.466368] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-31T19:07:03.602543] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:07:04.220863] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-31T19:07:04.257605] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-31T19:07:04.882300] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-31T19:07:05.057679] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-31T19:07:05.607164] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T19:07:05.857692] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-31T19:07:06.443464] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T19:07:06.657680] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-31T19:07:07.307756] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T19:07:07.457724] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-31T19:07:08.101858] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-31T19:07:08.257730] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-31T19:07:09.010601] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T19:07:09.057678] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-31T19:07:09.480810] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T19:07:09.857739] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-31T19:07:10.264595] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T19:07:10.657732] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-31T19:07:10.932880] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T19:07:11.457738] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-31T19:07:12.227107] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T19:07:12.239216] [INFO ] [REMOTE ] HBI: Full fetch complete (76936 records). [2025-10-31T19:07:12.239355] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-31T19:07:12.262755] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-31T19:07:12.638967] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-31T19:07:12.639064] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-31T19:07:12.640066] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-31T19:07:12.640131] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-31T19:07:12.641548] [DEBUG] [LOCAL ] HBI: Trimmed 76936 records to 53646 (keeping 200 days of data) [2025-10-31T19:07:12.863876] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T19:07:12.976121] [DEBUG] [LOCAL ] HBI: Primary data saved (53646 records). [2025-10-31T19:07:12.976262] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-31T19:07:12.976878] [INFO ] [MAIN ] Update Progress: 996/2365 symbols completed. HBI took 29.1s. Estimated remaining: 2h 54m 46s. Rate: 7.8 symbols/min [2025-10-31T19:07:13.064574] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-31T19:07:13.143308] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:07:13.159885] [DEBUG] [LOCAL ] HCI: Loaded 13931 existing records from primary storage. [2025-10-31T19:07:13.160118] [INFO ] [MAIN ] HCI: Loaded 13931 existing records. [2025-10-31T19:07:13.334182] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:07:13.334426] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-31T19:07:13.334473] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-31T19:07:13.334636] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-31T19:07:13.334719] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-31T19:07:13.696401] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:07:13.723864] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-31T19:07:13.857678] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-31T19:07:14.449038] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T19:07:14.575280] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T19:07:14.657624] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-31T19:07:15.298951] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-31T19:07:15.457624] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-31T19:07:16.137452] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-31T19:07:16.257637] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-31T19:07:17.057672] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-31T19:07:17.401175] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T19:07:17.726638] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T19:07:17.857699] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-31T19:07:18.522964] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T19:07:18.657688] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-31T19:07:19.457695] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-31T19:07:20.077030] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-31T19:07:20.257673] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-31T19:07:20.582619] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T19:07:20.968142] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-31T19:07:21.057692] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-31T19:07:21.857751] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-31T19:07:22.438196] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T19:07:22.513735] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T19:07:22.657617] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-31T19:07:23.352716] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-31T19:07:23.457627] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-31T19:07:24.257676] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-31T19:07:24.829376] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T19:07:24.909449] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T19:07:25.057677] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-31T19:07:25.857692] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-31T19:07:26.186276] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T19:07:26.657678] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-31T19:07:27.380069] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T19:07:27.457685] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-31T19:07:27.857199] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T19:07:28.257665] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-31T19:07:28.976814] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-31T19:07:29.057636] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-31T19:07:29.109456] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T19:07:29.113521] [INFO ] [REMOTE ] HCI: Full fetch complete (19523 records). [2025-10-31T19:07:29.113605] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-31T19:07:29.523199] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-31T19:07:29.523283] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-31T19:07:29.523795] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-31T19:07:29.523857] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-31T19:07:29.524417] [DEBUG] [LOCAL ] HCI: Trimmed 19523 records to 14038 (keeping 200 days of data) [2025-10-31T19:07:29.615595] [DEBUG] [LOCAL ] HCI: Primary data saved (14038 records). [2025-10-31T19:07:29.615757] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-31T19:07:29.615841] [INFO ] [MAIN ] Update Progress: 997/2365 symbols completed. HCI took 16.6s. Estimated remaining: 2h 54m 50s. Rate: 7.8 symbols/min [2025-10-31T19:07:29.857697] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-31T19:07:30.292724] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T19:07:30.657635] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-31T19:07:31.167895] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T19:07:31.457683] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-31T19:07:31.960352] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:07:32.257669] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-31T19:07:33.062869] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-31T19:07:33.094256] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-31T19:07:33.107550] [INFO ] [REMOTE ] HBM: Full fetch complete (76839 records). [2025-10-31T19:07:33.107788] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-31T19:07:33.515501] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-31T19:07:33.515675] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-31T19:07:33.517886] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-31T19:07:33.518131] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-31T19:07:33.520075] [DEBUG] [LOCAL ] HBM: Trimmed 76839 records to 53758 (keeping 200 days of data) [2025-10-31T19:07:33.641377] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-31T19:07:33.860831] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-31T19:07:33.906452] [DEBUG] [LOCAL ] HBM: Primary data saved (53758 records). [2025-10-31T19:07:33.906629] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-31T19:07:33.906782] [INFO ] [MAIN ] Update Progress: 998/2365 symbols completed. HBM took 42.8s. Estimated remaining: 2h 54m 38s. Rate: 7.8 symbols/min [2025-10-31T19:07:34.620362] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-31T19:07:34.634394] [INFO ] [REMOTE ] HCA: Full fetch complete (68879 records). [2025-10-31T19:07:34.634577] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-31T19:07:35.074772] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-31T19:07:35.074913] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-31T19:07:35.077028] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-31T19:07:35.077179] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-31T19:07:35.094463] [DEBUG] [LOCAL ] HCA: Trimmed 68879 records to 47483 (keeping 200 days of data) [2025-10-31T19:07:35.105507] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T19:07:35.116556] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-31T19:07:35.439963] [DEBUG] [LOCAL ] HCA: Primary data saved (47483 records). [2025-10-31T19:07:35.440189] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-31T19:07:35.440306] [INFO ] [MAIN ] Update Progress: 999/2365 symbols completed. HCA took 38.7s. Estimated remaining: 2h 54m 22s. Rate: 7.8 symbols/min [2025-10-31T19:07:36.499699] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-31T19:07:36.510390] [INFO ] [REMOTE ] HCC: Full fetch complete (64588 records). [2025-10-31T19:07:36.510584] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-31T19:07:36.900463] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-31T19:07:36.900552] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-31T19:07:36.901420] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-31T19:07:36.901481] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-31T19:07:36.902737] [DEBUG] [LOCAL ] HCC: Trimmed 64588 records to 45174 (keeping 200 days of data) [2025-10-31T19:07:37.168427] [DEBUG] [LOCAL ] HCC: Primary data saved (45174 records). [2025-10-31T19:07:37.168556] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-31T19:07:37.168634] [INFO ] [MAIN ] Update Progress: 1000/2365 symbols completed. HCC took 34.3s. Estimated remaining: 2h 54m 6s. Rate: 7.8 symbols/min [2025-10-31T19:07:37.860407] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:07:37.768774] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:07:37.925009] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:07:37.946010] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:07:37.946895] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-31T19:07:37.947627] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-31T19:07:37.947948] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-31T19:07:37.948229] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-31T19:07:37.948411] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-31T19:07:37.948469] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-31T19:07:38.296324] [DEBUG] [LOCAL ] HD: Loaded 53827 existing records from primary storage. [2025-10-31T19:07:38.307343] [INFO ] [MAIN ] HD: Loaded 53827 existing records. [2025-10-31T19:07:38.362086] [DEBUG] [LOCAL ] HE: Loaded 48887 existing records from primary storage. [2025-10-31T19:07:38.432322] [INFO ] [MAIN ] HE: Loaded 48887 existing records. [2025-10-31T19:07:38.566539] [DEBUG] [LOCAL ] HDB: Loaded 52275 existing records from primary storage. [2025-10-31T19:07:38.591766] [INFO ] [MAIN ] HDB: Loaded 52275 existing records. [2025-10-31T19:07:38.776851] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:07:38.836817] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:07:38.878089] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-31T19:07:38.877785] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-31T19:07:38.923008] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-31T19:07:38.996181] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-31T19:07:39.013266] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-31T19:07:39.078095] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:07:39.137095] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-31T19:07:39.174510] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:07:39.197316] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-31T19:07:39.218629] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-31T19:07:39.218879] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-31T19:07:39.242128] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-31T19:07:39.231669] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-31T19:07:39.242325] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-31T19:07:39.258962] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-31T19:07:39.247678] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-31T19:07:39.270729] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-31T19:07:39.803039] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T19:07:39.820067] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-31T19:07:40.104832] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:07:40.131891] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-31T19:07:40.170983] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-31T19:07:40.191961] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-31T19:07:40.334257] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:07:40.350239] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-31T19:07:40.376780] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:07:40.377202] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-31T19:07:40.459070] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-31T19:07:41.057684] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-31T19:07:41.239817] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.18 seconds). [2025-10-31T19:07:41.628300] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T19:07:41.676466] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:07:41.857636] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-31T19:07:41.958187] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-31T19:07:42.657679] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-31T19:07:43.160937] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T19:07:43.457743] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-31T19:07:44.031223] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T19:07:44.257636] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-31T19:07:44.603892] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T19:07:45.057677] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-31T19:07:45.861097] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-31T19:07:45.864435] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-31T19:07:46.412548] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T19:07:46.657681] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-31T19:07:47.281006] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-31T19:07:47.457682] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-31T19:07:48.257687] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-31T19:07:48.508337] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-31T19:07:48.871547] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T19:07:49.057716] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-31T19:07:49.606918] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T19:07:49.857692] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-31T19:07:50.370740] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:07:50.657672] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-31T19:07:51.292633] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T19:07:51.457686] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-31T19:07:51.685546] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-31T19:07:51.895044] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T19:07:52.257670] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-31T19:07:52.429006] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.17 seconds). [2025-10-31T19:07:53.057735] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-31T19:07:53.272556] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-10-31T19:07:53.857686] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-31T19:07:54.657695] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-31T19:07:55.235172] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-31T19:07:55.457694] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-31T19:07:55.640385] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-10-31T19:07:56.250310] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-31T19:07:56.260775] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-31T19:07:57.057663] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-31T19:07:57.354424] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-31T19:07:57.355183] [INFO ] [REMOTE ] HCXY: Full fetch complete (523 records). [2025-10-31T19:07:57.355251] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-31T19:07:57.534453] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-31T19:07:57.534755] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:07:57.534915] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:07:57.534994] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-31T19:07:57.535190] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-31T19:07:57.535257] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-31T19:07:57.535347] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-31T19:07:57.535571] [INFO ] [MAIN ] Update Progress: 1001/2365 symbols completed. HCXY took 20.4s. Estimated remaining: 2h 54m 16s. Rate: 7.8 symbols/min [2025-10-31T19:07:57.739278] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:07:57.742454] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T19:07:57.779727] [DEBUG] [LOCAL ] HEI: Loaded 29965 existing records from primary storage. [2025-10-31T19:07:57.780027] [INFO ] [MAIN ] HEI: Loaded 29965 existing records. [2025-10-31T19:07:57.862745] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-31T19:07:57.963628] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:07:57.963879] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-31T19:07:57.963926] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-31T19:07:57.964576] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-31T19:07:57.964635] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-31T19:07:58.353000] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:07:58.657713] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-31T19:07:59.106155] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T19:07:59.457710] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-31T19:08:00.257629] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-31T19:08:00.390851] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-31T19:08:01.057633] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-31T19:08:01.177744] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-31T19:08:01.191606] [INFO ] [REMOTE ] HDB: Full fetch complete (75670 records). [2025-10-31T19:08:01.191826] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-31T19:08:01.643113] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:08:01.682472] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-31T19:08:01.682590] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-31T19:08:01.683848] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-31T19:08:01.683924] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-31T19:08:01.685736] [DEBUG] [LOCAL ] HDB: Trimmed 75670 records to 52660 (keeping 200 days of data) [2025-10-31T19:08:01.875439] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-31T19:08:02.017440] [DEBUG] [LOCAL ] HDB: Primary data saved (52660 records). [2025-10-31T19:08:02.017580] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-31T19:08:02.017681] [INFO ] [MAIN ] Update Progress: 1002/2365 symbols completed. HDB took 24.8s. Estimated remaining: 2h 54m 4s. Rate: 7.8 symbols/min [2025-10-31T19:08:02.193211] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:08:02.201442] [DEBUG] [LOCAL ] HEQ: Loaded 6572 existing records from primary storage. [2025-10-31T19:08:02.201684] [INFO ] [MAIN ] HEQ: Loaded 6572 existing records. [2025-10-31T19:08:02.372714] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:08:02.372913] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-31T19:08:02.372960] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-31T19:08:02.373189] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-31T19:08:02.373244] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-31T19:08:02.670388] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-31T19:08:02.722249] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:08:02.755591] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-31T19:08:02.831800] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T19:08:03.457694] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-31T19:08:03.898697] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T19:08:04.257726] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-31T19:08:04.441331] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-31T19:08:05.057700] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-31T19:08:05.628241] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T19:08:05.857773] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-31T19:08:06.315578] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-31T19:08:06.530752] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T19:08:06.657674] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-31T19:08:07.010442] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-31T19:08:07.457689] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-31T19:08:07.836607] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-31T19:08:08.257667] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-31T19:08:09.057667] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-31T19:08:09.541633] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T19:08:09.857713] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-31T19:08:10.376445] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-31T19:08:10.638604] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-31T19:08:10.657625] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-31T19:08:11.457666] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-31T19:08:11.557638] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-31T19:08:11.570128] [INFO ] [REMOTE ] HD: Full fetch complete (77511 records). [2025-10-31T19:08:11.570306] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-31T19:08:11.955461] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-31T19:08:11.955541] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-31T19:08:11.956503] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-31T19:08:11.956572] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-31T19:08:11.958044] [DEBUG] [LOCAL ] HD: Trimmed 77511 records to 54207 (keeping 200 days of data) [2025-10-31T19:08:12.266573] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-31T19:08:12.295438] [DEBUG] [LOCAL ] HD: Primary data saved (54207 records). [2025-10-31T19:08:12.295561] [INFO ] [MAIN ] HD: Full history saved. [2025-10-31T19:08:12.295858] [INFO ] [MAIN ] Update Progress: 1003/2365 symbols completed. HD took 35.1s. Estimated remaining: 2h 53m 60s. Rate: 7.8 symbols/min [2025-10-31T19:08:12.465044] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:08:12.506078] [DEBUG] [LOCAL ] HESM: Loaded 48919 existing records from primary storage. [2025-10-31T19:08:12.506396] [INFO ] [MAIN ] HESM: Loaded 48919 existing records. [2025-10-31T19:08:12.687921] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T19:08:12.711458] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:08:12.718788] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-31T19:08:12.724840] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-31T19:08:12.725076] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-31T19:08:12.727463] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-31T19:08:12.727772] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-31T19:08:13.071417] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-31T19:08:13.117480] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:08:13.536041] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-31T19:08:13.857693] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-31T19:08:14.657636] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-31T19:08:14.962547] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T19:08:15.098129] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-31T19:08:15.457622] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-31T19:08:16.257668] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-31T19:08:16.603736] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T19:08:17.057615] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-31T19:08:17.251437] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T19:08:17.451336] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-31T19:08:17.857666] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-31T19:08:18.657669] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-31T19:08:19.145787] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T19:08:19.457668] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-31T19:08:19.549945] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-31T19:08:20.257735] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-31T19:08:20.596153] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T19:08:20.801928] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-31T19:08:21.057742] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-31T19:08:21.727738] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T19:08:21.734020] [INFO ] [REMOTE ] HEQ: Full fetch complete (9795 records). [2025-10-31T19:08:21.734088] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-31T19:08:21.862800] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-31T19:08:22.114635] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-31T19:08:22.114929] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-31T19:08:22.115183] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-31T19:08:22.115224] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-31T19:08:22.115636] [DEBUG] [LOCAL ] HEQ: Trimmed 9795 records to 6670 (keeping 200 days of data) [2025-10-31T19:08:22.162151] [DEBUG] [LOCAL ] HEQ: Primary data saved (6670 records). [2025-10-31T19:08:22.162278] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-31T19:08:22.162394] [INFO ] [MAIN ] Update Progress: 1004/2365 symbols completed. HEQ took 20.1s. Estimated remaining: 2h 53m 55s. Rate: 7.8 symbols/min [2025-10-31T19:08:22.328417] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:08:22.328554] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-31T19:08:22.328592] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-31T19:08:22.328723] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-31T19:08:22.328772] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-31T19:08:22.328814] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-31T19:08:22.328847] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-31T19:08:22.664672] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-31T19:08:22.680816] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:08:23.092362] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T19:08:23.457715] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-31T19:08:24.078232] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T19:08:24.091065] [INFO ] [REMOTE ] HE: Full fetch complete (71758 records). [2025-10-31T19:08:24.091256] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-31T19:08:24.262771] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-31T19:08:24.538806] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-31T19:08:24.538959] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-31T19:08:24.540034] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-31T19:08:24.540122] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-31T19:08:24.560297] [DEBUG] [LOCAL ] HE: Trimmed 71758 records to 49237 (keeping 200 days of data) [2025-10-31T19:08:24.560918] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T19:08:24.626681] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-31T19:08:24.857087] [DEBUG] [LOCAL ] HE: Primary data saved (49237 records). [2025-10-31T19:08:24.857240] [INFO ] [MAIN ] HE: Full history saved. [2025-10-31T19:08:24.858369] [INFO ] [MAIN ] Update Progress: 1005/2365 symbols completed. HE took 47.7s. Estimated remaining: 2h 53m 41s. Rate: 7.8 symbols/min [2025-10-31T19:08:25.031942] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:08:25.032123] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-31T19:08:25.032178] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-31T19:08:25.032310] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-31T19:08:25.032375] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-31T19:08:25.032491] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-31T19:08:25.032561] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-31T19:08:25.062746] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-31T19:08:25.336529] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-31T19:08:25.399108] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:08:25.857705] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-31T19:08:26.161384] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-31T19:08:26.657722] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-31T19:08:27.457677] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-31T19:08:27.506368] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-31T19:08:28.257625] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-31T19:08:28.468162] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-31T19:08:28.627480] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T19:08:29.057683] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-31T19:08:29.857674] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-31T19:08:30.117821] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-31T19:08:30.162026] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T19:08:30.657638] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-31T19:08:30.904433] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-31T19:08:31.457681] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-31T19:08:32.257629] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-31T19:08:32.606397] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T19:08:33.057702] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-31T19:08:33.132534] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T19:08:33.138088] [INFO ] [REMOTE ] HEI: Full fetch complete (46272 records). [2025-10-31T19:08:33.138198] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-31T19:08:33.507790] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-31T19:08:33.507890] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-31T19:08:33.508603] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-31T19:08:33.508668] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-31T19:08:33.509579] [DEBUG] [LOCAL ] HEI: Trimmed 46272 records to 30121 (keeping 200 days of data) [2025-10-31T19:08:33.691228] [DEBUG] [LOCAL ] HEI: Primary data saved (30121 records). [2025-10-31T19:08:33.691360] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-31T19:08:33.691437] [INFO ] [MAIN ] Update Progress: 1006/2365 symbols completed. HEI took 36.2s. Estimated remaining: 2h 53m 35s. Rate: 7.8 symbols/min [2025-10-31T19:08:33.857710] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-31T19:08:33.857624] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:08:33.873818] [DEBUG] [LOCAL ] HFRO: Loaded 15775 existing records from primary storage. [2025-10-31T19:08:33.874045] [INFO ] [MAIN ] HFRO: Loaded 15775 existing records. [2025-10-31T19:08:34.046367] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:08:34.046571] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-31T19:08:34.046618] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-31T19:08:34.047075] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-31T19:08:34.047133] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-31T19:08:34.113014] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-31T19:08:34.416714] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:08:34.445508] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T19:08:34.657679] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-31T19:08:35.411081] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-31T19:08:35.457605] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-31T19:08:36.196337] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T19:08:36.257675] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-31T19:08:36.981635] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-31T19:08:37.057606] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-31T19:08:37.748978] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-31T19:08:37.857685] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-31T19:08:38.402304] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-31T19:08:38.657661] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-31T19:08:38.857520] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-10-31T19:08:39.457737] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-31T19:08:39.685619] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-31T19:08:40.257684] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-31T19:08:41.057700] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-31T19:08:41.485734] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T19:08:41.720594] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-31T19:08:41.857683] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-31T19:08:42.657697] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-31T19:08:43.237382] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-31T19:08:43.428454] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T19:08:43.457608] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-31T19:08:43.666079] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-31T19:08:44.257706] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-31T19:08:44.949948] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-31T19:08:45.057670] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-31T19:08:45.252011] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.19 seconds). [2025-10-31T19:08:45.857732] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-31T19:08:46.657675] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-31T19:08:46.963536] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-31T19:08:47.457624] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-31T19:08:47.527191] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-31T19:08:47.538729] [INFO ] [REMOTE ] HESM: Full fetch complete (70054 records). [2025-10-31T19:08:47.538862] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-31T19:08:47.840219] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T19:08:47.968743] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-31T19:08:47.968882] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-31T19:08:47.969930] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-31T19:08:47.969994] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-31T19:08:47.971512] [DEBUG] [LOCAL ] HESM: Trimmed 70054 records to 49282 (keeping 200 days of data) [2025-10-31T19:08:48.265071] [DEBUG] [LOCAL ] HESM: Primary data saved (49282 records). [2025-10-31T19:08:48.265221] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-31T19:08:48.265471] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-31T19:08:48.265753] [INFO ] [MAIN ] Update Progress: 1007/2365 symbols completed. HESM took 36.0s. Estimated remaining: 2h 53m 36s. Rate: 7.8 symbols/min [2025-10-31T19:08:48.445674] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:08:48.463761] [DEBUG] [LOCAL ] HGER: Loaded 16178 existing records from primary storage. [2025-10-31T19:08:48.464018] [INFO ] [MAIN ] HGER: Loaded 16178 existing records. [2025-10-31T19:08:48.629048] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-31T19:08:48.661260] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:08:48.661492] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-31T19:08:48.661539] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-31T19:08:48.661735] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-31T19:08:48.661790] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-31T19:08:49.008118] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:08:49.057612] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-31T19:08:49.532245] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T19:08:49.857673] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-31T19:08:50.657688] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-31T19:08:50.715749] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T19:08:51.045624] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-31T19:08:51.457694] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-31T19:08:52.117188] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-31T19:08:52.120453] [INFO ] [REMOTE ] HFRO: Full fetch complete (25957 records). [2025-10-31T19:08:52.120532] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-31T19:08:52.267748] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-31T19:08:52.485080] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-31T19:08:52.485158] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-31T19:08:52.485704] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-31T19:08:52.485765] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-31T19:08:52.486361] [DEBUG] [LOCAL ] HFRO: Trimmed 25957 records to 15857 (keeping 200 days of data) [2025-10-31T19:08:52.576349] [DEBUG] [LOCAL ] HFRO: Primary data saved (15857 records). [2025-10-31T19:08:52.576483] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-31T19:08:52.576558] [INFO ] [MAIN ] Update Progress: 1008/2365 symbols completed. HFRO took 18.9s. Estimated remaining: 2h 53m 24s. Rate: 7.8 symbols/min [2025-10-31T19:08:52.753769] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-31T19:08:52.753662] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:08:52.754784] [INFO ] [REMOTE ] HFND: Full fetch complete (1803 records). [2025-10-31T19:08:52.754874] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-31T19:08:52.874098] [DEBUG] [LOCAL ] HGLB: Loaded 9236 existing records from primary storage. [2025-10-31T19:08:52.889667] [INFO ] [MAIN ] HGLB: Loaded 9236 existing records. [2025-10-31T19:08:53.049064] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-31T19:08:53.055052] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:08:53.070775] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:08:53.060353] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-31T19:08:53.076060] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-31T19:08:53.108706] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-31T19:08:53.126075] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-31T19:08:53.126226] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-31T19:08:53.130327] [INFO ] [MAIN ] Update Progress: 1009/2365 symbols completed. HFND took 28.3s. Estimated remaining: 2h 53m 7s. Rate: 7.8 symbols/min [2025-10-31T19:08:53.130018] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:08:53.142823] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-31T19:08:53.166483] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-31T19:08:53.192970] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-31T19:08:53.207544] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-31T19:08:53.356179] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-31T19:08:53.435052] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:08:53.602098] [DEBUG] [LOCAL ] HGTY: Loaded 13528 existing records from primary storage. [2025-10-31T19:08:53.623237] [INFO ] [MAIN ] HGTY: Loaded 13528 existing records. [2025-10-31T19:08:53.816468] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:08:53.862771] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-31T19:08:53.892720] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:08:53.892957] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-31T19:08:53.893010] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-31T19:08:53.893169] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-31T19:08:53.893208] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-31T19:08:54.164611] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-31T19:08:54.250378] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:08:54.657672] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-31T19:08:55.166394] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T19:08:55.457662] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-31T19:08:55.625902] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.17 seconds). [2025-10-31T19:08:56.257638] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-31T19:08:56.433171] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-10-31T19:08:57.057732] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-31T19:08:57.581973] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-31T19:08:57.857720] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-31T19:08:58.379145] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T19:08:58.657725] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-31T19:08:59.195586] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T19:08:59.457663] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-31T19:09:00.051546] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-31T19:09:00.257679] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-31T19:09:00.755879] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T19:09:01.057710] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-31T19:09:01.643746] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-31T19:09:01.857717] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-31T19:09:02.425911] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T19:09:02.657668] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-31T19:09:03.159072] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-31T19:09:03.457638] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-31T19:09:03.983380] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T19:09:04.257669] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-31T19:09:04.571357] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-31T19:09:04.572085] [INFO ] [REMOTE ] HF: Full fetch complete (415 records). [2025-10-31T19:09:04.572152] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-31T19:09:04.750089] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-31T19:09:04.750322] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:09:04.750403] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:09:04.750488] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-31T19:09:04.750582] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-31T19:09:04.750675] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-31T19:09:04.750756] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-31T19:09:04.750854] [INFO ] [MAIN ] Update Progress: 1010/2365 symbols completed. HF took 42.6s. Estimated remaining: 2h 53m 4s. Rate: 7.8 symbols/min [2025-10-31T19:09:04.920419] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:09:04.960822] [DEBUG] [LOCAL ] HGV: Loaded 46263 existing records from primary storage. [2025-10-31T19:09:04.961169] [INFO ] [MAIN ] HGV: Loaded 46263 existing records. [2025-10-31T19:09:05.059898] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-31T19:09:05.139451] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:09:05.139700] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-31T19:09:05.139769] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-31T19:09:05.140433] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-31T19:09:05.140494] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-31T19:09:05.491809] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:09:05.641635] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-31T19:09:05.857694] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-31T19:09:06.657699] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-31T19:09:07.135712] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T19:09:07.457670] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-31T19:09:07.760866] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-31T19:09:07.966287] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-31T19:09:08.257704] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-31T19:09:09.057698] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-31T19:09:09.337560] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T19:09:09.554927] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T19:09:09.857713] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-31T19:09:10.295454] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-31T19:09:10.657721] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-31T19:09:11.194431] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T19:09:11.457696] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-31T19:09:12.135078] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T19:09:12.138558] [INFO ] [REMOTE ] HGLB: Full fetch complete (14491 records). [2025-10-31T19:09:12.138688] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-31T19:09:12.262850] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-31T19:09:12.540109] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-31T19:09:12.540193] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-31T19:09:12.540533] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-31T19:09:12.540573] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-31T19:09:12.541058] [DEBUG] [LOCAL ] HGLB: Trimmed 14491 records to 9351 (keeping 200 days of data) [2025-10-31T19:09:12.597517] [DEBUG] [LOCAL ] HGLB: Primary data saved (9351 records). [2025-10-31T19:09:12.597696] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-31T19:09:12.597794] [INFO ] [MAIN ] Update Progress: 1011/2365 symbols completed. HGLB took 20.0s. Estimated remaining: 2h 52m 57s. Rate: 7.8 symbols/min [2025-10-31T19:09:12.782667] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:09:12.816751] [DEBUG] [LOCAL ] HHH: Loaded 32877 existing records from primary storage. [2025-10-31T19:09:12.817104] [INFO ] [MAIN ] HHH: Loaded 32877 existing records. [2025-10-31T19:09:12.934229] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T19:09:13.013633] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:09:13.013916] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-31T19:09:13.013967] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-31T19:09:13.014139] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-31T19:09:13.014180] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-31T19:09:13.067068] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-31T19:09:13.370792] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:09:13.857709] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-31T19:09:14.270099] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T19:09:14.276351] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-31T19:09:14.657701] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-31T19:09:15.457686] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-31T19:09:15.830387] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T19:09:16.069774] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-31T19:09:16.257678] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-31T19:09:16.859228] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T19:09:17.057674] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-31T19:09:17.800890] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-31T19:09:17.857722] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-31T19:09:18.538142] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T19:09:18.657684] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-31T19:09:19.457673] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-31T19:09:19.572497] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T19:09:20.110591] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T19:09:20.257692] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-31T19:09:21.057731] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-31T19:09:21.708017] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-31T19:09:21.857691] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-31T19:09:22.166965] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T19:09:22.536021] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T19:09:22.657632] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-31T19:09:23.457617] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-31T19:09:23.557064] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T19:09:24.257667] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-31T19:09:24.589586] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T19:09:25.057197] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-31T19:09:25.061635] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-31T19:09:25.857681] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-31T19:09:26.467737] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T19:09:26.657698] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-31T19:09:26.851829] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T19:09:26.858703] [INFO ] [REMOTE ] HGER: Full fetch complete (19914 records). [2025-10-31T19:09:26.858851] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-31T19:09:27.219009] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-31T19:09:27.219094] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-31T19:09:27.219529] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-31T19:09:27.219569] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-31T19:09:27.220150] [DEBUG] [LOCAL ] HGER: Trimmed 19914 records to 16379 (keeping 200 days of data) [2025-10-31T19:09:27.313919] [DEBUG] [LOCAL ] HGER: Primary data saved (16379 records). [2025-10-31T19:09:27.314064] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-31T19:09:27.314145] [INFO ] [MAIN ] Update Progress: 1012/2365 symbols completed. HGER took 39.0s. Estimated remaining: 2h 52m 59s. Rate: 7.8 symbols/min [2025-10-31T19:09:27.465469] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-31T19:09:27.497791] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:09:27.508381] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T19:09:27.512130] [INFO ] [REMOTE ] HGTY: Full fetch complete (17644 records). [2025-10-31T19:09:27.512215] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-31T19:09:27.727681] [DEBUG] [LOCAL ] HI: Loaded 36480 existing records from primary storage. [2025-10-31T19:09:27.804487] [INFO ] [MAIN ] HI: Loaded 36480 existing records. [2025-10-31T19:09:28.081030] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-31T19:09:28.095793] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-31T19:09:28.101063] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-31T19:09:28.101162] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-31T19:09:28.100514] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:09:28.101818] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-31T19:09:28.102121] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-31T19:09:28.102247] [DEBUG] [LOCAL ] HGTY: Trimmed 17644 records to 13612 (keeping 200 days of data) [2025-10-31T19:09:28.102592] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-31T19:09:28.102743] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-31T19:09:28.258284] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-31T19:09:28.382029] [DEBUG] [LOCAL ] HGTY: Primary data saved (13612 records). [2025-10-31T19:09:28.407057] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-31T19:09:28.433821] [INFO ] [MAIN ] Update Progress: 1013/2365 symbols completed. HGTY took 35.3s. Estimated remaining: 2h 52m 42s. Rate: 7.8 symbols/min [2025-10-31T19:09:28.595946] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T19:09:28.755554] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:09:28.787511] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:09:28.836571] [DEBUG] [LOCAL ] HIG: Loaded 51369 existing records from primary storage. [2025-10-31T19:09:28.836929] [INFO ] [MAIN ] HIG: Loaded 51369 existing records. [2025-10-31T19:09:29.017545] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:09:29.017903] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-31T19:09:29.017964] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-31T19:09:29.019111] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-31T19:09:29.019178] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-31T19:09:29.063476] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-31T19:09:29.385487] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:09:29.452094] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T19:09:29.857666] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-31T19:09:30.075860] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T19:09:30.657685] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-31T19:09:31.062949] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T19:09:31.457703] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-31T19:09:31.846398] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T19:09:32.257688] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-31T19:09:32.657737] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T19:09:33.057668] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-31T19:09:33.093616] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-31T19:09:33.857692] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-31T19:09:34.305170] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T19:09:34.657639] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-31T19:09:34.939065] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-31T19:09:35.457685] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-31T19:09:35.689236] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T19:09:36.257718] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-31T19:09:36.878844] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T19:09:36.889038] [INFO ] [REMOTE ] HGV: Full fetch complete (65958 records). [2025-10-31T19:09:36.889200] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-31T19:09:37.064995] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-31T19:09:37.296988] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-31T19:09:37.297113] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-31T19:09:37.298080] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-31T19:09:37.298241] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-31T19:09:37.318828] [DEBUG] [LOCAL ] HGV: Trimmed 65958 records to 46596 (keeping 200 days of data) [2025-10-31T19:09:37.318692] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-31T19:09:37.587456] [DEBUG] [LOCAL ] HGV: Primary data saved (46596 records). [2025-10-31T19:09:37.587589] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-31T19:09:37.587691] [INFO ] [MAIN ] Update Progress: 1014/2365 symbols completed. HGV took 32.8s. Estimated remaining: 2h 52m 37s. Rate: 7.8 symbols/min [2025-10-31T19:09:37.754578] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:09:37.789595] [DEBUG] [LOCAL ] HII: Loaded 33035 existing records from primary storage. [2025-10-31T19:09:37.790634] [INFO ] [MAIN ] HII: Loaded 33035 existing records. [2025-10-31T19:09:37.864744] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-31T19:09:37.973380] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:09:37.973761] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-31T19:09:37.973842] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-31T19:09:37.975084] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-31T19:09:37.975153] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-31T19:09:38.285117] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T19:09:38.357606] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:09:38.657687] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-31T19:09:39.279051] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T19:09:39.457681] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-31T19:09:39.606376] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T19:09:40.257630] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-31T19:09:40.600439] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T19:09:41.057672] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-31T19:09:41.289107] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T19:09:41.857693] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-31T19:09:42.369245] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:09:42.657621] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-31T19:09:42.749582] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T19:09:43.457683] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-31T19:09:43.953686] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T19:09:44.257663] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-31T19:09:44.480528] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-31T19:09:44.487689] [INFO ] [REMOTE ] HHH: Full fetch complete (45815 records). [2025-10-31T19:09:44.487848] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-31T19:09:44.894237] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-31T19:09:44.894349] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-31T19:09:44.895248] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-31T19:09:44.895320] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-31T19:09:44.896497] [DEBUG] [LOCAL ] HHH: Trimmed 45815 records to 33021 (keeping 200 days of data) [2025-10-31T19:09:45.073012] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-31T19:09:45.097845] [DEBUG] [LOCAL ] HHH: Primary data saved (33021 records). [2025-10-31T19:09:45.098017] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-31T19:09:45.098105] [INFO ] [MAIN ] Update Progress: 1015/2365 symbols completed. HHH took 32.5s. Estimated remaining: 2h 52m 29s. Rate: 7.8 symbols/min [2025-10-31T19:09:45.266001] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:09:45.316381] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-10-31T19:09:45.316740] [INFO ] [MAIN ] HIMS: Loaded 54207 existing records. [2025-10-31T19:09:45.498436] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:09:45.498740] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-31T19:09:45.498798] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-31T19:09:45.499200] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-31T19:09:45.499247] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-31T19:09:45.867699] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:09:45.862217] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-31T19:09:45.929595] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-31T19:09:45.931730] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-31T19:09:46.657712] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-31T19:09:47.280239] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T19:09:47.457679] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-31T19:09:48.266267] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-31T19:09:48.292028] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-31T19:09:48.435978] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T19:09:49.057717] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-31T19:09:49.131034] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T19:09:49.857684] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-31T19:09:50.326273] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T19:09:50.657673] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-31T19:09:50.937950] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T19:09:51.457668] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-31T19:09:51.984297] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T19:09:52.257731] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-31T19:09:53.064460] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-31T19:09:53.085404] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-31T19:09:53.623277] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T19:09:53.661520] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T19:09:53.672988] [INFO ] [REMOTE ] HIG: Full fetch complete (73706 records). [2025-10-31T19:09:53.673119] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-31T19:09:53.865057] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-31T19:09:54.059611] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-31T19:09:54.059717] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-31T19:09:54.060636] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-31T19:09:54.060714] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-31T19:09:54.062047] [DEBUG] [LOCAL ] HIG: Trimmed 73706 records to 51735 (keeping 200 days of data) [2025-10-31T19:09:54.385216] [DEBUG] [LOCAL ] HIG: Primary data saved (51735 records). [2025-10-31T19:09:54.385355] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-31T19:09:54.386061] [INFO ] [MAIN ] Update Progress: 1016/2365 symbols completed. HIG took 25.9s. Estimated remaining: 2h 52m 23s. Rate: 7.8 symbols/min [2025-10-31T19:09:54.560456] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:09:54.586498] [DEBUG] [LOCAL ] HIO: Loaded 23611 existing records from primary storage. [2025-10-31T19:09:54.586790] [INFO ] [MAIN ] HIO: Loaded 23611 existing records. [2025-10-31T19:09:54.662767] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-31T19:09:54.767763] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:09:54.768315] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-31T19:09:54.768425] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-31T19:09:54.769093] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-31T19:09:54.769154] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-31T19:09:55.064450] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T19:09:55.148432] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:09:55.457715] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-31T19:09:56.257673] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-31T19:09:56.639695] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-31T19:09:57.057629] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-31T19:09:57.160047] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-31T19:09:57.372229] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-31T19:09:57.381982] [INFO ] [REMOTE ] HI: Full fetch complete (52042 records). [2025-10-31T19:09:57.382088] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-31T19:09:57.755342] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-31T19:09:57.755422] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-31T19:09:57.756290] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-31T19:09:57.756357] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-31T19:09:57.757438] [DEBUG] [LOCAL ] HI: Trimmed 52042 records to 36811 (keeping 200 days of data) [2025-10-31T19:09:57.860882] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-31T19:09:57.985460] [DEBUG] [LOCAL ] HI: Primary data saved (36811 records). [2025-10-31T19:09:57.985618] [INFO ] [MAIN ] HI: Full history saved. [2025-10-31T19:09:57.985738] [INFO ] [MAIN ] Update Progress: 1017/2365 symbols completed. HI took 30.7s. Estimated remaining: 2h 52m 10s. Rate: 7.8 symbols/min [2025-10-31T19:09:58.158078] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:09:58.179554] [DEBUG] [LOCAL ] HIPO: Loaded 21087 existing records from primary storage. [2025-10-31T19:09:58.179865] [INFO ] [MAIN ] HIPO: Loaded 21087 existing records. [2025-10-31T19:09:58.393905] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:09:58.394296] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-31T19:09:58.394413] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-31T19:09:58.394633] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-31T19:09:58.394736] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-31T19:09:58.667921] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-31T19:09:58.707813] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-31T19:09:58.819340] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-31T19:09:58.856173] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:09:59.457680] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-31T19:10:00.257731] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-31T19:10:00.443287] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T19:10:00.775341] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-31T19:10:01.057676] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-31T19:10:01.348896] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T19:10:01.857666] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-31T19:10:01.958238] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-31T19:10:02.657675] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-31T19:10:03.384676] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T19:10:03.457607] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-31T19:10:03.921392] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-31T19:10:04.189571] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T19:10:04.257611] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-31T19:10:05.015859] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T19:10:05.057632] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-31T19:10:05.857613] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-31T19:10:05.921460] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-31T19:10:06.657718] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-31T19:10:07.457731] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-31T19:10:07.750591] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T19:10:07.845985] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-31T19:10:07.951502] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-31T19:10:08.257613] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-31T19:10:09.057684] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-31T19:10:09.140855] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T19:10:09.857682] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-31T19:10:10.104775] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-31T19:10:10.657699] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-31T19:10:11.457728] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-31T19:10:11.487202] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-31T19:10:12.062592] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-31T19:10:12.257712] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-31T19:10:12.483529] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T19:10:13.057706] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-31T19:10:13.857680] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-31T19:10:13.977014] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-31T19:10:14.172950] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-31T19:10:14.657688] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-31T19:10:15.057451] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T19:10:15.457723] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-31T19:10:16.257676] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-31T19:10:16.677153] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-31T19:10:16.742288] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T19:10:16.749839] [INFO ] [REMOTE ] HIO: Full fetch complete (38187 records). [2025-10-31T19:10:16.750007] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-31T19:10:17.062763] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-31T19:10:17.166750] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-31T19:10:17.173574] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-31T19:10:17.175221] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T19:10:17.174773] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-31T19:10:17.175344] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-31T19:10:17.182230] [DEBUG] [LOCAL ] HIO: Trimmed 38187 records to 23775 (keeping 200 days of data) [2025-10-31T19:10:17.315854] [DEBUG] [LOCAL ] HIO: Primary data saved (23775 records). [2025-10-31T19:10:17.316003] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-31T19:10:17.316089] [INFO ] [MAIN ] Update Progress: 1018/2365 symbols completed. HIO took 22.9s. Estimated remaining: 2h 52m 18s. Rate: 7.8 symbols/min [2025-10-31T19:10:17.480071] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:10:17.517139] [DEBUG] [LOCAL ] HIW: Loaded 44645 existing records from primary storage. [2025-10-31T19:10:17.517428] [INFO ] [MAIN ] HIW: Loaded 44645 existing records. [2025-10-31T19:10:17.688949] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:10:17.689156] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-31T19:10:17.689202] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-31T19:10:17.689964] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-31T19:10:17.690020] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-31T19:10:17.868723] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-31T19:10:18.041266] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:10:18.622737] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-31T19:10:18.630604] [INFO ] [REMOTE ] HII: Full fetch complete (52211 records). [2025-10-31T19:10:18.630795] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-31T19:10:18.662765] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-31T19:10:19.007919] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-31T19:10:19.008026] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-31T19:10:19.009013] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-31T19:10:19.009082] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-31T19:10:19.010943] [DEBUG] [LOCAL ] HII: Trimmed 52211 records to 33304 (keeping 200 days of data) [2025-10-31T19:10:19.220086] [DEBUG] [LOCAL ] HII: Primary data saved (33304 records). [2025-10-31T19:10:19.220221] [INFO ] [MAIN ] HII: Full history saved. [2025-10-31T19:10:19.220315] [INFO ] [MAIN ] Update Progress: 1019/2365 symbols completed. HII took 41.6s. Estimated remaining: 2h 52m 3s. Rate: 7.8 symbols/min [2025-10-31T19:10:19.385996] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:10:19.406031] [DEBUG] [LOCAL ] HIX: Loaded 20098 existing records from primary storage. [2025-10-31T19:10:19.406311] [INFO ] [MAIN ] HIX: Loaded 20098 existing records. [2025-10-31T19:10:19.467982] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-31T19:10:19.585066] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:10:19.598616] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-31T19:10:19.599200] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-31T19:10:19.599632] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T19:10:19.604771] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-31T19:10:19.605256] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-31T19:10:19.971730] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:10:20.257702] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-31T19:10:20.561988] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-31T19:10:20.574210] [INFO ] [REMOTE ] HIMS: Full fetch complete (77997 records). [2025-10-31T19:10:20.574384] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-31T19:10:20.919279] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-31T19:10:21.030250] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-31T19:10:21.030426] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-31T19:10:21.031459] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-31T19:10:21.031541] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-31T19:10:21.032996] [DEBUG] [LOCAL ] HIMS: Trimmed 77997 records to 54597 (keeping 200 days of data) [2025-10-31T19:10:21.081155] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-31T19:10:21.263868] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T19:10:21.389334] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-10-31T19:10:21.389490] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-31T19:10:21.390086] [INFO ] [MAIN ] Update Progress: 1020/2365 symbols completed. HIMS took 36.3s. Estimated remaining: 2h 51m 48s. Rate: 7.8 symbols/min [2025-10-31T19:10:21.553390] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:10:21.571683] [DEBUG] [LOCAL ] HKD: Loaded 18811 existing records from primary storage. [2025-10-31T19:10:21.571928] [INFO ] [MAIN ] HKD: Loaded 18811 existing records. [2025-10-31T19:10:21.744745] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:10:21.744974] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-31T19:10:21.745019] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-31T19:10:21.745392] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-31T19:10:21.745448] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-31T19:10:21.857764] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-31T19:10:21.964062] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-31T19:10:22.183537] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:10:22.588944] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T19:10:22.657683] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-31T19:10:23.457628] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-31T19:10:23.551948] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T19:10:24.114472] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T19:10:24.257672] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-31T19:10:24.983929] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:10:25.057729] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-31T19:10:25.833667] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T19:10:25.857669] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-31T19:10:26.657680] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-31T19:10:26.897885] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T19:10:27.377894] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-31T19:10:27.457609] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-31T19:10:28.265267] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-31T19:10:28.267241] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-31T19:10:29.057625] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-31T19:10:29.353511] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T19:10:29.805278] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-31T19:10:29.857609] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-31T19:10:30.520869] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-31T19:10:30.657699] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-31T19:10:31.457680] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-31T19:10:31.683331] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-31T19:10:31.687838] [INFO ] [REMOTE ] HIPO: Full fetch complete (30730 records). [2025-10-31T19:10:31.688016] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-31T19:10:32.120372] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-31T19:10:32.120458] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-31T19:10:32.121164] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-31T19:10:32.121249] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-31T19:10:32.122053] [DEBUG] [LOCAL ] HIPO: Trimmed 30730 records to 21174 (keeping 200 days of data) [2025-10-31T19:10:32.241893] [DEBUG] [LOCAL ] HIPO: Primary data saved (21174 records). [2025-10-31T19:10:32.255161] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-31T19:10:32.255285] [INFO ] [MAIN ] Update Progress: 1021/2365 symbols completed. HIPO took 34.3s. Estimated remaining: 2h 51m 44s. Rate: 7.8 symbols/min [2025-10-31T19:10:32.288083] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T19:10:32.267317] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-31T19:10:32.436223] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:10:32.484434] [DEBUG] [LOCAL ] HL: Loaded 54066 existing records from primary storage. [2025-10-31T19:10:32.484803] [INFO ] [MAIN ] HL: Loaded 54066 existing records. [2025-10-31T19:10:32.658476] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:10:32.658741] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-31T19:10:32.658825] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-31T19:10:32.659747] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-31T19:10:32.659803] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-31T19:10:33.003913] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:10:33.057605] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-31T19:10:33.292053] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T19:10:33.857675] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-31T19:10:34.388705] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T19:10:34.657672] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-31T19:10:35.103233] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T19:10:35.457666] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-31T19:10:36.003149] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T19:10:36.053496] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T19:10:36.257673] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-31T19:10:36.961587] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T19:10:37.057611] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-31T19:10:37.711961] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-31T19:10:37.857686] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-31T19:10:38.657719] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-31T19:10:39.059378] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T19:10:39.457741] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-31T19:10:39.565354] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T19:10:40.257676] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-31T19:10:40.692815] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T19:10:41.057622] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-31T19:10:41.169056] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T19:10:41.857661] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-31T19:10:42.108593] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-31T19:10:42.535545] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-31T19:10:42.657606] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-31T19:10:43.457617] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-31T19:10:43.508254] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T19:10:43.513002] [INFO ] [REMOTE ] HIX: Full fetch complete (29758 records). [2025-10-31T19:10:43.513076] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-31T19:10:43.890845] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-31T19:10:43.890925] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-31T19:10:43.891507] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-31T19:10:43.891547] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-31T19:10:43.892202] [DEBUG] [LOCAL ] HIX: Trimmed 29758 records to 20229 (keeping 200 days of data) [2025-10-31T19:10:44.003603] [DEBUG] [LOCAL ] HIX: Primary data saved (20229 records). [2025-10-31T19:10:44.003740] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-31T19:10:44.003822] [INFO ] [MAIN ] Update Progress: 1022/2365 symbols completed. HIX took 24.8s. Estimated remaining: 2h 51m 42s. Rate: 7.8 symbols/min [2025-10-31T19:10:44.170424] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:10:44.210961] [DEBUG] [LOCAL ] HLF: Loaded 48430 existing records from primary storage. [2025-10-31T19:10:44.211252] [INFO ] [MAIN ] HLF: Loaded 48430 existing records. [2025-10-31T19:10:44.263399] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-31T19:10:44.397400] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:10:44.404447] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-31T19:10:44.405101] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-31T19:10:44.405553] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-31T19:10:44.411305] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-31T19:10:44.411372] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-31T19:10:44.762927] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:10:45.057743] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-31T19:10:45.718172] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T19:10:45.844504] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T19:10:45.857596] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-31T19:10:46.657668] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-31T19:10:47.304479] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T19:10:47.457736] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-31T19:10:48.159723] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-31T19:10:48.257611] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-31T19:10:48.957192] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T19:10:49.057673] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-31T19:10:49.499444] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T19:10:49.857683] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-31T19:10:50.126825] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T19:10:50.657715] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-31T19:10:50.874984] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T19:10:51.457660] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-31T19:10:52.183722] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T19:10:52.257623] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-31T19:10:52.852257] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T19:10:52.863160] [INFO ] [REMOTE ] HIW: Full fetch complete (65104 records). [2025-10-31T19:10:52.863311] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-31T19:10:53.058580] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-31T19:10:53.323699] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T19:10:53.369712] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-31T19:10:53.369846] [INFO ] [REMOTE ] HKD: Full fetch complete (27890 records). [2025-10-31T19:10:53.369917] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-31T19:10:53.369984] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-31T19:10:53.371179] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-31T19:10:53.371305] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-31T19:10:53.482771] [DEBUG] [LOCAL ] HIW: Trimmed 65104 records to 45011 (keeping 200 days of data) [2025-10-31T19:10:53.860931] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-31T19:10:53.871564] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-31T19:10:53.872413] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-31T19:10:53.875373] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-31T19:10:53.878324] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-31T19:10:53.926613] [DEBUG] [LOCAL ] HKD: Trimmed 27890 records to 19201 (keeping 200 days of data) [2025-10-31T19:10:54.080912] [DEBUG] [LOCAL ] HKD: Primary data saved (19201 records). [2025-10-31T19:10:54.090934] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-31T19:10:54.091056] [INFO ] [MAIN ] Update Progress: 1023/2365 symbols completed. HKD took 32.7s. Estimated remaining: 2h 51m 38s. Rate: 7.8 symbols/min [2025-10-31T19:10:54.244579] [DEBUG] [LOCAL ] HIW: Primary data saved (45011 records). [2025-10-31T19:10:54.255215] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-31T19:10:54.255965] [INFO ] [MAIN ] Update Progress: 1024/2365 symbols completed. HIW took 36.9s. Estimated remaining: 2h 51m 20s. Rate: 7.8 symbols/min [2025-10-31T19:10:54.414402] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:10:54.483748] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:10:54.510855] [DEBUG] [LOCAL ] HLI: Loaded 30683 existing records from primary storage. [2025-10-31T19:10:54.517771] [INFO ] [MAIN ] HLI: Loaded 30683 existing records. [2025-10-31T19:10:54.636966] [DEBUG] [LOCAL ] HLIO: Loaded 27987 existing records from primary storage. [2025-10-31T19:10:54.662370] [INFO ] [MAIN ] HLIO: Loaded 27987 existing records. [2025-10-31T19:10:54.880863] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:10:54.906556] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-31T19:10:54.940992] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-31T19:10:54.940810] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:10:54.941176] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-31T19:10:54.941372] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-31T19:10:54.941332] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-31T19:10:54.941504] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-31T19:10:54.983640] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-31T19:10:54.993899] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-31T19:10:55.079535] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-31T19:10:55.197549] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-31T19:10:55.681074] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:10:55.707368] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-31T19:10:55.764571] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:10:55.794041] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-31T19:10:56.257628] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-31T19:10:56.811213] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-31T19:10:56.987946] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T19:10:57.057620] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-31T19:10:57.091969] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-31T19:10:57.857616] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-31T19:10:58.010842] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T19:10:58.657680] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-31T19:10:59.351805] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-31T19:10:59.457614] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-31T19:10:59.604721] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-31T19:11:00.257692] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-31T19:11:00.816594] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T19:11:01.057685] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-31T19:11:01.857710] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-31T19:11:01.922607] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-31T19:11:02.335410] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T19:11:02.657711] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-31T19:11:02.748450] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T19:11:03.457705] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-31T19:11:03.842500] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T19:11:04.257675] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-31T19:11:05.057698] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-31T19:11:05.356960] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T19:11:05.594517] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-31T19:11:05.606882] [INFO ] [REMOTE ] HL: Full fetch complete (77837 records). [2025-10-31T19:11:05.607031] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-31T19:11:05.858299] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-31T19:11:06.011080] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-31T19:11:06.011244] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-31T19:11:06.012720] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-31T19:11:06.012823] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-31T19:11:06.031471] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T19:11:06.030482] [DEBUG] [LOCAL ] HL: Trimmed 77837 records to 54456 (keeping 200 days of data) [2025-10-31T19:11:06.352926] [DEBUG] [LOCAL ] HL: Primary data saved (54456 records). [2025-10-31T19:11:06.353060] [INFO ] [MAIN ] HL: Full history saved. [2025-10-31T19:11:06.353135] [INFO ] [MAIN ] Update Progress: 1025/2365 symbols completed. HL took 34.1s. Estimated remaining: 2h 51m 18s. Rate: 7.8 symbols/min [2025-10-31T19:11:06.517425] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:11:06.546123] [DEBUG] [LOCAL ] HLLY: Loaded 33343 existing records from primary storage. [2025-10-31T19:11:06.546386] [INFO ] [MAIN ] HLLY: Loaded 33343 existing records. [2025-10-31T19:11:06.662777] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-31T19:11:06.730776] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:11:06.731517] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-31T19:11:06.731574] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-31T19:11:06.732267] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-31T19:11:06.732339] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-31T19:11:07.103385] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:11:07.122930] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T19:11:07.457678] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-31T19:11:07.775215] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T19:11:08.257676] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-31T19:11:08.449285] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-31T19:11:09.057677] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-31T19:11:09.526874] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T19:11:09.833802] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-31T19:11:09.857618] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-31T19:11:10.657635] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-31T19:11:10.824910] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-31T19:11:11.362131] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T19:11:11.457674] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-31T19:11:12.260609] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-31T19:11:12.264195] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T19:11:13.057742] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-31T19:11:13.583177] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T19:11:13.857622] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-31T19:11:13.966175] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T19:11:14.657684] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-31T19:11:15.022311] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T19:11:15.457673] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-31T19:11:15.580626] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T19:11:16.257673] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-31T19:11:16.808667] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-31T19:11:16.819581] [INFO ] [REMOTE ] HLF: Full fetch complete (70571 records). [2025-10-31T19:11:16.819770] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-31T19:11:17.062857] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-31T19:11:17.223782] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-31T19:11:17.239174] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-31T19:11:17.240373] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-31T19:11:17.241052] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-31T19:11:17.241955] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-31T19:11:17.252753] [DEBUG] [LOCAL ] HLF: Trimmed 70571 records to 48778 (keeping 200 days of data) [2025-10-31T19:11:17.525520] [DEBUG] [LOCAL ] HLF: Primary data saved (48778 records). [2025-10-31T19:11:17.525672] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-31T19:11:17.525769] [INFO ] [MAIN ] Update Progress: 1026/2365 symbols completed. HLF took 33.5s. Estimated remaining: 2h 51m 15s. Rate: 7.8 symbols/min [2025-10-31T19:11:17.708881] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:11:17.756539] [DEBUG] [LOCAL ] HLN: Loaded 53482 existing records from primary storage. [2025-10-31T19:11:17.756882] [INFO ] [MAIN ] HLN: Loaded 53482 existing records. [2025-10-31T19:11:17.858794] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-31T19:11:17.939135] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:11:17.939379] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-31T19:11:17.939427] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-31T19:11:17.940434] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-31T19:11:17.940491] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-31T19:11:18.326511] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:11:18.320954] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T19:11:18.657693] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-31T19:11:18.867252] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T19:11:19.457609] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-31T19:11:19.620050] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-31T19:11:20.257612] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-31T19:11:20.373385] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T19:11:21.051222] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-31T19:11:21.057610] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-31T19:11:21.814530] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-31T19:11:21.857620] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-31T19:11:22.657674] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-31T19:11:23.138508] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T19:11:23.457621] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-31T19:11:23.594889] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T19:11:24.191673] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T19:11:24.257710] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-31T19:11:25.057685] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-31T19:11:25.371772] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T19:11:25.381008] [INFO ] [REMOTE ] HLI: Full fetch complete (45581 records). [2025-10-31T19:11:25.381243] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-31T19:11:25.750095] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-31T19:11:25.750176] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-31T19:11:25.750980] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-31T19:11:25.751042] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-31T19:11:25.751998] [DEBUG] [LOCAL ] HLI: Trimmed 45581 records to 31047 (keeping 200 days of data) [2025-10-31T19:11:25.861742] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-31T19:11:25.953912] [DEBUG] [LOCAL ] HLI: Primary data saved (31047 records). [2025-10-31T19:11:25.954048] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-31T19:11:25.954139] [INFO ] [MAIN ] Update Progress: 1027/2365 symbols completed. HLI took 31.9s. Estimated remaining: 2h 51m 8s. Rate: 7.8 symbols/min [2025-10-31T19:11:26.143550] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:11:26.157475] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-31T19:11:26.164605] [INFO ] [REMOTE ] HLIO: Full fetch complete (37347 records). [2025-10-31T19:11:26.164844] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-31T19:11:26.598039] [DEBUG] [LOCAL ] HLT: Loaded 50747 existing records from primary storage. [2025-10-31T19:11:26.641602] [INFO ] [MAIN ] HLT: Loaded 50747 existing records. [2025-10-31T19:11:26.665571] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-31T19:11:27.026083] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-31T19:11:27.025810] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:11:27.026314] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-31T19:11:27.026417] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-31T19:11:27.026503] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-31T19:11:27.027608] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-31T19:11:27.027822] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-31T19:11:27.028788] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-31T19:11:27.029105] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-31T19:11:27.043752] [DEBUG] [LOCAL ] HLIO: Trimmed 37347 records to 28143 (keeping 200 days of data) [2025-10-31T19:11:27.404480] [DEBUG] [LOCAL ] HLIO: Primary data saved (28143 records). [2025-10-31T19:11:27.409999] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-31T19:11:27.425630] [INFO ] [MAIN ] Update Progress: 1028/2365 symbols completed. HLIO took 33.2s. Estimated remaining: 2h 50m 53s. Rate: 7.8 symbols/min [2025-10-31T19:11:27.830590] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-31T19:11:27.850321] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:11:27.891444] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-31T19:11:27.900415] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:11:27.929214] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T19:11:27.975913] [DEBUG] [LOCAL ] HLX: Loaded 47564 existing records from primary storage. [2025-10-31T19:11:27.976262] [INFO ] [MAIN ] HLX: Loaded 47564 existing records. [2025-10-31T19:11:28.151156] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:11:28.151390] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-31T19:11:28.151438] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-31T19:11:28.152216] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-31T19:11:28.152274] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-31T19:11:28.262774] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-31T19:11:28.507144] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:11:29.057692] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-31T19:11:29.508542] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-31T19:11:29.760206] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-31T19:11:29.857604] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-31T19:11:30.236160] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T19:11:30.657698] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-31T19:11:31.305531] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T19:11:31.457683] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-31T19:11:31.970747] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-31T19:11:32.257700] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-31T19:11:32.699149] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-31T19:11:33.057686] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-31T19:11:33.439972] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T19:11:33.857681] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-31T19:11:34.236735] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T19:11:34.657678] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-31T19:11:35.128516] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T19:11:35.457689] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-31T19:11:35.634613] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T19:11:36.257696] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-31T19:11:36.627231] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T19:11:37.057693] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-31T19:11:37.704461] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-31T19:11:37.857614] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-31T19:11:38.347414] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T19:11:38.657629] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-31T19:11:39.199205] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T19:11:39.457674] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-31T19:11:39.964044] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:11:40.257709] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-31T19:11:41.062392] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-31T19:11:41.068043] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-31T19:11:41.565274] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T19:11:41.857687] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-31T19:11:42.138048] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T19:11:42.145876] [INFO ] [REMOTE ] HLLY: Full fetch complete (46023 records). [2025-10-31T19:11:42.146012] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-31T19:11:42.520985] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-31T19:11:42.521081] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-31T19:11:42.521962] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-31T19:11:42.522036] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-31T19:11:42.523225] [DEBUG] [LOCAL ] HLLY: Trimmed 46023 records to 33574 (keeping 200 days of data) [2025-10-31T19:11:42.674787] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-31T19:11:42.726269] [DEBUG] [LOCAL ] HLLY: Primary data saved (33574 records). [2025-10-31T19:11:42.726402] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-31T19:11:42.726481] [INFO ] [MAIN ] Update Progress: 1029/2365 symbols completed. HLLY took 36.4s. Estimated remaining: 2h 50m 55s. Rate: 7.8 symbols/min [2025-10-31T19:11:42.909779] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:11:42.955427] [DEBUG] [LOCAL ] HMC: Loaded 46367 existing records from primary storage. [2025-10-31T19:11:42.955882] [INFO ] [MAIN ] HMC: Loaded 46367 existing records. [2025-10-31T19:11:43.150053] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:11:43.150337] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-31T19:11:43.150443] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-31T19:11:43.150795] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-31T19:11:43.150922] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-31T19:11:43.344521] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-31T19:11:43.466539] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-31T19:11:43.546463] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:11:43.998769] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T19:11:44.257669] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-31T19:11:44.616250] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T19:11:45.057693] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-31T19:11:45.608778] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T19:11:45.857673] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-31T19:11:46.525390] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T19:11:46.657684] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-31T19:11:47.361900] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T19:11:47.374290] [INFO ] [REMOTE ] HLN: Full fetch complete (77020 records). [2025-10-31T19:11:47.374477] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-31T19:11:47.462840] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-31T19:11:47.795116] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-31T19:11:47.795216] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-31T19:11:47.796477] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-31T19:11:47.796545] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-31T19:11:47.798246] [DEBUG] [LOCAL ] HLN: Trimmed 77020 records to 53866 (keeping 200 days of data) [2025-10-31T19:11:48.172052] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-31T19:11:48.204219] [DEBUG] [LOCAL ] HLN: Primary data saved (53866 records). [2025-10-31T19:11:48.204372] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-31T19:11:48.204458] [INFO ] [MAIN ] Update Progress: 1030/2365 symbols completed. HLN took 30.7s. Estimated remaining: 2h 50m 44s. Rate: 7.8 symbols/min [2025-10-31T19:11:48.270106] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-31T19:11:48.381424] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:11:48.404041] [DEBUG] [LOCAL ] HMN: Loaded 23042 existing records from primary storage. [2025-10-31T19:11:48.404314] [INFO ] [MAIN ] HMN: Loaded 23042 existing records. [2025-10-31T19:11:48.585403] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:11:48.585670] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-31T19:11:48.585733] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-31T19:11:48.585935] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-31T19:11:48.585992] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-31T19:11:48.955663] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:11:48.984154] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T19:11:49.057627] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-31T19:11:49.566373] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T19:11:49.857737] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-31T19:11:50.285806] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T19:11:50.657628] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-31T19:11:51.036102] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T19:11:51.457705] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-31T19:11:51.922375] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T19:11:52.257677] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-31T19:11:52.728737] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T19:11:52.888149] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T19:11:52.899850] [INFO ] [REMOTE ] HLT: Full fetch complete (73658 records). [2025-10-31T19:11:52.899998] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-31T19:11:53.072021] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-31T19:11:53.285298] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-31T19:11:53.285378] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-31T19:11:53.286313] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-31T19:11:53.286377] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-31T19:11:53.287701] [DEBUG] [LOCAL ] HLT: Trimmed 73658 records to 51125 (keeping 200 days of data) [2025-10-31T19:11:53.602116] [DEBUG] [LOCAL ] HLT: Primary data saved (51125 records). [2025-10-31T19:11:53.602247] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-31T19:11:53.602323] [INFO ] [MAIN ] Update Progress: 1031/2365 symbols completed. HLT took 27.6s. Estimated remaining: 2h 50m 34s. Rate: 7.8 symbols/min [2025-10-31T19:11:53.771083] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:11:53.771373] [DEBUG] [LOCAL ] HMY: No existing data file found in primary storage. [2025-10-31T19:11:53.771512] [WARN ] [MAIN ] HMY: No existing data found, performing full refresh instead. [2025-10-31T19:11:53.771696] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-31T19:11:53.771817] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-31T19:11:53.771875] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-31T19:11:53.771908] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-31T19:11:53.863840] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-31T19:11:53.886912] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T19:11:54.136320] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:11:54.657738] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-31T19:11:55.343858] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-31T19:11:55.447977] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T19:11:55.457621] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-31T19:11:56.122495] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T19:11:56.257637] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-31T19:11:57.057744] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-31T19:11:57.689297] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T19:11:57.857710] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-31T19:11:58.372530] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-31T19:11:58.384574] [INFO ] [REMOTE ] HLX: Full fetch complete (69005 records). [2025-10-31T19:11:58.384817] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-31T19:11:58.664192] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-31T19:11:58.837446] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-31T19:11:58.837609] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-31T19:11:58.839442] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-31T19:11:58.839557] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-31T19:11:58.841032] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-31T19:11:58.848696] [DEBUG] [LOCAL ] HLX: Trimmed 69005 records to 47904 (keeping 200 days of data) [2025-10-31T19:11:59.139737] [DEBUG] [LOCAL ] HLX: Primary data saved (47904 records). [2025-10-31T19:11:59.139979] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-31T19:11:59.140912] [INFO ] [MAIN ] Update Progress: 1032/2365 symbols completed. HLX took 31.7s. Estimated remaining: 2h 50m 23s. Rate: 7.8 symbols/min [2025-10-31T19:11:59.314855] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:11:59.315122] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-31T19:11:59.315161] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-31T19:11:59.315290] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-31T19:11:59.315333] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-31T19:11:59.315374] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-31T19:11:59.315409] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-31T19:11:59.473196] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-31T19:11:59.739624] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:11:59.927499] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T19:12:00.257683] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-31T19:12:00.305027] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T19:12:01.057690] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-31T19:12:01.669197] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T19:12:01.798289] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-31T19:12:01.857667] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-31T19:12:02.657625] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-31T19:12:02.712005] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-31T19:12:02.813815] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T19:12:02.814321] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-31T19:12:02.814451] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:12:02.814512] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-31T19:12:02.814562] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:12:02.814674] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-31T19:12:02.814780] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-31T19:12:02.814835] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-31T19:12:02.814889] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-31T19:12:02.814955] [INFO ] [MAIN ] Update Progress: 1033/2365 symbols completed. HNGE took 3.7s. Estimated remaining: 2h 50m 10s. Rate: 7.8 symbols/min [2025-10-31T19:12:03.029422] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:12:03.060153] [DEBUG] [LOCAL ] HNI: Loaded 30158 existing records from primary storage. [2025-10-31T19:12:03.060428] [INFO ] [MAIN ] HNI: Loaded 30158 existing records. [2025-10-31T19:12:03.233239] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:12:03.233432] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-31T19:12:03.233475] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-31T19:12:03.234082] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-31T19:12:03.234165] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-31T19:12:03.463540] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-31T19:12:03.599228] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:12:04.257724] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-31T19:12:04.720862] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:12:04.967934] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-31T19:12:05.057687] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-31T19:12:05.835214] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-31T19:12:05.857617] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-31T19:12:06.657619] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-31T19:12:06.775811] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T19:12:07.288605] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-31T19:12:07.457630] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-31T19:12:08.157968] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T19:12:08.257609] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-31T19:12:09.057691] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-31T19:12:09.234025] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-31T19:12:09.238841] [INFO ] [REMOTE ] HMN: Full fetch complete (31943 records). [2025-10-31T19:12:09.238924] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-31T19:12:09.612958] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-31T19:12:09.613053] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-31T19:12:09.613772] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-31T19:12:09.613837] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-31T19:12:09.614725] [DEBUG] [LOCAL ] HMN: Trimmed 31943 records to 23256 (keeping 200 days of data) [2025-10-31T19:12:09.755229] [DEBUG] [LOCAL ] HMN: Primary data saved (23256 records). [2025-10-31T19:12:09.755369] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-31T19:12:09.755477] [INFO ] [MAIN ] Update Progress: 1034/2365 symbols completed. HMN took 21.6s. Estimated remaining: 2h 50m 2s. Rate: 7.8 symbols/min [2025-10-31T19:12:09.862715] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-31T19:12:09.854108] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-31T19:12:09.951302] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:12:09.995544] [DEBUG] [LOCAL ] HOG: Loaded 50819 existing records from primary storage. [2025-10-31T19:12:09.995872] [INFO ] [MAIN ] HOG: Loaded 50819 existing records. [2025-10-31T19:12:10.172546] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:12:10.172777] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-31T19:12:10.172827] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-31T19:12:10.173799] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-31T19:12:10.173858] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-31T19:12:10.518769] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:12:10.657674] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-31T19:12:11.389007] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-31T19:12:11.414221] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-31T19:12:11.457612] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-31T19:12:12.198614] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-31T19:12:12.257684] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-31T19:12:13.057626] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-31T19:12:13.103791] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-31T19:12:13.857700] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-31T19:12:14.510637] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T19:12:14.657629] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-31T19:12:15.187499] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T19:12:15.457669] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-31T19:12:16.104597] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-31T19:12:16.257621] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-31T19:12:16.823818] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T19:12:17.057614] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-31T19:12:17.585746] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T19:12:17.857628] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-31T19:12:18.535046] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T19:12:18.657680] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-31T19:12:19.457676] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-31T19:12:19.566838] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-31T19:12:19.892327] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T19:12:20.257713] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-31T19:12:20.768900] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T19:12:21.057670] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-31T19:12:21.437883] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T19:12:21.857675] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-31T19:12:22.367638] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-31T19:12:22.379029] [INFO ] [REMOTE ] HMC: Full fetch complete (68373 records). [2025-10-31T19:12:22.379198] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-31T19:12:22.662836] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-31T19:12:22.790966] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-31T19:12:22.791049] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-31T19:12:22.791956] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-31T19:12:22.792018] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-31T19:12:22.793322] [DEBUG] [LOCAL ] HMC: Trimmed 68373 records to 46746 (keeping 200 days of data) [2025-10-31T19:12:23.089569] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T19:12:23.090251] [DEBUG] [LOCAL ] HMC: Primary data saved (46746 records). [2025-10-31T19:12:23.100524] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-31T19:12:23.100993] [INFO ] [MAIN ] Update Progress: 1035/2365 symbols completed. HMC took 40.4s. Estimated remaining: 2h 50m 2s. Rate: 7.8 symbols/min [2025-10-31T19:12:23.269416] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:12:23.306117] [DEBUG] [LOCAL ] HOMB: Loaded 43836 existing records from primary storage. [2025-10-31T19:12:23.306399] [INFO ] [MAIN ] HOMB: Loaded 43836 existing records. [2025-10-31T19:12:23.460234] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-31T19:12:23.481919] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:12:23.482820] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-31T19:12:23.482911] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-31T19:12:23.484026] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-31T19:12:23.484082] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-31T19:12:23.836481] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:12:24.204116] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-31T19:12:24.257628] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-31T19:12:24.433295] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T19:12:25.057708] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-31T19:12:25.658996] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T19:12:25.857684] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-31T19:12:26.327034] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T19:12:26.335127] [INFO ] [REMOTE ] HNI: Full fetch complete (42545 records). [2025-10-31T19:12:26.335258] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-31T19:12:26.670764] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-31T19:12:26.721250] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-31T19:12:26.721318] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-31T19:12:26.722082] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-31T19:12:26.722144] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-31T19:12:26.723133] [DEBUG] [LOCAL ] HNI: Trimmed 42545 records to 30434 (keeping 200 days of data) [2025-10-31T19:12:26.903589] [DEBUG] [LOCAL ] HNI: Primary data saved (30434 records). [2025-10-31T19:12:26.903724] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-31T19:12:26.904633] [INFO ] [MAIN ] Update Progress: 1036/2365 symbols completed. HNI took 24.1s. Estimated remaining: 2h 49m 49s. Rate: 7.8 symbols/min [2025-10-31T19:12:27.072507] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:12:27.072725] [DEBUG] [LOCAL ] HOUS: No existing data file found in primary storage. [2025-10-31T19:12:27.072776] [WARN ] [MAIN ] HOUS: No existing data found, performing full refresh instead. [2025-10-31T19:12:27.072890] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-31T19:12:27.072934] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-31T19:12:27.072979] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-31T19:12:27.073013] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-31T19:12:27.433003] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:12:27.461347] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-31T19:12:27.467550] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-31T19:12:28.063082] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:12:28.257637] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-31T19:12:28.413883] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T19:12:29.057704] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-31T19:12:29.762994] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T19:12:29.857690] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-31T19:12:30.117741] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T19:12:30.657669] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-31T19:12:31.233146] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T19:12:31.457704] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-31T19:12:32.257677] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-31T19:12:32.542579] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T19:12:32.720629] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-31T19:12:32.733084] [INFO ] [REMOTE ] HMY: Full fetch complete (77170 records). [2025-10-31T19:12:32.733260] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-31T19:12:33.062855] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-31T19:12:33.149823] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-31T19:12:33.149910] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-31T19:12:33.150918] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-31T19:12:33.150981] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-31T19:12:33.152371] [DEBUG] [LOCAL ] HMY: Trimmed 77170 records to 53937 (keeping 200 days of data) [2025-10-31T19:12:33.480062] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T19:12:33.511298] [DEBUG] [LOCAL ] HMY: Primary data saved (53937 records). [2025-10-31T19:12:33.511418] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-31T19:12:33.511486] [INFO ] [MAIN ] Update Progress: 1037/2365 symbols completed. HMY took 39.9s. Estimated remaining: 2h 49m 40s. Rate: 7.8 symbols/min [2025-10-31T19:12:33.857681] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-31T19:12:34.533515] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T19:12:34.657631] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-31T19:12:34.853054] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T19:12:35.457699] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-31T19:12:36.001240] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T19:12:36.257716] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-31T19:12:36.510378] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T19:12:37.057746] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-31T19:12:37.346066] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T19:12:37.857673] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-31T19:12:38.363724] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:12:38.657674] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-31T19:12:39.216266] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T19:12:39.457618] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-31T19:12:39.667221] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T19:12:40.257679] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-31T19:12:40.665436] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T19:12:41.057683] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-31T19:12:41.335762] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T19:12:41.857633] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-31T19:12:42.103589] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T19:12:42.657637] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-31T19:12:42.976842] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T19:12:43.457678] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-31T19:12:43.735974] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T19:12:44.257677] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-31T19:12:44.823358] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-31T19:12:44.834997] [INFO ] [REMOTE ] HOG: Full fetch complete (74218 records). [2025-10-31T19:12:44.835107] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-31T19:12:45.070892] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-31T19:12:45.241314] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-31T19:12:45.241500] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-31T19:12:45.242582] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-31T19:12:45.242752] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-31T19:12:45.244343] [DEBUG] [LOCAL ] HOG: Trimmed 74218 records to 51201 (keeping 200 days of data) [2025-10-31T19:12:45.385337] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T19:12:45.586306] [DEBUG] [LOCAL ] HOG: Primary data saved (51201 records). [2025-10-31T19:12:45.586452] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-31T19:12:45.586540] [INFO ] [MAIN ] Update Progress: 1038/2365 symbols completed. HOG took 35.8s. Estimated remaining: 2h 49m 38s. Rate: 7.8 symbols/min [2025-10-31T19:12:45.857735] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-31T19:12:46.308465] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T19:12:46.657740] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-31T19:12:46.995068] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T19:12:47.457761] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-31T19:12:48.015845] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T19:12:48.029515] [INFO ] [REMOTE ] HOUS: Full fetch complete (64874 records). [2025-10-31T19:12:48.029666] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-31T19:12:48.414205] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-31T19:12:48.414283] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-31T19:12:48.415089] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-31T19:12:48.415149] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-31T19:12:48.416303] [DEBUG] [LOCAL ] HOUS: Trimmed 64874 records to 46582 (keeping 200 days of data) [2025-10-31T19:12:48.668508] [DEBUG] [LOCAL ] HOUS: Primary data saved (46582 records). [2025-10-31T19:12:48.668713] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-31T19:12:48.668800] [INFO ] [MAIN ] Update Progress: 1039/2365 symbols completed. HOUS took 21.8s. Estimated remaining: 2h 49m 24s. Rate: 7.8 symbols/min [2025-10-31T19:12:48.705521] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T19:12:48.716181] [INFO ] [REMOTE ] HOMB: Full fetch complete (64401 records). [2025-10-31T19:12:48.716305] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-31T19:12:49.094876] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-31T19:12:49.094978] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-31T19:12:49.095862] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-31T19:12:49.095925] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-31T19:12:49.097067] [DEBUG] [LOCAL ] HOMB: Trimmed 64401 records to 44181 (keeping 200 days of data) [2025-10-31T19:12:49.352070] [DEBUG] [LOCAL ] HOMB: Primary data saved (44181 records). [2025-10-31T19:12:49.352254] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-31T19:12:49.352350] [INFO ] [MAIN ] Update Progress: 1040/2365 symbols completed. HOMB took 26.3s. Estimated remaining: 2h 49m 8s. Rate: 7.8 symbols/min [2025-10-31T19:12:49.914693] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:12:50.040905] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:12:50.045760] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:12:50.067088] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:12:50.083780] [DEBUG] [LOCAL ] HPF: Loaded 7324 existing records from primary storage. [2025-10-31T19:12:50.083473] [DEBUG] [LOCAL ] HOV: Loaded 13690 existing records from primary storage. [2025-10-31T19:12:50.084233] [INFO ] [MAIN ] HOV: Loaded 13690 existing records. [2025-10-31T19:12:50.084362] [INFO ] [MAIN ] HPF: Loaded 7324 existing records. [2025-10-31T19:12:50.480427] [DEBUG] [LOCAL ] HP: Loaded 51595 existing records from primary storage. [2025-10-31T19:12:50.501200] [INFO ] [MAIN ] HP: Loaded 51595 existing records. [2025-10-31T19:12:50.534770] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:12:50.547996] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:12:50.590318] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-31T19:12:50.601001] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-31T19:12:50.619995] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-31T19:12:50.619900] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-31T19:12:50.648299] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-10-31T19:12:50.648704] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-31T19:12:50.649231] [INFO ] [MAIN ] HPE: Loaded 54087 existing records. [2025-10-31T19:12:50.648622] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-31T19:12:50.649041] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-31T19:12:50.682867] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-31T19:12:51.077698] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:12:51.164371] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-31T19:12:51.169708] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-31T19:12:51.278566] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:12:51.285365] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-31T19:12:51.330345] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-31T19:12:51.312489] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-31T19:12:51.401271] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-31T19:12:51.527270] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-31T19:12:51.594749] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-31T19:12:51.957969] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:12:52.026244] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-31T19:12:52.082699] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:12:52.099531] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-31T19:12:52.520528] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:12:52.551608] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:12:52.547338] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-31T19:12:52.552713] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-31T19:12:52.757340] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-31T19:12:52.760290] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-31T19:12:52.790997] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-31T19:12:52.793998] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-31T19:12:53.168864] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-31T19:12:53.170781] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-31T19:12:53.385325] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T19:12:53.629596] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-31T19:12:53.770182] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T19:12:53.857627] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-31T19:12:53.983557] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T19:12:54.195367] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-31T19:12:54.657696] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-31T19:12:55.228384] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T19:12:55.457689] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-31T19:12:56.091817] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-31T19:12:56.257690] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-31T19:12:57.057665] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-31T19:12:57.506233] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:12:57.857681] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-31T19:12:58.322109] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T19:12:58.657671] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-31T19:12:59.061957] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T19:12:59.062198] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-31T19:12:59.457639] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-31T19:12:59.924204] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-31T19:13:00.257689] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-31T19:13:01.057723] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-31T19:13:01.587206] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T19:13:01.857672] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-31T19:13:02.123014] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-31T19:13:02.346061] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-31T19:13:02.657689] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-31T19:13:03.158823] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T19:13:03.457671] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-31T19:13:04.160041] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-31T19:13:04.257689] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-31T19:13:05.057727] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-31T19:13:05.671564] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T19:13:05.829866] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T19:13:05.857601] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-31T19:13:06.494953] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T19:13:06.657727] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-31T19:13:07.457687] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-31T19:13:07.925374] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T19:13:08.012047] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T19:13:08.257731] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-31T19:13:09.057669] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-31T19:13:09.336764] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T19:13:09.857712] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-31T19:13:10.559368] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T19:13:10.593420] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-31T19:13:10.657617] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-31T19:13:11.457733] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-31T19:13:12.016946] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T19:13:12.238560] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T19:13:12.241598] [INFO ] [REMOTE ] HOV: Full fetch complete (18827 records). [2025-10-31T19:13:12.241694] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-31T19:13:12.262782] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-31T19:13:12.598042] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-31T19:13:12.598121] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-31T19:13:12.598531] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-31T19:13:12.598571] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-31T19:13:12.599143] [DEBUG] [LOCAL ] HOV: Trimmed 18827 records to 13825 (keeping 200 days of data) [2025-10-31T19:13:12.678847] [DEBUG] [LOCAL ] HOV: Primary data saved (13825 records). [2025-10-31T19:13:12.678974] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-31T19:13:12.679050] [INFO ] [MAIN ] Update Progress: 1041/2365 symbols completed. HOV took 23.3s. Estimated remaining: 2h 49m 20s. Rate: 7.8 symbols/min [2025-10-31T19:13:12.846754] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:13:12.853337] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T19:13:12.855564] [INFO ] [REMOTE ] HPF: Full fetch complete (10292 records). [2025-10-31T19:13:12.855735] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-31T19:13:12.965023] [DEBUG] [LOCAL ] HPI: Loaded 10600 existing records from primary storage. [2025-10-31T19:13:13.003478] [INFO ] [MAIN ] HPI: Loaded 10600 existing records. [2025-10-31T19:13:13.073577] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-31T19:13:13.393740] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:13:13.417032] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-31T19:13:13.416954] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-31T19:13:13.417142] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-31T19:13:13.417206] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-31T19:13:13.417577] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-31T19:13:13.417694] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-31T19:13:13.417538] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-31T19:13:13.422932] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-31T19:13:13.497627] [DEBUG] [LOCAL ] HPF: Trimmed 10292 records to 7368 (keeping 200 days of data) [2025-10-31T19:13:13.738822] [DEBUG] [LOCAL ] HPF: Primary data saved (7368 records). [2025-10-31T19:13:13.761854] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-31T19:13:13.762132] [INFO ] [MAIN ] Update Progress: 1042/2365 symbols completed. HPF took 24.4s. Estimated remaining: 2h 49m 4s. Rate: 7.8 symbols/min [2025-10-31T19:13:13.867132] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-31T19:13:13.932901] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:13:14.018768] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:13:14.064061] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-10-31T19:13:14.064404] [INFO ] [MAIN ] HPP: Loaded 51595 existing records. [2025-10-31T19:13:14.249441] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:13:14.249772] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-31T19:13:14.249890] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-31T19:13:14.250800] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-31T19:13:14.250858] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-31T19:13:14.652241] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:13:14.664095] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-31T19:13:14.686138] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-31T19:13:15.457627] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-31T19:13:15.586754] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-31T19:13:15.846777] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T19:13:15.933672] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-31T19:13:16.257698] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-31T19:13:17.057668] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-31T19:13:17.382127] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T19:13:17.857723] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-31T19:13:18.399354] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T19:13:18.657676] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-31T19:13:19.375409] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T19:13:19.457612] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-31T19:13:20.029475] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T19:13:20.257714] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-31T19:13:20.969313] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-31T19:13:21.057634] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-31T19:13:21.781382] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T19:13:21.792684] [INFO ] [REMOTE ] HP: Full fetch complete (74161 records). [2025-10-31T19:13:21.792854] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-31T19:13:21.862844] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-31T19:13:22.175392] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-31T19:13:22.175473] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-31T19:13:22.176456] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-31T19:13:22.176519] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-31T19:13:22.177917] [DEBUG] [LOCAL ] HP: Trimmed 74161 records to 51930 (keeping 200 days of data) [2025-10-31T19:13:22.303895] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-31T19:13:22.499868] [DEBUG] [LOCAL ] HP: Primary data saved (51930 records). [2025-10-31T19:13:22.500176] [INFO ] [MAIN ] HP: Full history saved. [2025-10-31T19:13:22.500380] [INFO ] [MAIN ] Update Progress: 1043/2365 symbols completed. HP took 33.1s. Estimated remaining: 2h 48m 58s. Rate: 7.8 symbols/min [2025-10-31T19:13:22.671418] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:13:22.668669] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-31T19:13:22.725358] [DEBUG] [LOCAL ] HPQ: Loaded 54059 existing records from primary storage. [2025-10-31T19:13:22.725981] [INFO ] [MAIN ] HPQ: Loaded 54059 existing records. [2025-10-31T19:13:22.938929] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-31T19:13:22.993493] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:13:22.994043] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-31T19:13:22.994097] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-31T19:13:22.994450] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-31T19:13:22.994508] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-31T19:13:23.436426] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:13:23.457675] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-31T19:13:23.873920] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T19:13:24.257685] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-31T19:13:24.688632] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-31T19:13:24.756944] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:13:25.057705] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-31T19:13:25.857697] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-31T19:13:26.241115] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-31T19:13:26.367623] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-31T19:13:26.657662] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-31T19:13:27.457725] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-31T19:13:28.257703] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-31T19:13:28.405246] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-31T19:13:28.417757] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-31T19:13:28.417971] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-31T19:13:28.747355] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T19:13:28.840258] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-31T19:13:28.850189] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-31T19:13:28.851448] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-31T19:13:28.852137] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-31T19:13:28.853263] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-31T19:13:28.864903] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 54477 (keeping 200 days of data) [2025-10-31T19:13:29.075403] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-31T19:13:29.194089] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-10-31T19:13:29.194216] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-31T19:13:29.195186] [INFO ] [MAIN ] Update Progress: 1044/2365 symbols completed. HPE took 39.8s. Estimated remaining: 2h 48m 49s. Rate: 7.8 symbols/min [2025-10-31T19:13:29.364545] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:13:29.377739] [DEBUG] [LOCAL ] HPS: Loaded 10140 existing records from primary storage. [2025-10-31T19:13:29.377989] [INFO ] [MAIN ] HPS: Loaded 10140 existing records. [2025-10-31T19:13:29.556191] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:13:29.562939] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-31T19:13:29.563038] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-31T19:13:29.562837] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T19:13:29.565215] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-31T19:13:29.565971] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-31T19:13:29.862732] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-31T19:13:29.914772] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:13:30.657733] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-31T19:13:31.156464] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-31T19:13:31.161243] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T19:13:31.457664] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-31T19:13:32.030339] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-31T19:13:32.257705] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-31T19:13:33.057704] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-31T19:13:33.487041] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T19:13:33.564049] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T19:13:33.857687] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-31T19:13:34.451295] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-31T19:13:34.657670] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-31T19:13:35.201482] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-31T19:13:35.457686] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-31T19:13:36.257632] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-31T19:13:36.744486] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T19:13:37.057688] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-31T19:13:37.585831] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T19:13:37.819956] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-31T19:13:37.857624] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-31T19:13:38.469126] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-31T19:13:38.657705] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-31T19:13:39.177540] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-31T19:13:39.457629] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-31T19:13:40.131295] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-31T19:13:40.257676] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-31T19:13:41.057695] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-31T19:13:41.434466] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T19:13:41.857681] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-31T19:13:42.447468] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-31T19:13:42.548122] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-31T19:13:42.657634] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-31T19:13:43.266471] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T19:13:43.269956] [INFO ] [REMOTE ] HPI: Full fetch complete (13796 records). [2025-10-31T19:13:43.270048] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-31T19:13:43.462823] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-31T19:13:43.661385] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-31T19:13:43.661468] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-31T19:13:43.661846] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-31T19:13:43.661910] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-31T19:13:43.662383] [DEBUG] [LOCAL ] HPI: Trimmed 13796 records to 10649 (keeping 200 days of data) [2025-10-31T19:13:43.725675] [DEBUG] [LOCAL ] HPI: Primary data saved (10649 records). [2025-10-31T19:13:43.725802] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-31T19:13:43.725877] [INFO ] [MAIN ] Update Progress: 1045/2365 symbols completed. HPI took 31.0s. Estimated remaining: 2h 48m 50s. Rate: 7.8 symbols/min [2025-10-31T19:13:43.892133] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:13:43.916873] [DEBUG] [LOCAL ] HQH: Loaded 25661 existing records from primary storage. [2025-10-31T19:13:43.917152] [INFO ] [MAIN ] HQH: Loaded 25661 existing records. [2025-10-31T19:13:44.120404] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T19:13:44.124794] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:13:44.128071] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-31T19:13:44.128182] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-31T19:13:44.129276] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-31T19:13:44.129339] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-31T19:13:44.269168] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-31T19:13:44.485228] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:13:44.918162] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T19:13:45.057679] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-31T19:13:45.857713] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-31T19:13:46.193003] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T19:13:46.657679] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-31T19:13:46.710737] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-31T19:13:47.457633] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-31T19:13:48.249691] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-31T19:13:48.261046] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-31T19:13:48.280987] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-31T19:13:48.742503] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-31T19:13:48.745178] [INFO ] [REMOTE ] HPS: Full fetch complete (14889 records). [2025-10-31T19:13:48.745249] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-31T19:13:49.062785] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-31T19:13:49.129683] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-31T19:13:49.130074] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-31T19:13:49.130465] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-31T19:13:49.130542] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-31T19:13:49.131135] [DEBUG] [LOCAL ] HPS: Trimmed 14889 records to 10214 (keeping 200 days of data) [2025-10-31T19:13:49.190565] [DEBUG] [LOCAL ] HPS: Primary data saved (10214 records). [2025-10-31T19:13:49.190706] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-31T19:13:49.190794] [INFO ] [MAIN ] Update Progress: 1046/2365 symbols completed. HPS took 20.0s. Estimated remaining: 2h 48m 39s. Rate: 7.8 symbols/min [2025-10-31T19:13:49.361052] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:13:49.377273] [DEBUG] [LOCAL ] HQL: Loaded 17521 existing records from primary storage. [2025-10-31T19:13:49.377483] [INFO ] [MAIN ] HQL: Loaded 17521 existing records. [2025-10-31T19:13:49.554136] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:13:49.554349] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-31T19:13:49.554403] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-31T19:13:49.554832] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-31T19:13:49.554891] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-31T19:13:49.866625] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-31T19:13:49.907014] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:13:50.009820] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-31T19:13:50.657627] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-31T19:13:51.304487] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-31T19:13:51.329463] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T19:13:51.457618] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-31T19:13:52.257669] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-31T19:13:53.007452] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T19:13:53.057676] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-31T19:13:53.774153] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T19:13:53.786271] [INFO ] [REMOTE ] HPP: Full fetch complete (73411 records). [2025-10-31T19:13:53.786432] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-31T19:13:53.863497] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-31T19:13:54.181585] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-31T19:13:54.181742] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-31T19:13:54.182806] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-31T19:13:54.182873] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-31T19:13:54.184323] [DEBUG] [LOCAL ] HPP: Trimmed 73411 records to 51981 (keeping 200 days of data) [2025-10-31T19:13:54.442006] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-31T19:13:54.530629] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-31T19:13:54.547906] [DEBUG] [LOCAL ] HPP: Primary data saved (51981 records). [2025-10-31T19:13:54.547999] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-31T19:13:54.548069] [INFO ] [MAIN ] Update Progress: 1047/2365 symbols completed. HPP took 40.8s. Estimated remaining: 2h 48m 29s. Rate: 7.8 symbols/min [2025-10-31T19:13:54.662725] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-31T19:13:54.718110] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:13:54.765062] [DEBUG] [LOCAL ] HR: Loaded 52472 existing records from primary storage. [2025-10-31T19:13:54.765358] [INFO ] [MAIN ] HR: Loaded 52472 existing records. [2025-10-31T19:13:54.939970] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:13:54.940207] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-31T19:13:54.940258] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-31T19:13:54.941210] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-31T19:13:54.941267] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-31T19:13:55.303606] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:13:55.363705] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-31T19:13:55.457686] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-31T19:13:56.078969] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T19:13:56.257694] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-31T19:13:56.982386] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-31T19:13:57.057624] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-31T19:13:57.857780] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-31T19:13:58.241981] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T19:13:58.657696] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-31T19:13:59.450847] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-31T19:13:59.461542] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-31T19:13:59.697119] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T19:14:00.257619] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-31T19:14:00.325913] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-31T19:14:00.945511] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T19:14:00.957901] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-31T19:14:00.958055] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-31T19:14:01.057788] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-31T19:14:01.351897] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-31T19:14:01.351975] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-31T19:14:01.352958] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-31T19:14:01.353021] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-31T19:14:01.354352] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 54449 (keeping 200 days of data) [2025-10-31T19:14:01.677008] [DEBUG] [LOCAL ] HPQ: Primary data saved (54449 records). [2025-10-31T19:14:01.677130] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-31T19:14:01.677204] [INFO ] [MAIN ] Update Progress: 1048/2365 symbols completed. HPQ took 39.2s. Estimated remaining: 2h 48m 20s. Rate: 7.8 symbols/min [2025-10-31T19:14:01.861593] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-31T19:14:01.867525] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:14:01.879980] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-31T19:14:01.929271] [DEBUG] [LOCAL ] HRB: Loaded 48303 existing records from primary storage. [2025-10-31T19:14:01.929604] [INFO ] [MAIN ] HRB: Loaded 48303 existing records. [2025-10-31T19:14:02.132546] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:14:02.132815] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-31T19:14:02.132865] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-31T19:14:02.133459] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-31T19:14:02.133515] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-31T19:14:02.491926] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:14:02.657690] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-31T19:14:03.027769] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T19:14:03.457672] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-31T19:14:03.669685] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T19:14:04.257683] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-31T19:14:04.804766] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T19:14:04.977612] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T19:14:05.057678] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-31T19:14:05.857673] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-31T19:14:05.918021] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T19:14:06.657686] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-31T19:14:07.075636] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T19:14:07.448513] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-31T19:14:07.457605] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-31T19:14:08.235162] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-31T19:14:08.257607] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-31T19:14:09.057681] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-31T19:14:09.182384] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T19:14:09.188830] [INFO ] [REMOTE ] HQH: Full fetch complete (36679 records). [2025-10-31T19:14:09.188968] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-31T19:14:09.555739] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-31T19:14:09.555951] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-31T19:14:09.556677] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-31T19:14:09.556739] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-31T19:14:09.557553] [DEBUG] [LOCAL ] HQH: Trimmed 36679 records to 25837 (keeping 200 days of data) [2025-10-31T19:14:09.680901] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-31T19:14:09.727529] [DEBUG] [LOCAL ] HQH: Primary data saved (25837 records). [2025-10-31T19:14:09.727691] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-31T19:14:09.727785] [INFO ] [MAIN ] Update Progress: 1049/2365 symbols completed. HQH took 26.0s. Estimated remaining: 2h 48m 13s. Rate: 7.8 symbols/min [2025-10-31T19:14:09.864440] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-31T19:14:09.896440] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:14:09.930025] [DEBUG] [LOCAL ] HRI: Loaded 32363 existing records from primary storage. [2025-10-31T19:14:09.930305] [INFO ] [MAIN ] HRI: Loaded 32363 existing records. [2025-10-31T19:14:10.113293] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:14:10.113506] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-31T19:14:10.113552] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-31T19:14:10.114082] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-31T19:14:10.114140] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-31T19:14:10.474249] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:14:10.657674] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-31T19:14:10.709758] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-31T19:14:11.457688] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-31T19:14:11.912948] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T19:14:12.257694] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-31T19:14:12.347138] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T19:14:13.057677] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-31T19:14:13.515321] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T19:14:13.857686] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-31T19:14:14.049028] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T19:14:14.657658] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-31T19:14:15.283258] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-31T19:14:15.457715] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-31T19:14:16.127056] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T19:14:16.257728] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-31T19:14:16.504145] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T19:14:17.057673] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-31T19:14:17.433471] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T19:14:17.857678] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-31T19:14:18.269721] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T19:14:18.476136] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-31T19:14:18.657626] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-31T19:14:19.310278] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T19:14:19.457629] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-31T19:14:20.257623] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-31T19:14:20.403575] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-31T19:14:20.409523] [INFO ] [REMOTE ] HQL: Full fetch complete (25574 records). [2025-10-31T19:14:20.409596] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-31T19:14:20.772876] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-31T19:14:20.772958] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-31T19:14:20.773452] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-31T19:14:20.773490] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-31T19:14:20.774129] [DEBUG] [LOCAL ] HQL: Trimmed 25574 records to 17731 (keeping 200 days of data) [2025-10-31T19:14:20.876629] [DEBUG] [LOCAL ] HQL: Primary data saved (17731 records). [2025-10-31T19:14:20.876775] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-31T19:14:20.876851] [INFO ] [MAIN ] Update Progress: 1050/2365 symbols completed. HQL took 31.7s. Estimated remaining: 2h 48m 10s. Rate: 7.8 symbols/min [2025-10-31T19:14:21.044236] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:14:21.070031] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-31T19:14:21.091225] [DEBUG] [LOCAL ] HRL: Loaded 53503 existing records from primary storage. [2025-10-31T19:14:21.091518] [INFO ] [MAIN ] HRL: Loaded 53503 existing records. [2025-10-31T19:14:21.269498] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:14:21.269903] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-31T19:14:21.270009] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-31T19:14:21.270993] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-31T19:14:21.271063] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-31T19:14:21.589703] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T19:14:21.664091] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:14:21.857630] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-31T19:14:22.491830] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T19:14:22.657683] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-31T19:14:23.192467] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T19:14:23.457685] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-31T19:14:23.918338] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T19:14:24.257683] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-31T19:14:24.632853] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T19:14:25.057739] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-31T19:14:25.725663] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-31T19:14:25.738695] [INFO ] [REMOTE ] HR: Full fetch complete (75158 records). [2025-10-31T19:14:25.738825] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-31T19:14:25.862780] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-31T19:14:26.130503] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-31T19:14:26.130795] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-31T19:14:26.131892] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-31T19:14:26.131981] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-31T19:14:26.133539] [DEBUG] [LOCAL ] HR: Trimmed 75158 records to 52859 (keeping 200 days of data) [2025-10-31T19:14:26.152564] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T19:14:26.461873] [DEBUG] [LOCAL ] HR: Primary data saved (52859 records). [2025-10-31T19:14:26.461993] [INFO ] [MAIN ] HR: Full history saved. [2025-10-31T19:14:26.462066] [INFO ] [MAIN ] Update Progress: 1051/2365 symbols completed. HR took 31.9s. Estimated remaining: 2h 47m 60s. Rate: 7.8 symbols/min [2025-10-31T19:14:26.626379] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:14:26.657676] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-31T19:14:26.658269] [DEBUG] [LOCAL ] HRTG: Loaded 34427 existing records from primary storage. [2025-10-31T19:14:26.659213] [INFO ] [MAIN ] HRTG: Loaded 34427 existing records. [2025-10-31T19:14:26.833111] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:14:26.833297] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-31T19:14:26.833342] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-31T19:14:26.833615] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-31T19:14:26.833693] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-31T19:14:27.183317] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:14:27.259769] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T19:14:27.457701] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-31T19:14:27.704424] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-31T19:14:28.182346] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T19:14:28.257613] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-31T19:14:28.980011] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-31T19:14:29.057607] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-31T19:14:29.832554] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T19:14:29.857610] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-31T19:14:30.657636] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-31T19:14:30.951763] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T19:14:31.457695] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-31T19:14:31.723106] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-31T19:14:32.257676] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-31T19:14:32.370027] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T19:14:33.057732] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-31T19:14:33.337679] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T19:14:33.857630] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-31T19:14:33.949806] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T19:14:34.657676] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-31T19:14:35.377888] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-31T19:14:35.457667] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-31T19:14:35.990712] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T19:14:36.257672] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-31T19:14:36.844448] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-31T19:14:37.057704] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-31T19:14:37.525709] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T19:14:37.534189] [INFO ] [REMOTE ] HRI: Full fetch complete (47052 records). [2025-10-31T19:14:37.534307] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-31T19:14:37.868061] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-31T19:14:37.919578] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-31T19:14:37.919795] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-31T19:14:37.920625] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-31T19:14:37.920828] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-31T19:14:37.922333] [DEBUG] [LOCAL ] HRI: Trimmed 47052 records to 32586 (keeping 200 days of data) [2025-10-31T19:14:38.056365] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T19:14:38.159742] [DEBUG] [LOCAL ] HRI: Primary data saved (32586 records). [2025-10-31T19:14:38.159875] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-31T19:14:38.160436] [INFO ] [MAIN ] Update Progress: 1052/2365 symbols completed. HRI took 28.4s. Estimated remaining: 2h 47m 57s. Rate: 7.8 symbols/min [2025-10-31T19:14:38.323460] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:14:38.370383] [DEBUG] [LOCAL ] HSBC: Loaded 51338 existing records from primary storage. [2025-10-31T19:14:38.370711] [INFO ] [MAIN ] HSBC: Loaded 51338 existing records. [2025-10-31T19:14:38.541714] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:14:38.541928] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-31T19:14:38.541974] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-31T19:14:38.542883] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-31T19:14:38.542939] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-31T19:14:38.662730] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-31T19:14:38.897385] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:14:39.113813] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T19:14:39.457670] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-31T19:14:39.626136] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T19:14:40.257632] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-31T19:14:40.752334] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T19:14:41.057720] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-31T19:14:41.401094] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-31T19:14:41.857664] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-31T19:14:42.494352] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-31T19:14:42.657625] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-31T19:14:43.293956] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-31T19:14:43.304393] [INFO ] [REMOTE ] HRB: Full fetch complete (69826 records). [2025-10-31T19:14:43.304543] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-31T19:14:43.460880] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-31T19:14:43.689080] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-31T19:14:43.689160] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-31T19:14:43.690076] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-31T19:14:43.690138] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-31T19:14:43.691419] [DEBUG] [LOCAL ] HRB: Trimmed 69826 records to 48640 (keeping 200 days of data) [2025-10-31T19:14:43.979986] [DEBUG] [LOCAL ] HRB: Primary data saved (48640 records). [2025-10-31T19:14:43.980103] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-31T19:14:43.980180] [INFO ] [MAIN ] Update Progress: 1053/2365 symbols completed. HRB took 42.3s. Estimated remaining: 2h 47m 47s. Rate: 7.8 symbols/min [2025-10-31T19:14:44.174030] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-31T19:14:44.182195] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:14:44.206815] [DEBUG] [LOCAL ] HSHP: Loaded 13956 existing records from primary storage. [2025-10-31T19:14:44.207040] [INFO ] [MAIN ] HSHP: Loaded 13956 existing records. [2025-10-31T19:14:44.267738] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-31T19:14:44.381019] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:14:44.381208] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-31T19:14:44.381253] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-31T19:14:44.381405] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-31T19:14:44.381442] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-31T19:14:44.721809] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:14:45.057630] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-31T19:14:45.121374] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-31T19:14:45.332145] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T19:14:45.615329] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-31T19:14:45.857627] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-31T19:14:46.477777] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-31T19:14:46.657691] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-31T19:14:47.457634] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-31T19:14:47.498955] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T19:14:48.257703] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-31T19:14:48.405421] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-31T19:14:48.952824] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T19:14:49.057690] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-31T19:14:49.692792] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T19:14:49.857742] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-31T19:14:50.657722] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-31T19:14:51.116171] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:14:51.457701] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-31T19:14:51.982523] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-31T19:14:51.989978] [INFO ] [REMOTE ] HRTG: Full fetch complete (44627 records). [2025-10-31T19:14:51.990063] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-31T19:14:52.262838] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-31T19:14:52.373620] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-31T19:14:52.373725] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-31T19:14:52.374425] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-31T19:14:52.374465] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-31T19:14:52.375351] [DEBUG] [LOCAL ] HRTG: Trimmed 44627 records to 34670 (keeping 200 days of data) [2025-10-31T19:14:52.586831] [DEBUG] [LOCAL ] HRTG: Primary data saved (34670 records). [2025-10-31T19:14:52.586951] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-31T19:14:52.587024] [INFO ] [MAIN ] Update Progress: 1054/2365 symbols completed. HRTG took 26.1s. Estimated remaining: 2h 47m 40s. Rate: 7.8 symbols/min [2025-10-31T19:14:52.755818] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:14:52.806514] [DEBUG] [LOCAL ] HSY: Loaded 50699 existing records from primary storage. [2025-10-31T19:14:52.807038] [INFO ] [MAIN ] HSY: Loaded 50699 existing records. [2025-10-31T19:14:52.987327] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:14:52.987922] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-31T19:14:52.988138] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-31T19:14:52.994305] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-31T19:14:52.997238] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-31T19:14:53.011546] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T19:14:53.063715] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-31T19:14:53.219961] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-31T19:14:53.445658] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:14:53.857724] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-31T19:14:54.657676] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-31T19:14:54.759298] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-31T19:14:55.457702] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-31T19:14:55.527972] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-31T19:14:56.030213] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T19:14:56.257713] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-31T19:14:56.890910] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T19:14:57.057693] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-31T19:14:57.835551] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-31T19:14:57.857603] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-31T19:14:58.522634] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T19:14:58.657721] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-31T19:14:59.278895] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-31T19:14:59.391327] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T19:14:59.457666] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-31T19:14:59.988792] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-31T19:15:00.257735] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-31T19:15:01.057720] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-31T19:15:01.807214] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T19:15:01.857631] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-31T19:15:02.635211] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-31T19:15:02.657619] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-31T19:15:03.461542] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-31T19:15:03.487345] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-31T19:15:03.530208] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-31T19:15:04.257713] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-31T19:15:05.065928] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-31T19:15:05.085232] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-31T19:15:05.507942] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T19:15:05.720854] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T19:15:05.723991] [INFO ] [REMOTE ] HSHP: Full fetch complete (22695 records). [2025-10-31T19:15:05.724060] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-31T19:15:05.862762] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-31T19:15:06.084845] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-31T19:15:06.084921] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-31T19:15:06.085349] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-31T19:15:06.085387] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-31T19:15:06.086008] [DEBUG] [LOCAL ] HSHP: Trimmed 22695 records to 14011 (keeping 200 days of data) [2025-10-31T19:15:06.162274] [DEBUG] [LOCAL ] HSHP: Primary data saved (14011 records). [2025-10-31T19:15:06.162397] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-31T19:15:06.162472] [INFO ] [MAIN ] Update Progress: 1055/2365 symbols completed. HSHP took 22.2s. Estimated remaining: 2h 47m 40s. Rate: 7.8 symbols/min [2025-10-31T19:15:06.327281] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:06.327438] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-31T19:15:06.327474] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-31T19:15:06.327578] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-31T19:15:06.327618] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-31T19:15:06.327690] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-31T19:15:06.327745] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-31T19:15:06.677574] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:06.673012] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-31T19:15:07.274350] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T19:15:07.457680] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-31T19:15:08.257624] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-31T19:15:08.292371] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-31T19:15:08.440760] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T19:15:08.441166] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-31T19:15:08.441254] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:15:08.441304] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-31T19:15:08.441362] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:15:08.441431] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-31T19:15:08.441491] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-31T19:15:08.441527] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-31T19:15:08.441566] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-31T19:15:08.441609] [INFO ] [MAIN ] Update Progress: 1056/2365 symbols completed. HTB took 2.3s. Estimated remaining: 2h 47m 26s. Rate: 7.8 symbols/min [2025-10-31T19:15:08.612603] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:08.628400] [DEBUG] [LOCAL ] HTD: Loaded 14114 existing records from primary storage. [2025-10-31T19:15:08.628691] [INFO ] [MAIN ] HTD: Loaded 14114 existing records. [2025-10-31T19:15:08.813374] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:15:08.813632] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-31T19:15:08.813878] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-31T19:15:08.814350] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-31T19:15:08.814409] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-31T19:15:09.036174] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-31T19:15:09.062800] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-31T19:15:09.236579] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:09.857675] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-31T19:15:10.657688] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-31T19:15:11.090393] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-31T19:15:11.102898] [INFO ] [REMOTE ] HRL: Full fetch complete (77043 records). [2025-10-31T19:15:11.103036] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-31T19:15:11.469876] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-31T19:15:11.493626] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-31T19:15:11.493841] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-31T19:15:11.494959] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-31T19:15:11.495214] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-31T19:15:11.496761] [DEBUG] [LOCAL ] HRL: Trimmed 77043 records to 53893 (keeping 200 days of data) [2025-10-31T19:15:11.649638] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-31T19:15:11.749722] [INFO ] [REMOTE ] HSBC: Full fetch complete (74320 records). [2025-10-31T19:15:11.753211] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-31T19:15:12.109971] [DEBUG] [LOCAL ] HRL: Primary data saved (53893 records). [2025-10-31T19:15:12.123874] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-31T19:15:12.148811] [INFO ] [MAIN ] Update Progress: 1057/2365 symbols completed. HRL took 51.3s. Estimated remaining: 2h 47m 13s. Rate: 7.8 symbols/min [2025-10-31T19:15:12.384391] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T19:15:12.391617] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-31T19:15:12.418063] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-31T19:15:12.446771] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-31T19:15:12.448122] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-31T19:15:12.467277] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:12.460966] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-31T19:15:12.467663] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-31T19:15:12.467740] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-31T19:15:12.498285] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-31T19:15:12.498985] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-31T19:15:12.500926] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-31T19:15:12.501037] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-31T19:15:12.500746] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-31T19:15:12.513080] [DEBUG] [LOCAL ] HSBC: Trimmed 74320 records to 51719 (keeping 200 days of data) [2025-10-31T19:15:13.060795] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-31T19:15:13.158907] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:13.200356] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T19:15:13.242478] [DEBUG] [LOCAL ] HSBC: Primary data saved (51719 records). [2025-10-31T19:15:13.242590] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-31T19:15:13.243129] [INFO ] [MAIN ] Update Progress: 1058/2365 symbols completed. HSBC took 35.1s. Estimated remaining: 2h 46m 57s. Rate: 7.8 symbols/min [2025-10-31T19:15:13.407669] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:13.452764] [DEBUG] [LOCAL ] HTGC: Loaded 47809 existing records from primary storage. [2025-10-31T19:15:13.453040] [INFO ] [MAIN ] HTGC: Loaded 47809 existing records. [2025-10-31T19:15:13.626870] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:15:13.627048] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-31T19:15:13.627094] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-31T19:15:13.627952] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-31T19:15:13.628009] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-31T19:15:13.862861] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-31T19:15:13.976115] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:14.123733] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-31T19:15:14.626827] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-31T19:15:14.657631] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-31T19:15:15.274733] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T19:15:15.286383] [INFO ] [REMOTE ] HSY: Full fetch complete (73554 records). [2025-10-31T19:15:15.286547] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-31T19:15:15.459781] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-31T19:15:15.699135] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-31T19:15:15.699222] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-31T19:15:15.700377] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-31T19:15:15.700474] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-31T19:15:15.701983] [DEBUG] [LOCAL ] HSY: Trimmed 73554 records to 51086 (keeping 200 days of data) [2025-10-31T19:15:16.019092] [DEBUG] [LOCAL ] HSY: Primary data saved (51086 records). [2025-10-31T19:15:16.019232] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-31T19:15:16.019309] [INFO ] [MAIN ] Update Progress: 1059/2365 symbols completed. HSY took 23.4s. Estimated remaining: 2h 46m 44s. Rate: 7.8 symbols/min [2025-10-31T19:15:16.188362] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:16.197150] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T19:15:16.228807] [DEBUG] [LOCAL ] HTH: Loaded 32443 existing records from primary storage. [2025-10-31T19:15:16.229082] [INFO ] [MAIN ] HTH: Loaded 32443 existing records. [2025-10-31T19:15:16.262896] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-31T19:15:16.405599] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:15:16.405875] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-31T19:15:16.405925] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-31T19:15:16.406504] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-31T19:15:16.406561] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-31T19:15:16.746448] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:16.835185] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-31T19:15:17.057677] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-31T19:15:17.548462] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T19:15:17.857740] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-31T19:15:18.657696] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-31T19:15:19.023461] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-31T19:15:19.258176] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-31T19:15:19.457718] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-31T19:15:20.157619] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T19:15:20.257629] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-31T19:15:20.821158] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-31T19:15:21.057679] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-31T19:15:21.857633] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-31T19:15:21.959001] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-31T19:15:22.089021] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-31T19:15:22.657695] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-31T19:15:23.309404] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T19:15:23.457678] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-31T19:15:24.240377] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T19:15:24.244535] [INFO ] [REMOTE ] HTD: Full fetch complete (19489 records). [2025-10-31T19:15:24.244608] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-31T19:15:24.266074] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-31T19:15:24.613494] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-31T19:15:24.613596] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-31T19:15:24.614039] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-31T19:15:24.614107] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-31T19:15:24.614709] [DEBUG] [LOCAL ] HTD: Trimmed 19489 records to 14175 (keeping 200 days of data) [2025-10-31T19:15:24.699706] [DEBUG] [LOCAL ] HTD: Primary data saved (14175 records). [2025-10-31T19:15:24.699836] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-31T19:15:24.699913] [INFO ] [MAIN ] Update Progress: 1060/2365 symbols completed. HTD took 16.3s. Estimated remaining: 2h 46m 37s. Rate: 7.8 symbols/min [2025-10-31T19:15:24.869824] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:24.903129] [DEBUG] [LOCAL ] HUBB: Loaded 35910 existing records from primary storage. [2025-10-31T19:15:24.903437] [INFO ] [MAIN ] HUBB: Loaded 35910 existing records. [2025-10-31T19:15:25.062711] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-31T19:15:25.099247] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:15:25.100218] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-31T19:15:25.100287] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-31T19:15:25.101071] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-31T19:15:25.101130] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-31T19:15:25.374332] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-31T19:15:25.480200] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:25.500782] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T19:15:25.857684] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-31T19:15:26.657676] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-31T19:15:27.066853] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T19:15:27.457613] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-31T19:15:27.492732] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T19:15:28.257668] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-31T19:15:28.469581] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-10-31T19:15:28.657757] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T19:15:29.057691] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-31T19:15:29.857720] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-31T19:15:30.168434] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T19:15:30.657684] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-31T19:15:30.896460] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-31T19:15:31.375889] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-31T19:15:31.457671] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-31T19:15:32.257682] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-31T19:15:32.771936] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:15:33.057673] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-31T19:15:33.238029] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T19:15:33.289363] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-31T19:15:33.857683] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-31T19:15:34.657670] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-31T19:15:35.085764] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T19:15:35.457626] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-31T19:15:35.595847] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-31T19:15:35.639230] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.18 seconds). [2025-10-31T19:15:36.257684] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-31T19:15:37.057675] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-31T19:15:37.269267] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-10-31T19:15:37.315495] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T19:15:37.857675] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-31T19:15:38.090505] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-31T19:15:38.657682] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-31T19:15:39.457684] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-31T19:15:39.790738] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-31T19:15:39.791473] [INFO ] [REMOTE ] HTFC: Full fetch complete (834 records). [2025-10-31T19:15:39.791539] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-31T19:15:39.791945] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-10-30) is before last completed trading day (2025-10-31). Symbol may be delisted or halted. [2025-10-31T19:15:39.792214] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:15:39.792324] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:15:39.792553] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-31T19:15:39.792694] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-31T19:15:39.792901] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-31T19:15:39.793245] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-31T19:15:39.793610] [INFO ] [MAIN ] Update Progress: 1061/2365 symbols completed. HTFC took 27.6s. Estimated remaining: 2h 46m 39s. Rate: 7.8 symbols/min [2025-10-31T19:15:39.931324] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T19:15:40.024885] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:40.061919] [DEBUG] [LOCAL ] HUBS: Loaded 39815 existing records from primary storage. [2025-10-31T19:15:40.062211] [INFO ] [MAIN ] HUBS: Loaded 39815 existing records. [2025-10-31T19:15:40.237491] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:15:40.237723] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-31T19:15:40.237777] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-31T19:15:40.238471] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-31T19:15:40.238527] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-31T19:15:40.266690] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-31T19:15:40.586542] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:41.057711] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-31T19:15:41.322943] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T19:15:41.857684] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-31T19:15:41.987493] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-31T19:15:42.657683] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-31T19:15:43.156211] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T19:15:43.457712] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-31T19:15:43.882552] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T19:15:44.257748] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-31T19:15:44.467555] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T19:15:45.057628] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-31T19:15:45.118688] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T19:15:45.857698] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-31T19:15:46.179702] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T19:15:46.657685] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-31T19:15:47.035310] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T19:15:47.457679] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-31T19:15:47.805356] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T19:15:48.257632] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-31T19:15:48.370560] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T19:15:49.057678] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-31T19:15:49.726296] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-31T19:15:49.737638] [INFO ] [REMOTE ] HTGC: Full fetch complete (68979 records). [2025-10-31T19:15:49.737777] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-31T19:15:49.862924] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-31T19:15:50.136273] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-31T19:15:50.136565] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-31T19:15:50.137569] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-31T19:15:50.137800] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-31T19:15:50.157110] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-31T19:15:50.164348] [DEBUG] [LOCAL ] HTGC: Trimmed 68979 records to 48184 (keeping 200 days of data) [2025-10-31T19:15:50.164997] [INFO ] [REMOTE ] HTH: Full fetch complete (47192 records). [2025-10-31T19:15:50.165115] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-31T19:15:50.657897] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-31T19:15:50.824676] [DEBUG] [LOCAL ] HTGC: Primary data saved (48184 records). [2025-10-31T19:15:50.837691] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-31T19:15:50.840865] [INFO ] [MAIN ] Update Progress: 1062/2365 symbols completed. HTGC took 37.6s. Estimated remaining: 2h 46m 35s. Rate: 7.8 symbols/min [2025-10-31T19:15:50.862024] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-31T19:15:50.884077] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-31T19:15:50.910825] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-31T19:15:50.910909] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-31T19:15:50.943331] [DEBUG] [LOCAL ] HTH: Trimmed 47192 records to 32738 (keeping 200 days of data) [2025-10-31T19:15:51.103871] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:51.243131] [DEBUG] [LOCAL ] HTH: Primary data saved (32738 records). [2025-10-31T19:15:51.243429] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-31T19:15:51.243549] [INFO ] [MAIN ] Update Progress: 1063/2365 symbols completed. HTH took 35.2s. Estimated remaining: 2h 46m 19s. Rate: 7.8 symbols/min [2025-10-31T19:15:51.264899] [DEBUG] [LOCAL ] HUM: Loaded 49273 existing records from primary storage. [2025-10-31T19:15:51.280587] [INFO ] [MAIN ] HUM: Loaded 49273 existing records. [2025-10-31T19:15:51.578506] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:15:51.617169] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:15:51.619192] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-31T19:15:51.619795] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-31T19:15:51.628378] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-31T19:15:51.628715] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-31T19:15:51.631359] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-31T19:15:51.631455] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-31T19:15:52.011169] [DEBUG] [LOCAL ] HUN: Loaded 53597 existing records from primary storage. [2025-10-31T19:15:52.022427] [INFO ] [MAIN ] HUN: Loaded 53597 existing records. [2025-10-31T19:15:52.133012] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:52.260155] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-31T19:15:52.274355] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-31T19:15:52.353099] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:15:52.353342] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-31T19:15:52.353404] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-31T19:15:52.354259] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-31T19:15:52.354316] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-31T19:15:52.699419] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:15:52.979852] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T19:15:53.057620] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-31T19:15:53.608245] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T19:15:53.857665] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-31T19:15:54.301170] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-31T19:15:54.657714] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-31T19:15:55.273623] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-31T19:15:55.457682] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-31T19:15:55.698903] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T19:15:56.257672] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-31T19:15:56.788820] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T19:15:57.057679] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-31T19:15:57.515834] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T19:15:57.857618] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-31T19:15:58.066502] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T19:15:58.657635] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-31T19:15:59.287472] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-31T19:15:59.457622] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-31T19:15:59.688944] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T19:16:00.257691] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-31T19:16:01.057683] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-31T19:16:01.211570] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-31T19:16:01.837775] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T19:16:01.857623] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-31T19:16:02.098043] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T19:16:02.657688] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-31T19:16:03.319138] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-31T19:16:03.457688] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-31T19:16:03.863330] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T19:16:04.257617] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-31T19:16:04.898374] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T19:16:05.057624] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-31T19:16:05.369376] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T19:16:05.857685] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-31T19:16:06.305447] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-31T19:16:06.657669] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-31T19:16:07.155856] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T19:16:07.164605] [INFO ] [REMOTE ] HUBB: Full fetch complete (54329 records). [2025-10-31T19:16:07.164787] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-31T19:16:07.462834] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-31T19:16:07.608167] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-31T19:16:07.608259] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-31T19:16:07.609191] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-31T19:16:07.609257] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-31T19:16:07.611726] [DEBUG] [LOCAL ] HUBB: Trimmed 54329 records to 36171 (keeping 200 days of data) [2025-10-31T19:16:07.889632] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-31T19:16:07.917141] [DEBUG] [LOCAL ] HUBB: Primary data saved (36171 records). [2025-10-31T19:16:07.917713] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-31T19:16:07.917811] [INFO ] [MAIN ] Update Progress: 1064/2365 symbols completed. HUBB took 43.2s. Estimated remaining: 2h 46m 22s. Rate: 7.8 symbols/min [2025-10-31T19:16:08.110848] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:16:08.149969] [DEBUG] [LOCAL ] HUYA: Loaded 43909 existing records from primary storage. [2025-10-31T19:16:08.150263] [INFO ] [MAIN ] HUYA: Loaded 43909 existing records. [2025-10-31T19:16:08.262794] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-31T19:16:08.365929] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:16:08.366153] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-31T19:16:08.366203] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-31T19:16:08.366975] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-31T19:16:08.367037] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-31T19:16:08.740529] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:16:08.764458] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:16:09.057728] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-31T19:16:09.716286] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T19:16:09.857675] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-31T19:16:10.317973] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:16:10.657693] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-31T19:16:11.143313] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T19:16:11.457689] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-31T19:16:12.257627] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-31T19:16:12.344953] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-31T19:16:12.501544] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T19:16:13.057720] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-31T19:16:13.494922] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T19:16:13.857708] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-31T19:16:14.587143] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-31T19:16:14.596848] [INFO ] [REMOTE ] HUBS: Full fetch complete (57344 records). [2025-10-31T19:16:14.596982] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-31T19:16:14.662790] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-31T19:16:14.991549] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-31T19:16:14.991634] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-31T19:16:14.992692] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-31T19:16:14.992758] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-31T19:16:14.993889] [DEBUG] [LOCAL ] HUBS: Trimmed 57344 records to 40118 (keeping 200 days of data) [2025-10-31T19:16:15.243242] [DEBUG] [LOCAL ] HUBS: Primary data saved (40118 records). [2025-10-31T19:16:15.243417] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-31T19:16:15.243503] [INFO ] [MAIN ] Update Progress: 1065/2365 symbols completed. HUBS took 35.4s. Estimated remaining: 2h 46m 14s. Rate: 7.8 symbols/min [2025-10-31T19:16:15.437383] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:16:15.464001] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-31T19:16:15.467115] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-31T19:16:15.488124] [DEBUG] [LOCAL ] HVT: Loaded 14594 existing records from primary storage. [2025-10-31T19:16:15.488352] [INFO ] [MAIN ] HVT: Loaded 14594 existing records. [2025-10-31T19:16:15.669768] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:16:15.669989] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-31T19:16:15.670039] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-31T19:16:15.670401] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-31T19:16:15.670461] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-31T19:16:16.032427] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:16:16.257698] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-31T19:16:16.408157] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-31T19:16:16.422027] [INFO ] [REMOTE ] HUN: Full fetch complete (77043 records). [2025-10-31T19:16:16.422273] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-31T19:16:16.824922] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-31T19:16:16.825039] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-31T19:16:16.826208] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-31T19:16:16.826291] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-31T19:16:16.828147] [DEBUG] [LOCAL ] HUN: Trimmed 77043 records to 53985 (keeping 200 days of data) [2025-10-31T19:16:16.853186] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:16:17.069294] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-31T19:16:17.187448] [DEBUG] [LOCAL ] HUN: Primary data saved (53985 records). [2025-10-31T19:16:17.187599] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-31T19:16:17.187706] [INFO ] [MAIN ] Update Progress: 1066/2365 symbols completed. HUN took 25.9s. Estimated remaining: 2h 45m 59s. Rate: 7.8 symbols/min [2025-10-31T19:16:17.352837] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:16:17.402083] [DEBUG] [LOCAL ] HWM: Loaded 53014 existing records from primary storage. [2025-10-31T19:16:17.402423] [INFO ] [MAIN ] HWM: Loaded 53014 existing records. [2025-10-31T19:16:17.575690] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:16:17.575903] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-31T19:16:17.575951] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-31T19:16:17.576916] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-31T19:16:17.576974] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-31T19:16:17.866235] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-31T19:16:17.939719] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:16:17.974584] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-31T19:16:18.158335] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T19:16:18.657726] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-31T19:16:19.371710] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T19:16:19.457636] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-31T19:16:19.510482] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-31T19:16:20.170748] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T19:16:20.257718] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-31T19:16:21.057714] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-31T19:16:21.803611] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T19:16:21.830203] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T19:16:21.857618] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-31T19:16:22.560105] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T19:16:22.657708] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-31T19:16:23.457722] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-31T19:16:24.257628] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-31T19:16:24.322358] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-31T19:16:24.333375] [INFO ] [REMOTE ] HUM: Full fetch complete (71062 records). [2025-10-31T19:16:24.333510] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-31T19:16:24.719573] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-31T19:16:24.719807] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-31T19:16:24.720845] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-31T19:16:24.720928] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-31T19:16:24.722777] [DEBUG] [LOCAL ] HUM: Trimmed 71062 records to 49647 (keeping 200 days of data) [2025-10-31T19:16:24.987846] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-31T19:16:25.064621] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-31T19:16:25.083339] [DEBUG] [LOCAL ] HUM: Primary data saved (49647 records). [2025-10-31T19:16:25.083581] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-31T19:16:25.084203] [INFO ] [MAIN ] Update Progress: 1067/2365 symbols completed. HUM took 34.2s. Estimated remaining: 2h 45m 52s. Rate: 7.8 symbols/min [2025-10-31T19:16:25.251373] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:16:25.292960] [DEBUG] [LOCAL ] HXL: Loaded 46152 existing records from primary storage. [2025-10-31T19:16:25.293249] [INFO ] [MAIN ] HXL: Loaded 46152 existing records. [2025-10-31T19:16:25.470672] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:16:25.471143] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-31T19:16:25.471233] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-31T19:16:25.472206] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-31T19:16:25.472270] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-31T19:16:25.631024] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T19:16:25.863749] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-31T19:16:25.882188] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-31T19:16:25.978728] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:16:26.657691] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-31T19:16:26.972083] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-31T19:16:27.457702] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-31T19:16:28.257678] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-31T19:16:28.265560] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-31T19:16:28.466573] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T19:16:29.057712] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-31T19:16:29.296101] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-31T19:16:29.675758] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-31T19:16:29.857696] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-31T19:16:30.657693] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-31T19:16:31.080544] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T19:16:31.457734] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-31T19:16:31.701663] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T19:16:32.257671] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-31T19:16:32.898787] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T19:16:33.057674] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-31T19:16:33.714366] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T19:16:33.857697] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-31T19:16:34.056921] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T19:16:34.657675] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-31T19:16:35.333695] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-31T19:16:35.457628] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-31T19:16:35.734761] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-31T19:16:36.257681] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-31T19:16:36.946605] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T19:16:37.057665] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-31T19:16:37.456371] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T19:16:37.696496] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T19:16:37.857718] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-31T19:16:38.657695] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-31T19:16:39.295867] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T19:16:39.420231] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-31T19:16:39.457625] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-31T19:16:40.257691] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-31T19:16:41.032862] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-31T19:16:41.057611] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-31T19:16:41.308444] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T19:16:41.857682] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-31T19:16:42.383448] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T19:16:42.657690] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-31T19:16:42.952955] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T19:16:43.457723] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-31T19:16:44.014479] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T19:16:44.025087] [INFO ] [REMOTE ] HUYA: Full fetch complete (64000 records). [2025-10-31T19:16:44.025209] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-31T19:16:44.267670] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-31T19:16:44.416441] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-31T19:16:44.416519] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-31T19:16:44.417495] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-31T19:16:44.417559] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-31T19:16:44.418877] [DEBUG] [LOCAL ] HUYA: Trimmed 64000 records to 44131 (keeping 200 days of data) [2025-10-31T19:16:44.663070] [DEBUG] [LOCAL ] HUYA: Primary data saved (44131 records). [2025-10-31T19:16:44.663195] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-31T19:16:44.663275] [INFO ] [MAIN ] Update Progress: 1068/2365 symbols completed. HUYA took 36.7s. Estimated remaining: 2h 45m 59s. Rate: 7.8 symbols/min [2025-10-31T19:16:44.834321] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:16:44.844457] [DEBUG] [LOCAL ] HY: Loaded 9580 existing records from primary storage. [2025-10-31T19:16:44.844694] [INFO ] [MAIN ] HY: Loaded 9580 existing records. [2025-10-31T19:16:45.026867] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:16:45.027161] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-31T19:16:45.027212] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-31T19:16:45.027518] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-31T19:16:45.027575] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-31T19:16:45.058749] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-31T19:16:45.219674] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-31T19:16:45.445178] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:16:45.475186] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T19:16:45.857727] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-31T19:16:45.982862] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-31T19:16:45.986489] [INFO ] [REMOTE ] HVT: Full fetch complete (22952 records). [2025-10-31T19:16:45.986563] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-31T19:16:46.377617] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-31T19:16:46.377804] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-31T19:16:46.378384] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-31T19:16:46.378518] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-31T19:16:46.379437] [DEBUG] [LOCAL ] HVT: Trimmed 22952 records to 14720 (keeping 200 days of data) [2025-10-31T19:16:46.430500] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-31T19:16:46.478662] [DEBUG] [LOCAL ] HVT: Primary data saved (14720 records). [2025-10-31T19:16:46.478797] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-31T19:16:46.478874] [INFO ] [MAIN ] Update Progress: 1069/2365 symbols completed. HVT took 31.2s. Estimated remaining: 2h 45m 44s. Rate: 7.8 symbols/min [2025-10-31T19:16:46.646444] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:16:46.646595] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-31T19:16:46.646631] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-31T19:16:46.646758] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-31T19:16:46.646799] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-31T19:16:46.646841] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-31T19:16:46.646872] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-31T19:16:46.667103] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-31T19:16:46.998469] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:16:47.457632] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-31T19:16:47.872810] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T19:16:47.973859] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T19:16:48.257638] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-31T19:16:48.799169] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-31T19:16:49.057725] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-31T19:16:49.279139] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-31T19:16:49.857668] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-31T19:16:50.062741] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-31T19:16:50.657675] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-31T19:16:51.457701] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-31T19:16:51.658756] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-10-31T19:16:52.257624] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-31T19:16:52.390193] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-31T19:16:52.401988] [INFO ] [REMOTE ] HWM: Full fetch complete (76577 records). [2025-10-31T19:16:52.402123] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-31T19:16:52.800359] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-31T19:16:52.800440] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-31T19:16:52.801512] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-31T19:16:52.801575] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-31T19:16:52.803009] [DEBUG] [LOCAL ] HWM: Trimmed 76577 records to 53393 (keeping 200 days of data) [2025-10-31T19:16:53.078600] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-31T19:16:53.127996] [DEBUG] [LOCAL ] HWM: Primary data saved (53393 records). [2025-10-31T19:16:53.128580] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-31T19:16:53.128817] [INFO ] [MAIN ] Update Progress: 1070/2365 symbols completed. HWM took 35.9s. Estimated remaining: 2h 45m 35s. Rate: 7.8 symbols/min [2025-10-31T19:16:53.298940] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:16:53.299150] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-31T19:16:53.299219] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-31T19:16:53.299484] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-31T19:16:53.299613] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-31T19:16:53.299935] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-31T19:16:53.300006] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-31T19:16:53.563127] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T19:16:53.700009] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:16:53.733035] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T19:16:53.857667] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-31T19:16:54.413315] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-31T19:16:54.657637] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-31T19:16:54.913878] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-31T19:16:55.457693] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-31T19:16:55.632545] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.17 seconds). [2025-10-31T19:16:56.257636] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-31T19:16:56.482039] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-10-31T19:16:57.057720] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-31T19:16:57.249530] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-10-31T19:16:57.857692] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-31T19:16:58.081779] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-31T19:16:58.657620] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-31T19:16:58.876227] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-10-31T19:16:59.457679] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-31T19:17:00.257728] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-31T19:17:00.750810] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T19:17:01.055421] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T19:17:01.066084] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-31T19:17:01.074705] [INFO ] [REMOTE ] HXL: Full fetch complete (66783 records). [2025-10-31T19:17:01.074912] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-31T19:17:01.402161] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-31T19:17:01.553042] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-31T19:17:01.553126] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-31T19:17:01.554071] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-31T19:17:01.554134] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-31T19:17:01.555442] [DEBUG] [LOCAL ] HXL: Trimmed 66783 records to 46459 (keeping 200 days of data) [2025-10-31T19:17:01.841509] [DEBUG] [LOCAL ] HXL: Primary data saved (46459 records). [2025-10-31T19:17:01.841680] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-31T19:17:01.842311] [INFO ] [MAIN ] Update Progress: 1071/2365 symbols completed. HXL took 36.8s. Estimated remaining: 2h 45m 29s. Rate: 7.8 symbols/min [2025-10-31T19:17:01.864164] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-31T19:17:02.047604] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:17:02.060018] [DEBUG] [LOCAL ] HYI: Loaded 9543 existing records from primary storage. [2025-10-31T19:17:02.060245] [INFO ] [MAIN ] HYI: Loaded 9543 existing records. [2025-10-31T19:17:02.238445] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:17:02.238734] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-31T19:17:02.238787] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-31T19:17:02.239018] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-31T19:17:02.239077] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-31T19:17:02.576853] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-31T19:17:02.638498] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:17:02.657609] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-31T19:17:03.334706] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T19:17:03.457686] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-31T19:17:03.741210] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-31T19:17:04.257676] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-31T19:17:04.749058] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-31T19:17:05.057681] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-31T19:17:05.610212] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-31T19:17:05.857699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-31T19:17:06.029575] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.17 seconds). [2025-10-31T19:17:06.657689] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-31T19:17:06.893430] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-31T19:17:07.457682] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-31T19:17:07.689488] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-31T19:17:08.257683] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-31T19:17:08.762230] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T19:17:09.057672] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-31T19:17:09.637150] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-31T19:17:09.857682] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-31T19:17:10.009982] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.15 seconds). [2025-10-31T19:17:10.657665] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-31T19:17:11.357784] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-31T19:17:11.360218] [INFO ] [REMOTE ] HY: Full fetch complete (14636 records). [2025-10-31T19:17:11.360286] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-31T19:17:11.460890] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-31T19:17:11.722027] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-31T19:17:11.722101] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-31T19:17:11.722462] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-31T19:17:11.722530] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-31T19:17:11.723076] [DEBUG] [LOCAL ] HY: Trimmed 14636 records to 9636 (keeping 200 days of data) [2025-10-31T19:17:11.796231] [DEBUG] [LOCAL ] HY: Primary data saved (9636 records). [2025-10-31T19:17:11.796370] [INFO ] [MAIN ] HY: Full history saved. [2025-10-31T19:17:11.796449] [INFO ] [MAIN ] Update Progress: 1072/2365 symbols completed. HY took 27.1s. Estimated remaining: 2h 45m 24s. Rate: 7.8 symbols/min [2025-10-31T19:17:11.906165] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-31T19:17:11.907383] [INFO ] [REMOTE ] HYAC: Full fetch complete (897 records). [2025-10-31T19:17:11.917920] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-31T19:17:12.092399] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:17:12.177661] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-10-31T19:17:12.177989] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:17:12.178070] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:17:12.178151] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-31T19:17:12.178224] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-31T19:17:12.178268] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-31T19:17:12.178314] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-31T19:17:12.178377] [INFO ] [MAIN ] Update Progress: 1073/2365 symbols completed. HYAC took 25.7s. Estimated remaining: 2h 45m 7s. Rate: 7.8 symbols/min [2025-10-31T19:17:12.262750] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-31T19:17:12.328178] [DEBUG] [LOCAL ] HYT: Loaded 33105 existing records from primary storage. [2025-10-31T19:17:12.348261] [INFO ] [MAIN ] HYT: Loaded 33105 existing records. [2025-10-31T19:17:12.415843] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:17:12.549109] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-31T19:17:12.549008] [DEBUG] [LOCAL ] HYTR: Loaded 3100 existing records from primary storage. [2025-10-31T19:17:12.551195] [INFO ] [MAIN ] HYTR: Loaded 3100 existing records. [2025-10-31T19:17:12.600599] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:17:12.652163] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-31T19:17:12.663246] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-31T19:17:12.684551] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-31T19:17:12.689968] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-31T19:17:12.869337] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:17:12.879792] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-31T19:17:12.884982] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-31T19:17:12.902466] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-31T19:17:12.912854] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-31T19:17:13.063528] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-31T19:17:13.434852] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:17:13.535130] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:17:13.705738] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T19:17:13.857626] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-31T19:17:14.327923] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-31T19:17:14.657678] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-31T19:17:15.150289] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T19:17:15.457689] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-31T19:17:15.703767] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-31T19:17:16.257696] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-31T19:17:16.447849] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-10-31T19:17:17.057626] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-31T19:17:17.417354] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-31T19:17:17.857694] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-31T19:17:18.657667] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-31T19:17:18.905449] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T19:17:19.052475] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-31T19:17:19.457681] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-31T19:17:19.988242] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T19:17:20.257623] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-31T19:17:20.746462] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-31T19:17:21.057675] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-31T19:17:21.567056] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-31T19:17:21.857633] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-31T19:17:22.227755] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-31T19:17:22.657672] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-31T19:17:22.997314] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-31T19:17:23.457702] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-31T19:17:24.257695] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-31T19:17:24.370955] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T19:17:24.751635] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-31T19:17:24.752420] [INFO ] [REMOTE ] HYBX: Full fetch complete (676 records). [2025-10-31T19:17:24.752487] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-31T19:17:24.931366] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-31T19:17:24.931559] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:17:24.931626] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:17:24.931715] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-31T19:17:24.931777] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-31T19:17:24.931814] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-31T19:17:24.931900] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-31T19:17:24.931960] [INFO ] [MAIN ] Update Progress: 1074/2365 symbols completed. HYBX took 31.8s. Estimated remaining: 2h 45m 6s. Rate: 7.8 symbols/min [2025-10-31T19:17:25.067091] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-31T19:17:25.098995] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:17:25.125547] [DEBUG] [LOCAL ] HZO: Loaded 28202 existing records from primary storage. [2025-10-31T19:17:25.125858] [INFO ] [MAIN ] HZO: Loaded 28202 existing records. [2025-10-31T19:17:25.303107] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:17:25.303341] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-31T19:17:25.303394] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-31T19:17:25.303987] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-31T19:17:25.304043] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-31T19:17:25.556850] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T19:17:25.668302] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:17:25.857663] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-31T19:17:26.527760] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T19:17:26.530977] [INFO ] [REMOTE ] HYI: Full fetch complete (14158 records). [2025-10-31T19:17:26.531046] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-31T19:17:26.662805] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-31T19:17:26.925099] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-31T19:17:26.925173] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-31T19:17:26.925476] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-31T19:17:26.925514] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-31T19:17:26.925982] [DEBUG] [LOCAL ] HYI: Trimmed 14158 records to 9633 (keeping 200 days of data) [2025-10-31T19:17:26.983332] [DEBUG] [LOCAL ] HYI: Primary data saved (9633 records). [2025-10-31T19:17:26.983462] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-31T19:17:26.983539] [INFO ] [MAIN ] Update Progress: 1075/2365 symbols completed. HYI took 25.1s. Estimated remaining: 2h 44m 51s. Rate: 7.8 symbols/min [2025-10-31T19:17:27.155351] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:17:27.163291] [DEBUG] [LOCAL ] IAE: Loaded 6551 existing records from primary storage. [2025-10-31T19:17:27.163488] [INFO ] [MAIN ] IAE: Loaded 6551 existing records. [2025-10-31T19:17:27.337425] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:17:27.337670] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-31T19:17:27.337730] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-31T19:17:27.337979] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-31T19:17:27.338034] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-31T19:17:27.462717] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-31T19:17:27.698586] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:17:27.719064] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T19:17:28.257635] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-31T19:17:28.496700] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T19:17:28.594668] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-31T19:17:29.057688] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-31T19:17:29.817067] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T19:17:29.857672] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-31T19:17:30.657629] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-31T19:17:30.739504] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T19:17:31.457620] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-31T19:17:31.665316] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T19:17:32.257680] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-31T19:17:32.567454] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-31T19:17:32.596463] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T19:17:33.057665] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-31T19:17:33.460022] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-31T19:17:33.857664] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-31T19:17:34.261389] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T19:17:34.657668] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-31T19:17:35.110192] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-31T19:17:35.457635] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-31T19:17:35.724109] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-31T19:17:36.257668] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-31T19:17:37.057672] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-31T19:17:37.185633] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-31T19:17:37.857630] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-31T19:17:37.897181] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T19:17:38.592229] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T19:17:38.657618] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-31T19:17:38.715608] [DEBUG] [REMOTE ] HZO: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-31T19:17:38.715854] [WARN ] [REMOTE ] HZO: No data returned for month 2025-06 [2025-10-31T19:17:38.715948] [FATAL] [REMOTE ] HZO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:17:38.716020] [FATAL] [MAIN ] HZO: Failed to fetch primary data. [2025-10-31T19:17:38.716056] [WARN ] [MAIN ] HZO: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:17:38.716121] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-31T19:17:38.716178] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-31T19:17:38.716212] [INFO ] [LOCAL ] HZO: Starting deletion of derivative data. [2025-10-31T19:17:38.716381] [DEBUG] [LOCAL ] HZO: Deleted derivative data file. [2025-10-31T19:17:38.716460] [INFO ] [MAIN ] Update Progress: 1076/2365 symbols completed. HZO took 13.8s. Estimated remaining: 2h 44m 48s. Rate: 7.8 symbols/min [2025-10-31T19:17:38.882802] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:17:38.931125] [DEBUG] [LOCAL ] IAG: Loaded 53882 existing records from primary storage. [2025-10-31T19:17:38.931431] [INFO ] [MAIN ] IAG: Loaded 53882 existing records. [2025-10-31T19:17:39.104880] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:17:39.105100] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-31T19:17:39.105146] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-31T19:17:39.106078] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-31T19:17:39.106134] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-31T19:17:39.463591] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-31T19:17:39.495620] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:17:39.769412] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-31T19:17:40.257705] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-31T19:17:41.057623] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-31T19:17:41.260015] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-31T19:17:41.458333] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-31T19:17:41.857677] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-31T19:17:42.657736] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-31T19:17:42.948128] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T19:17:43.183826] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T19:17:43.185580] [INFO ] [REMOTE ] HYTR: Full fetch complete (4717 records). [2025-10-31T19:17:43.185734] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-31T19:17:43.462782] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-31T19:17:43.563945] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-31T19:17:43.564026] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-31T19:17:43.564184] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-31T19:17:43.564223] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-31T19:17:43.564598] [DEBUG] [LOCAL ] HYTR: Trimmed 4717 records to 3118 (keeping 200 days of data) [2025-10-31T19:17:43.583609] [DEBUG] [LOCAL ] HYTR: Primary data saved (3118 records). [2025-10-31T19:17:43.583725] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-31T19:17:43.583809] [INFO ] [MAIN ] Update Progress: 1077/2365 symbols completed. HYTR took 31.4s. Estimated remaining: 2h 44m 37s. Rate: 7.8 symbols/min [2025-10-31T19:17:44.257680] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-31T19:17:44.707991] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-31T19:17:44.761153] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:17:45.057717] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-31T19:17:45.857680] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-31T19:17:46.466024] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T19:17:46.657619] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-31T19:17:46.747004] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T19:17:47.457668] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-31T19:17:48.015017] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T19:17:48.257725] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-31T19:17:48.605315] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-31T19:17:48.613144] [INFO ] [REMOTE ] HYT: Full fetch complete (47621 records). [2025-10-31T19:17:48.613245] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-31T19:17:48.736580] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-31T19:17:48.994500] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-31T19:17:48.994573] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-31T19:17:48.995306] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-31T19:17:48.995368] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-31T19:17:48.996274] [DEBUG] [LOCAL ] HYT: Trimmed 47621 records to 33310 (keeping 200 days of data) [2025-10-31T19:17:49.080685] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-31T19:17:49.194481] [DEBUG] [LOCAL ] HYT: Primary data saved (33310 records). [2025-10-31T19:17:49.194657] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-31T19:17:49.194760] [INFO ] [MAIN ] Update Progress: 1078/2365 symbols completed. HYT took 37.4s. Estimated remaining: 2h 44m 27s. Rate: 7.8 symbols/min [2025-10-31T19:17:49.508542] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T19:17:49.857677] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-31T19:17:50.307398] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-31T19:17:50.657711] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-31T19:17:51.153810] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-31T19:17:51.457676] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-31T19:17:52.038805] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T19:17:52.042021] [INFO ] [REMOTE ] IAE: Full fetch complete (9223 records). [2025-10-31T19:17:52.042149] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-31T19:17:52.262797] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-31T19:17:52.486818] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-31T19:17:52.486948] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-31T19:17:52.487731] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-31T19:17:52.487813] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-31T19:17:52.489182] [DEBUG] [LOCAL ] IAE: Trimmed 9223 records to 6584 (keeping 200 days of data) [2025-10-31T19:17:52.527128] [DEBUG] [LOCAL ] IAE: Primary data saved (6584 records). [2025-10-31T19:17:52.527261] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-31T19:17:52.527343] [INFO ] [MAIN ] Update Progress: 1079/2365 symbols completed. IAE took 25.5s. Estimated remaining: 2h 44m 14s. Rate: 7.8 symbols/min [2025-10-31T19:17:53.813992] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T19:17:53.827812] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-31T19:17:55.154803] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T19:17:55.166059] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-31T19:17:56.428622] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:17:56.439337] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-31T19:17:57.802738] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T19:17:57.814266] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-31T19:17:59.122723] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T19:17:59.134565] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-31T19:18:00.640207] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T19:18:00.651637] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-31T19:18:02.513887] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-31T19:18:02.527429] [INFO ] [REMOTE ] IAG: Full fetch complete (77537 records). [2025-10-31T19:18:02.527596] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-31T19:18:02.913665] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-31T19:18:02.913752] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-31T19:18:02.914721] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-31T19:18:02.914782] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-31T19:18:02.916176] [DEBUG] [LOCAL ] IAG: Trimmed 77537 records to 54272 (keeping 200 days of data) [2025-10-31T19:18:03.224890] [DEBUG] [LOCAL ] IAG: Primary data saved (54272 records). [2025-10-31T19:18:03.225301] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-31T19:18:03.225418] [INFO ] [MAIN ] Update Progress: 1080/2365 symbols completed. IAG took 24.5s. Estimated remaining: 2h 44m 10s. Rate: 7.8 symbols/min [2025-10-31T19:18:03.720301] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:03.894023] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:03.917493] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:03.920759] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:03.944663] [DEBUG] [LOCAL ] IBP: Loaded 28199 existing records from primary storage. [2025-10-31T19:18:03.945134] [INFO ] [MAIN ] IBP: Loaded 28199 existing records. [2025-10-31T19:18:04.150856] [DEBUG] [LOCAL ] IBTA: Loaded 35548 existing records from primary storage. [2025-10-31T19:18:04.177756] [INFO ] [MAIN ] IBTA: Loaded 35548 existing records. [2025-10-31T19:18:04.208368] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:04.235042] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-31T19:18:04.283384] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-31T19:18:04.323787] [DEBUG] [LOCAL ] IBM: Loaded 54018 existing records from primary storage. [2025-10-31T19:18:04.324634] [DEBUG] [LOCAL ] IBN: Loaded 53166 existing records from primary storage. [2025-10-31T19:18:04.325623] [INFO ] [MAIN ] IBN: Loaded 53166 existing records. [2025-10-31T19:18:04.330970] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-31T19:18:04.325533] [INFO ] [MAIN ] IBM: Loaded 54018 existing records. [2025-10-31T19:18:04.402504] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-31T19:18:04.647607] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:04.706401] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-31T19:18:04.747420] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-31T19:18:04.802944] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-31T19:18:04.901443] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-31T19:18:04.931857] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:04.988432] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:05.038536] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-31T19:18:05.067454] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-31T19:18:05.092038] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-31T19:18:05.112916] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-31T19:18:05.123493] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-31T19:18:05.147991] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-31T19:18:05.188581] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-31T19:18:05.265826] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-31T19:18:05.698284] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:05.813700] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-31T19:18:06.197435] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:06.207453] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-31T19:18:06.346733] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:06.363445] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-31T19:18:06.367372] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:06.368582] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-31T19:18:06.808877] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T19:18:06.813963] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-31T19:18:07.088992] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-31T19:18:07.094432] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-31T19:18:07.757404] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:18:07.758809] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T19:18:07.769901] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-31T19:18:07.778412] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-31T19:18:07.897235] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-31T19:18:07.902271] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-31T19:18:07.965079] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T19:18:07.975560] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-31T19:18:08.743912] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T19:18:08.751192] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-31T19:18:08.864425] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-31T19:18:08.875618] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-31T19:18:09.099528] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T19:18:09.109555] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-31T19:18:09.671606] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T19:18:09.678110] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-31T19:18:09.756091] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-31T19:18:09.766200] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-31T19:18:10.205141] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-31T19:18:10.216768] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-31T19:18:10.247579] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T19:18:10.657801] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-31T19:18:10.692912] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-31T19:18:11.250188] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T19:18:11.296218] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T19:18:11.457672] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-31T19:18:11.569222] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T19:18:12.257686] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-31T19:18:13.004870] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T19:18:13.057669] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-31T19:18:13.195360] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T19:18:13.857698] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-31T19:18:14.642217] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-31T19:18:14.657602] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-31T19:18:14.696252] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-31T19:18:15.457619] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-31T19:18:15.565315] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T19:18:16.257671] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-31T19:18:16.372136] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T19:18:17.057696] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-31T19:18:17.364209] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T19:18:17.857735] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-31T19:18:18.034861] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-31T19:18:18.657762] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-31T19:18:19.457671] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-31T19:18:19.527089] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-31T19:18:19.985009] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T19:18:20.257670] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-31T19:18:20.517357] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T19:18:21.057686] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-31T19:18:21.857679] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-31T19:18:22.106999] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-31T19:18:22.145500] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-31T19:18:22.154112] [INFO ] [REMOTE ] IBTA: Full fetch complete (51213 records). [2025-10-31T19:18:22.154267] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-31T19:18:22.564173] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-31T19:18:22.564315] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-31T19:18:22.565508] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-31T19:18:22.565583] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-31T19:18:22.567317] [DEBUG] [LOCAL ] IBTA: Trimmed 51213 records to 35767 (keeping 200 days of data) [2025-10-31T19:18:22.657714] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-31T19:18:22.797953] [DEBUG] [LOCAL ] IBTA: Primary data saved (35767 records). [2025-10-31T19:18:22.798177] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-31T19:18:22.798282] [INFO ] [MAIN ] Update Progress: 1081/2365 symbols completed. IBTA took 19.6s. Estimated remaining: 2h 44m 17s. Rate: 7.8 symbols/min [2025-10-31T19:18:22.986890] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:23.020115] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T19:18:23.083338] [DEBUG] [LOCAL ] ICE: Loaded 53397 existing records from primary storage. [2025-10-31T19:18:23.083929] [INFO ] [MAIN ] ICE: Loaded 53397 existing records. [2025-10-31T19:18:23.281559] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:23.281759] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-31T19:18:23.281825] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-31T19:18:23.282160] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-31T19:18:23.282219] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-31T19:18:23.464167] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-31T19:18:23.660330] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:24.257689] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-31T19:18:24.443904] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T19:18:24.568047] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-31T19:18:25.057680] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-31T19:18:25.778736] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T19:18:25.857668] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-31T19:18:26.339149] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T19:18:26.346004] [INFO ] [REMOTE ] IBP: Full fetch complete (41068 records). [2025-10-31T19:18:26.346157] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-31T19:18:26.662749] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-31T19:18:26.743569] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-31T19:18:26.743681] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-31T19:18:26.744468] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-31T19:18:26.744513] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-31T19:18:26.745474] [DEBUG] [LOCAL ] IBP: Trimmed 41068 records to 28404 (keeping 200 days of data) [2025-10-31T19:18:26.922177] [DEBUG] [LOCAL ] IBP: Primary data saved (28404 records). [2025-10-31T19:18:26.922370] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-31T19:18:26.922461] [INFO ] [MAIN ] Update Progress: 1082/2365 symbols completed. IBP took 23.7s. Estimated remaining: 2h 44m 5s. Rate: 7.8 symbols/min [2025-10-31T19:18:27.091554] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:27.121848] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T19:18:27.159542] [DEBUG] [LOCAL ] ICL: Loaded 37764 existing records from primary storage. [2025-10-31T19:18:27.159849] [INFO ] [MAIN ] ICL: Loaded 37764 existing records. [2025-10-31T19:18:27.335581] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:27.335807] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-31T19:18:27.335863] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-31T19:18:27.336082] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-31T19:18:27.336123] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-31T19:18:27.472217] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-31T19:18:27.687207] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:28.257734] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-31T19:18:28.627169] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-31T19:18:28.745874] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T19:18:29.057681] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-31T19:18:29.319862] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T19:18:29.857697] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-31T19:18:30.571716] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T19:18:30.657621] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-31T19:18:31.299368] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T19:18:31.457678] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-31T19:18:31.943385] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T19:18:32.257668] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-31T19:18:32.687736] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T19:18:33.057676] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-31T19:18:33.491354] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T19:18:33.582564] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-31T19:18:33.594890] [INFO ] [REMOTE ] IBM: Full fetch complete (77750 records). [2025-10-31T19:18:33.595053] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-31T19:18:33.862871] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-31T19:18:33.980026] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-31T19:18:33.980127] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-31T19:18:33.981161] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-31T19:18:33.981226] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-31T19:18:33.982681] [DEBUG] [LOCAL ] IBM: Trimmed 77750 records to 54408 (keeping 200 days of data) [2025-10-31T19:18:34.316838] [DEBUG] [LOCAL ] IBM: Primary data saved (54408 records). [2025-10-31T19:18:34.316971] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-31T19:18:34.317777] [INFO ] [MAIN ] Update Progress: 1083/2365 symbols completed. IBM took 31.1s. Estimated remaining: 2h 43m 57s. Rate: 7.8 symbols/min [2025-10-31T19:18:34.480341] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:34.516228] [DEBUG] [LOCAL ] IDA: Loaded 32763 existing records from primary storage. [2025-10-31T19:18:34.516490] [INFO ] [MAIN ] IDA: Loaded 32763 existing records. [2025-10-31T19:18:34.662755] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-31T19:18:34.689791] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:34.690141] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-31T19:18:34.690194] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-31T19:18:34.690468] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-31T19:18:34.690522] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-31T19:18:35.040171] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:35.079734] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T19:18:35.457626] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-31T19:18:36.063933] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-31T19:18:36.257626] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-31T19:18:36.463724] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T19:18:37.057706] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-31T19:18:37.741740] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T19:18:37.753947] [INFO ] [REMOTE ] IBN: Full fetch complete (76666 records). [2025-10-31T19:18:37.754085] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-31T19:18:37.862730] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-31T19:18:38.141086] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-31T19:18:38.141180] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-31T19:18:38.142220] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-31T19:18:38.142291] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-31T19:18:38.143811] [DEBUG] [LOCAL ] IBN: Trimmed 76666 records to 53556 (keeping 200 days of data) [2025-10-31T19:18:38.412688] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T19:18:38.529180] [DEBUG] [LOCAL ] IBN: Primary data saved (53556 records). [2025-10-31T19:18:38.529313] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-31T19:18:38.529391] [INFO ] [MAIN ] Update Progress: 1084/2365 symbols completed. IBN took 35.3s. Estimated remaining: 2h 43m 45s. Rate: 7.8 symbols/min [2025-10-31T19:18:38.664519] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-31T19:18:38.695520] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:38.707003] [DEBUG] [LOCAL ] IDE: Loaded 9201 existing records from primary storage. [2025-10-31T19:18:38.707295] [INFO ] [MAIN ] IDE: Loaded 9201 existing records. [2025-10-31T19:18:38.883247] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:38.883497] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-31T19:18:38.883548] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-31T19:18:38.883735] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-31T19:18:38.883791] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-31T19:18:39.244344] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:39.276456] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T19:18:39.457680] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-31T19:18:39.636104] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T19:18:40.055934] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-31T19:18:40.257681] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-31T19:18:40.710177] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-31T19:18:41.057740] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-31T19:18:41.857671] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-31T19:18:42.348223] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T19:18:42.416445] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-31T19:18:42.657680] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-31T19:18:43.117627] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T19:18:43.457721] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-31T19:18:44.257728] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-31T19:18:44.342581] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T19:18:45.057673] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-31T19:18:45.615712] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T19:18:45.857637] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-31T19:18:46.060998] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-31T19:18:46.657692] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-31T19:18:47.031330] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T19:18:47.457676] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-31T19:18:47.609535] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-31T19:18:47.980403] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T19:18:48.257698] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-31T19:18:49.057702] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-31T19:18:49.857692] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-31T19:18:49.920952] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-31T19:18:49.933332] [INFO ] [REMOTE ] ICE: Full fetch complete (77028 records). [2025-10-31T19:18:49.933481] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-31T19:18:50.325472] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T19:18:50.372982] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-31T19:18:50.373064] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-31T19:18:50.374113] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-31T19:18:50.374179] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-31T19:18:50.375587] [DEBUG] [LOCAL ] ICE: Trimmed 77028 records to 53787 (keeping 200 days of data) [2025-10-31T19:18:50.658830] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-31T19:18:50.711570] [DEBUG] [LOCAL ] ICE: Primary data saved (53787 records). [2025-10-31T19:18:50.711745] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-31T19:18:50.711834] [INFO ] [MAIN ] Update Progress: 1085/2365 symbols completed. ICE took 27.9s. Estimated remaining: 2h 43m 43s. Rate: 7.8 symbols/min [2025-10-31T19:18:50.889132] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:18:50.914005] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T19:18:50.936975] [DEBUG] [LOCAL ] IDT: Loaded 18616 existing records from primary storage. [2025-10-31T19:18:50.937245] [INFO ] [MAIN ] IDT: Loaded 18616 existing records. [2025-10-31T19:18:51.113080] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:18:51.113283] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-31T19:18:51.113327] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-31T19:18:51.113564] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-31T19:18:51.113620] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-31T19:18:51.455436] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:18:51.457612] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-31T19:18:51.766583] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T19:18:51.953075] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-31T19:18:52.257671] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-31T19:18:52.762816] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-31T19:18:53.057704] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-31T19:18:53.857690] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-31T19:18:54.093870] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T19:18:54.564418] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T19:18:54.657613] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-31T19:18:55.404944] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-31T19:18:55.457613] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-31T19:18:56.133890] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T19:18:56.257633] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-31T19:18:57.057617] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-31T19:18:57.123186] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-31T19:18:57.555878] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-31T19:18:57.857666] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-31T19:18:58.610118] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T19:18:58.657689] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-31T19:18:59.457709] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-31T19:18:59.542820] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T19:19:00.076509] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-31T19:19:00.257691] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-31T19:19:01.057698] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-31T19:19:01.322791] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T19:19:01.556515] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T19:19:01.857691] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-31T19:19:02.657676] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-31T19:19:02.842687] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-31T19:19:03.152340] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-31T19:19:03.457669] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-31T19:19:04.257706] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-31T19:19:04.284243] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-31T19:19:05.057729] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-31T19:19:05.380979] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T19:19:05.388317] [INFO ] [REMOTE ] IDA: Full fetch complete (45337 records). [2025-10-31T19:19:05.388410] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-31T19:19:05.766968] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T19:19:05.786345] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-31T19:19:05.787041] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-31T19:19:05.788079] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-31T19:19:05.788166] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-31T19:19:05.788426] [INFO ] [REMOTE ] IDE: Full fetch complete (12685 records). [2025-10-31T19:19:05.789129] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-31T19:19:05.826706] [DEBUG] [LOCAL ] IDA: Trimmed 45337 records to 32990 (keeping 200 days of data) [2025-10-31T19:19:05.866443] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-31T19:19:06.375933] [DEBUG] [LOCAL ] IDA: Primary data saved (32990 records). [2025-10-31T19:19:06.398966] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-31T19:19:06.408955] [INFO ] [MAIN ] Update Progress: 1086/2365 symbols completed. IDA took 32.1s. Estimated remaining: 2h 43m 45s. Rate: 7.8 symbols/min [2025-10-31T19:19:06.433631] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-31T19:19:06.438924] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-31T19:19:06.439277] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-31T19:19:06.470777] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-31T19:19:06.520535] [DEBUG] [LOCAL ] IDE: Trimmed 12685 records to 9258 (keeping 200 days of data) [2025-10-31T19:19:06.659549] [DEBUG] [LOCAL ] IDE: Primary data saved (9258 records). [2025-10-31T19:19:06.686125] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-31T19:19:06.686284] [INFO ] [MAIN ] Update Progress: 1087/2365 symbols completed. IDE took 28.2s. Estimated remaining: 2h 43m 28s. Rate: 7.8 symbols/min [2025-10-31T19:19:06.684152] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-31T19:19:06.686011] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:06.916125] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:06.917286] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T19:19:06.936764] [DEBUG] [LOCAL ] IEX: Loaded 38321 existing records from primary storage. [2025-10-31T19:19:06.937203] [INFO ] [MAIN ] IEX: Loaded 38321 existing records. [2025-10-31T19:19:07.138702] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:07.138974] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-31T19:19:07.139024] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-31T19:19:07.139392] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-31T19:19:07.139447] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-31T19:19:07.282770] [DEBUG] [LOCAL ] IFF: Loaded 51573 existing records from primary storage. [2025-10-31T19:19:07.307607] [INFO ] [MAIN ] IFF: Loaded 51573 existing records. [2025-10-31T19:19:07.462855] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-31T19:19:07.681035] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:07.719135] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-31T19:19:07.745745] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-31T19:19:07.745558] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:07.746597] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-31T19:19:07.746735] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-31T19:19:07.902195] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T19:19:08.158211] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:08.257740] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-31T19:19:08.337632] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-31T19:19:09.057722] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-31T19:19:09.172864] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T19:19:09.857732] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-31T19:19:10.193445] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T19:19:10.657713] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-31T19:19:10.848487] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-31T19:19:10.853887] [INFO ] [REMOTE ] IDT: Full fetch complete (24353 records). [2025-10-31T19:19:10.854009] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-31T19:19:11.225336] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-31T19:19:11.225411] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-31T19:19:11.225920] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-31T19:19:11.225980] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-31T19:19:11.226597] [DEBUG] [LOCAL ] IDT: Trimmed 24353 records to 18726 (keeping 200 days of data) [2025-10-31T19:19:11.337402] [DEBUG] [LOCAL ] IDT: Primary data saved (18726 records). [2025-10-31T19:19:11.337554] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-31T19:19:11.337663] [INFO ] [MAIN ] Update Progress: 1088/2365 symbols completed. IDT took 20.6s. Estimated remaining: 2h 43m 17s. Rate: 7.8 symbols/min [2025-10-31T19:19:11.462824] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-31T19:19:11.507825] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:11.526635] [DEBUG] [LOCAL ] IFN: Loaded 18224 existing records from primary storage. [2025-10-31T19:19:11.526892] [INFO ] [MAIN ] IFN: Loaded 18224 existing records. [2025-10-31T19:19:11.708493] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:11.708878] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-31T19:19:11.709012] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-31T19:19:11.709198] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-31T19:19:11.709238] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-31T19:19:12.040564] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-31T19:19:12.103770] [INFO ] [REMOTE ] ICL: Full fetch complete (55447 records). [2025-10-31T19:19:12.106181] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-31T19:19:12.127608] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:12.264828] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-31T19:19:12.509356] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-31T19:19:12.509480] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-31T19:19:12.510630] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-31T19:19:12.510750] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-31T19:19:12.512516] [DEBUG] [LOCAL ] ICL: Trimmed 55447 records to 37947 (keeping 200 days of data) [2025-10-31T19:19:12.626786] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-31T19:19:12.744688] [DEBUG] [LOCAL ] ICL: Primary data saved (37947 records). [2025-10-31T19:19:12.744818] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-31T19:19:12.745365] [INFO ] [MAIN ] Update Progress: 1089/2365 symbols completed. ICL took 45.8s. Estimated remaining: 2h 43m 2s. Rate: 7.8 symbols/min [2025-10-31T19:19:12.909326] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:12.930496] [DEBUG] [LOCAL ] IFS: Loaded 21851 existing records from primary storage. [2025-10-31T19:19:12.930751] [INFO ] [MAIN ] IFS: Loaded 21851 existing records. [2025-10-31T19:19:13.068612] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-31T19:19:13.108497] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:13.108674] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-31T19:19:13.108732] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-31T19:19:13.108939] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-31T19:19:13.108994] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-31T19:19:13.478964] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:13.534165] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-31T19:19:13.857716] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-31T19:19:14.049056] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T19:19:14.657701] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-31T19:19:15.145235] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T19:19:15.381752] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-31T19:19:15.457621] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-31T19:19:16.139565] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-31T19:19:16.257686] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-31T19:19:17.022266] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T19:19:17.057612] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-31T19:19:17.767025] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-31T19:19:17.857619] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-31T19:19:18.447165] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-31T19:19:18.657700] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-31T19:19:19.457722] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-31T19:19:19.737919] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T19:19:20.176767] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T19:19:20.257633] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-31T19:19:21.057746] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-31T19:19:21.382545] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T19:19:21.737507] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T19:19:21.857622] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-31T19:19:22.657680] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-31T19:19:23.198955] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T19:19:23.457666] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-31T19:19:23.824998] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T19:19:24.215328] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T19:19:24.257619] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-31T19:19:25.057626] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-31T19:19:25.297539] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T19:19:25.841793] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-31T19:19:25.857599] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-31T19:19:26.626918] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T19:19:26.657631] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-31T19:19:27.457671] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-31T19:19:28.096351] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T19:19:28.138248] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-31T19:19:28.257602] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-31T19:19:29.057633] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-31T19:19:29.215613] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-31T19:19:29.220503] [INFO ] [REMOTE ] IFN: Full fetch complete (27470 records). [2025-10-31T19:19:29.220608] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-31T19:19:29.592533] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-31T19:19:29.592633] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-31T19:19:29.593229] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-31T19:19:29.593272] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-31T19:19:29.593912] [DEBUG] [LOCAL ] IFN: Trimmed 27470 records to 18322 (keeping 200 days of data) [2025-10-31T19:19:29.701159] [DEBUG] [LOCAL ] IFN: Primary data saved (18322 records). [2025-10-31T19:19:29.701273] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-31T19:19:29.701347] [INFO ] [MAIN ] Update Progress: 1090/2365 symbols completed. IFN took 18.4s. Estimated remaining: 2h 43m 5s. Rate: 7.8 symbols/min [2025-10-31T19:19:29.872493] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-31T19:19:29.882326] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:29.884617] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T19:19:29.898695] [DEBUG] [LOCAL ] IGA: Loaded 9759 existing records from primary storage. [2025-10-31T19:19:29.898928] [INFO ] [MAIN ] IGA: Loaded 9759 existing records. [2025-10-31T19:19:30.070224] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:30.070427] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-31T19:19:30.070472] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-31T19:19:30.070675] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-31T19:19:30.070735] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-31T19:19:30.415497] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:30.657719] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-31T19:19:31.181670] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T19:19:31.192456] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-31T19:19:31.457670] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-31T19:19:32.257665] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-31T19:19:32.694863] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T19:19:32.886152] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-31T19:19:33.057683] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-31T19:19:33.733165] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-31T19:19:33.857672] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-31T19:19:34.657673] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-31T19:19:34.767624] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T19:19:35.027381] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T19:19:35.457713] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-31T19:19:36.257939] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-31T19:19:36.474767] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T19:19:36.941957] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T19:19:37.057711] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-31T19:19:37.857730] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-31T19:19:38.377995] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T19:19:38.657676] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-31T19:19:38.964857] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T19:19:39.143444] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T19:19:39.457719] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-31T19:19:40.257709] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-31T19:19:40.510872] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-31T19:19:40.996816] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-31T19:19:41.057623] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-31T19:19:41.623669] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T19:19:41.857617] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-31T19:19:42.426284] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-31T19:19:42.657684] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-31T19:19:43.457719] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-31T19:19:43.745091] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-31T19:19:43.749840] [INFO ] [REMOTE ] IFS: Full fetch complete (32402 records). [2025-10-31T19:19:43.749952] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-31T19:19:44.062272] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T19:19:44.126414] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-31T19:19:44.126525] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-31T19:19:44.127176] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-31T19:19:44.127236] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-31T19:19:44.127983] [DEBUG] [LOCAL ] IFS: Trimmed 32402 records to 21948 (keeping 200 days of data) [2025-10-31T19:19:44.254782] [DEBUG] [LOCAL ] IFS: Primary data saved (21948 records). [2025-10-31T19:19:44.254901] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-31T19:19:44.254977] [INFO ] [MAIN ] Update Progress: 1091/2365 symbols completed. IFS took 31.5s. Estimated remaining: 2h 43m 6s. Rate: 7.8 symbols/min [2025-10-31T19:19:44.266221] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-31T19:19:44.441873] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:44.463298] [DEBUG] [LOCAL ] IGD: Loaded 19361 existing records from primary storage. [2025-10-31T19:19:44.463530] [INFO ] [MAIN ] IGD: Loaded 19361 existing records. [2025-10-31T19:19:44.636548] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:44.636826] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-31T19:19:44.636876] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-31T19:19:44.637047] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-31T19:19:44.637085] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-31T19:19:44.980370] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:45.057676] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-31T19:19:45.500363] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T19:19:45.857672] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-31T19:19:46.283288] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-31T19:19:46.657709] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-31T19:19:47.036141] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-31T19:19:47.044742] [INFO ] [REMOTE ] IEX: Full fetch complete (54073 records). [2025-10-31T19:19:47.044868] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-31T19:19:47.197295] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-31T19:19:47.434394] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-31T19:19:47.434496] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-31T19:19:47.435315] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-31T19:19:47.435376] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-31T19:19:47.436461] [DEBUG] [LOCAL ] IEX: Trimmed 54073 records to 38584 (keeping 200 days of data) [2025-10-31T19:19:47.490246] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-31T19:19:47.677822] [DEBUG] [LOCAL ] IEX: Primary data saved (38584 records). [2025-10-31T19:19:47.678034] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-31T19:19:47.678714] [INFO ] [MAIN ] Update Progress: 1092/2365 symbols completed. IEX took 41.2s. Estimated remaining: 2h 42m 53s. Rate: 7.8 symbols/min [2025-10-31T19:19:47.846568] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:47.854203] [DEBUG] [LOCAL ] IGI: Loaded 4083 existing records from primary storage. [2025-10-31T19:19:47.854410] [INFO ] [MAIN ] IGI: Loaded 4083 existing records. [2025-10-31T19:19:48.035386] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:48.044521] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-31T19:19:48.045011] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-31T19:19:48.044840] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T19:19:48.048148] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-31T19:19:48.048521] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-31T19:19:48.262868] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-31T19:19:48.410447] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:49.057670] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-31T19:19:49.082072] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-31T19:19:49.857730] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-31T19:19:50.400247] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-31T19:19:50.657624] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-31T19:19:50.770290] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-31T19:19:50.961769] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-31T19:19:51.457689] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-31T19:19:52.172988] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-31T19:19:52.257629] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-31T19:19:53.003956] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-31T19:19:53.057693] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-31T19:19:53.715845] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-31T19:19:53.857692] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-31T19:19:54.178941] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-31T19:19:54.657637] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-31T19:19:55.299859] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T19:19:55.303124] [INFO ] [REMOTE ] IGA: Full fetch complete (14366 records). [2025-10-31T19:19:55.303203] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-31T19:19:55.458514] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-31T19:19:55.665570] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-31T19:19:55.665666] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-31T19:19:55.666004] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-31T19:19:55.666045] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-31T19:19:55.666490] [DEBUG] [LOCAL ] IGA: Trimmed 14366 records to 9880 (keeping 200 days of data) [2025-10-31T19:19:55.724325] [DEBUG] [LOCAL ] IGA: Primary data saved (9880 records). [2025-10-31T19:19:55.724453] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-31T19:19:55.724530] [INFO ] [MAIN ] Update Progress: 1093/2365 symbols completed. IGA took 26.0s. Estimated remaining: 2h 42m 46s. Rate: 7.8 symbols/min [2025-10-31T19:19:55.892708] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:55.921869] [DEBUG] [LOCAL ] IGR: Loaded 30144 existing records from primary storage. [2025-10-31T19:19:55.922141] [INFO ] [MAIN ] IGR: Loaded 30144 existing records. [2025-10-31T19:19:56.104327] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:56.104601] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-31T19:19:56.104740] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-31T19:19:56.105047] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-31T19:19:56.105104] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-31T19:19:56.279331] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-31T19:19:56.465774] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:56.776872] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T19:19:57.026039] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T19:19:57.038130] [INFO ] [REMOTE ] IFF: Full fetch complete (73870 records). [2025-10-31T19:19:57.038287] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-31T19:19:57.068136] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-31T19:19:57.426449] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-31T19:19:57.426532] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-31T19:19:57.427491] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-31T19:19:57.427562] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-31T19:19:57.429016] [DEBUG] [LOCAL ] IFF: Trimmed 73870 records to 51958 (keeping 200 days of data) [2025-10-31T19:19:57.742546] [DEBUG] [LOCAL ] IFF: Primary data saved (51958 records). [2025-10-31T19:19:57.742720] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-31T19:19:57.742826] [INFO ] [MAIN ] Update Progress: 1094/2365 symbols completed. IFF took 51.1s. Estimated remaining: 2h 42m 31s. Rate: 7.8 symbols/min [2025-10-31T19:19:57.862902] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-31T19:19:57.911798] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:19:57.916529] [DEBUG] [LOCAL ] IH: Loaded 2665 existing records from primary storage. [2025-10-31T19:19:57.916704] [INFO ] [MAIN ] IH: Loaded 2665 existing records. [2025-10-31T19:19:58.097722] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:19:58.098136] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-31T19:19:58.098214] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-31T19:19:58.098380] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-31T19:19:58.098484] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-31T19:19:58.279629] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T19:19:58.491034] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:19:58.533358] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-31T19:19:58.657686] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-31T19:19:59.457624] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-31T19:19:59.492514] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T19:19:59.687749] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-31T19:20:00.257674] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-31T19:20:00.507389] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-31T19:20:01.057671] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-31T19:20:01.553363] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T19:20:01.857679] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-31T19:20:02.628288] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T19:20:02.657696] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-31T19:20:03.037059] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-31T19:20:03.457661] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-31T19:20:03.788310] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-31T19:20:04.257685] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-31T19:20:05.057717] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-31T19:20:05.160239] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T19:20:05.857706] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-31T19:20:06.256701] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T19:20:06.271910] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-31T19:20:06.657665] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-31T19:20:07.057832] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-31T19:20:07.457670] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-31T19:20:07.757732] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-31T19:20:08.257668] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-31T19:20:08.645710] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-31T19:20:09.057628] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-31T19:20:09.857666] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-31T19:20:10.043494] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-31T19:20:10.142982] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-31T19:20:10.657676] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-31T19:20:10.928729] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-31T19:20:11.457668] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-31T19:20:12.257728] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-31T19:20:12.690216] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T19:20:13.057674] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-31T19:20:13.421545] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-31T19:20:13.857708] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-31T19:20:14.046850] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-31T19:20:14.048826] [INFO ] [REMOTE ] IGI: Full fetch complete (5599 records). [2025-10-31T19:20:14.048896] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-31T19:20:14.271278] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T19:20:14.418009] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-31T19:20:14.418086] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-31T19:20:14.418236] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-31T19:20:14.418274] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-31T19:20:14.418628] [DEBUG] [LOCAL ] IGI: Trimmed 5599 records to 4131 (keeping 200 days of data) [2025-10-31T19:20:14.443916] [DEBUG] [LOCAL ] IGI: Primary data saved (4131 records). [2025-10-31T19:20:14.444009] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-31T19:20:14.444081] [INFO ] [MAIN ] Update Progress: 1095/2365 symbols completed. IGI took 26.8s. Estimated remaining: 2h 42m 34s. Rate: 7.8 symbols/min [2025-10-31T19:20:14.609079] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:20:14.617909] [DEBUG] [LOCAL ] IHD: Loaded 7374 existing records from primary storage. [2025-10-31T19:20:14.618165] [INFO ] [MAIN ] IHD: Loaded 7374 existing records. [2025-10-31T19:20:14.662768] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-31T19:20:14.795310] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:20:14.795544] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-31T19:20:14.795604] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-31T19:20:14.795923] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-31T19:20:14.795980] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-31T19:20:15.149613] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:20:15.457638] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-31T19:20:15.615857] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-31T19:20:16.108017] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T19:20:16.257670] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-31T19:20:16.845963] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T19:20:16.847135] [INFO ] [REMOTE ] IH: Full fetch complete (5074 records). [2025-10-31T19:20:16.847206] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-31T19:20:17.062822] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-31T19:20:17.227982] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-31T19:20:17.228056] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-31T19:20:17.228219] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-31T19:20:17.228265] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-31T19:20:17.228634] [DEBUG] [LOCAL ] IH: Trimmed 5074 records to 2682 (keeping 200 days of data) [2025-10-31T19:20:17.243506] [DEBUG] [LOCAL ] IH: Primary data saved (2682 records). [2025-10-31T19:20:17.243602] [INFO ] [MAIN ] IH: Full history saved. [2025-10-31T19:20:17.243703] [INFO ] [MAIN ] Update Progress: 1096/2365 symbols completed. IH took 19.5s. Estimated remaining: 2h 42m 21s. Rate: 7.8 symbols/min [2025-10-31T19:20:17.413859] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:20:17.437730] [DEBUG] [LOCAL ] IHG: Loaded 23551 existing records from primary storage. [2025-10-31T19:20:17.438020] [INFO ] [MAIN ] IHG: Loaded 23551 existing records. [2025-10-31T19:20:17.612437] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:20:17.612622] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-31T19:20:17.612708] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-31T19:20:17.612934] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-31T19:20:17.612972] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-31T19:20:17.862816] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-31T19:20:17.965410] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:20:18.112218] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-31T19:20:18.118160] [INFO ] [REMOTE ] IGD: Full fetch complete (29701 records). [2025-10-31T19:20:18.118279] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-31T19:20:18.458668] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-31T19:20:18.528478] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-31T19:20:18.528569] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-31T19:20:18.529302] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-31T19:20:18.529364] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-31T19:20:18.530065] [DEBUG] [LOCAL ] IGD: Trimmed 29701 records to 19582 (keeping 200 days of data) [2025-10-31T19:20:18.642048] [DEBUG] [LOCAL ] IGD: Primary data saved (19582 records). [2025-10-31T19:20:18.642191] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-31T19:20:18.642269] [INFO ] [MAIN ] Update Progress: 1097/2365 symbols completed. IGD took 34.4s. Estimated remaining: 2h 42m 6s. Rate: 7.8 symbols/min [2025-10-31T19:20:18.663531] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-31T19:20:18.824538] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:20:18.858098] [DEBUG] [LOCAL ] IHS: Loaded 37018 existing records from primary storage. [2025-10-31T19:20:18.858392] [INFO ] [MAIN ] IHS: Loaded 37018 existing records. [2025-10-31T19:20:19.030412] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:20:19.030619] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-31T19:20:19.030698] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-31T19:20:19.030915] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-31T19:20:19.030972] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-31T19:20:19.422340] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:20:19.457626] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-31T19:20:19.535032] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T19:20:20.257344] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-31T19:20:20.263407] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-31T19:20:20.804340] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T19:20:21.057628] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-31T19:20:21.703707] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-31T19:20:21.857681] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-31T19:20:22.604763] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T19:20:22.657678] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-31T19:20:23.457678] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-31T19:20:23.691405] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T19:20:24.257625] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-31T19:20:24.470857] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T19:20:25.057671] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-31T19:20:25.226451] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T19:20:25.857624] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-31T19:20:25.964943] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T19:20:26.222310] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-31T19:20:26.657691] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-31T19:20:27.155336] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T19:20:27.457634] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-31T19:20:28.005734] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-31T19:20:28.257697] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-31T19:20:29.057624] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-31T19:20:29.151241] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T19:20:29.857714] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-31T19:20:30.146596] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T19:20:30.657667] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-31T19:20:30.682281] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-31T19:20:31.457705] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-31T19:20:31.693469] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-31T19:20:31.700452] [INFO ] [REMOTE ] IGR: Full fetch complete (44347 records). [2025-10-31T19:20:31.700594] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-31T19:20:32.072285] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-31T19:20:32.072359] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-31T19:20:32.073165] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-31T19:20:32.073227] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-31T19:20:32.074234] [DEBUG] [LOCAL ] IGR: Trimmed 44347 records to 30347 (keeping 200 days of data) [2025-10-31T19:20:32.244620] [DEBUG] [LOCAL ] IGR: Primary data saved (30347 records). [2025-10-31T19:20:32.244769] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-31T19:20:32.244849] [INFO ] [MAIN ] Update Progress: 1098/2365 symbols completed. IGR took 36.5s. Estimated remaining: 2h 42m 5s. Rate: 7.8 symbols/min [2025-10-31T19:20:32.266195] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-31T19:20:32.426951] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:20:32.452585] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-31T19:20:32.464330] [DEBUG] [LOCAL ] IIF: Loaded 4940 existing records from primary storage. [2025-10-31T19:20:32.465038] [INFO ] [MAIN ] IIF: Loaded 4940 existing records. [2025-10-31T19:20:32.639167] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:20:32.639378] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-31T19:20:32.639426] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-31T19:20:32.639610] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-31T19:20:32.639686] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-31T19:20:32.819074] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-31T19:20:33.004106] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:20:33.057672] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-31T19:20:33.620494] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-31T19:20:33.857688] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-31T19:20:34.657708] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-31T19:20:34.861910] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T19:20:35.457733] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-31T19:20:35.606719] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T19:20:36.257674] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-31T19:20:36.406369] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-31T19:20:37.057708] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-31T19:20:37.114106] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-31T19:20:37.857714] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-31T19:20:38.113637] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T19:20:38.285417] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T19:20:38.657662] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-31T19:20:39.026464] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T19:20:39.457662] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-31T19:20:39.853931] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-31T19:20:40.257680] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-31T19:20:40.721910] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-31T19:20:41.057667] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-31T19:20:41.824266] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-31T19:20:41.857613] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-31T19:20:42.657639] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-31T19:20:42.727385] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-31T19:20:43.457626] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-31T19:20:43.617190] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T19:20:44.262766] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-31T19:20:44.274944] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-31T19:20:45.057705] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-31T19:20:45.369945] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T19:20:45.379878] [INFO ] [REMOTE ] IHS: Full fetch complete (51637 records). [2025-10-31T19:20:45.380055] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-31T19:20:45.727468] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T19:20:45.741601] [INFO ] [REMOTE ] IHD: Full fetch complete (11589 records). [2025-10-31T19:20:45.744774] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-31T19:20:45.865282] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-31T19:20:45.879006] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-31T19:20:45.883315] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-31T19:20:45.884969] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-31T19:20:45.895716] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-31T19:20:45.963837] [DEBUG] [LOCAL ] IHS: Trimmed 51637 records to 37281 (keeping 200 days of data) [2025-10-31T19:20:46.256788] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-31T19:20:46.270344] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-31T19:20:46.270811] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-31T19:20:46.270871] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-31T19:20:46.322756] [DEBUG] [LOCAL ] IHD: Trimmed 11589 records to 7428 (keeping 200 days of data) [2025-10-31T19:20:46.323613] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-31T19:20:46.423894] [DEBUG] [LOCAL ] IHD: Primary data saved (7428 records). [2025-10-31T19:20:46.426334] [DEBUG] [LOCAL ] IHS: Primary data saved (37281 records). [2025-10-31T19:20:46.426706] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-31T19:20:46.426858] [INFO ] [MAIN ] Update Progress: 1099/2365 symbols completed. IHD took 32.0s. Estimated remaining: 2h 42m 5s. Rate: 7.8 symbols/min [2025-10-31T19:20:46.426581] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-31T19:20:46.438501] [INFO ] [MAIN ] Update Progress: 1100/2365 symbols completed. IHS took 27.8s. Estimated remaining: 2h 41m 48s. Rate: 7.8 symbols/min [2025-10-31T19:20:46.679033] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-31T19:20:46.767165] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:20:46.786945] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:20:46.812947] [DEBUG] [LOCAL ] IIIN: Loaded 16032 existing records from primary storage. [2025-10-31T19:20:46.813304] [DEBUG] [LOCAL ] IIM: Loaded 15379 existing records from primary storage. [2025-10-31T19:20:46.813532] [INFO ] [MAIN ] IIIN: Loaded 16032 existing records. [2025-10-31T19:20:46.878099] [INFO ] [MAIN ] IIM: Loaded 15379 existing records. [2025-10-31T19:20:47.158239] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:20:47.178120] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:20:47.178423] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-31T19:20:47.178316] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-31T19:20:47.178525] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-31T19:20:47.178610] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-31T19:20:47.178848] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-31T19:20:47.178899] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-31T19:20:47.178936] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-31T19:20:47.210541] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-31T19:20:47.471062] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-31T19:20:47.450046] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T19:20:47.940620] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:20:47.960745] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:20:48.257639] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-31T19:20:48.469249] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-31T19:20:48.685822] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T19:20:49.057674] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-31T19:20:49.728932] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-31T19:20:49.857637] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-31T19:20:50.525462] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-31T19:20:50.657696] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-31T19:20:51.443527] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-31T19:20:51.457603] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-31T19:20:52.168297] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T19:20:52.257631] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-31T19:20:52.815471] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-31T19:20:53.057630] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-31T19:20:53.714740] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-31T19:20:53.857667] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-31T19:20:54.657683] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-31T19:20:54.810628] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-31T19:20:54.816885] [INFO ] [REMOTE ] IHG: Full fetch complete (34858 records). [2025-10-31T19:20:54.817010] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-31T19:20:55.201800] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-31T19:20:55.201907] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-31T19:20:55.202739] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-31T19:20:55.202814] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-31T19:20:55.203700] [DEBUG] [LOCAL ] IHG: Trimmed 34858 records to 23759 (keeping 200 days of data) [2025-10-31T19:20:55.354685] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-31T19:20:55.369955] [DEBUG] [LOCAL ] IHG: Primary data saved (23759 records). [2025-10-31T19:20:55.370090] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-31T19:20:55.370174] [INFO ] [MAIN ] Update Progress: 1101/2365 symbols completed. IHG took 38.1s. Estimated remaining: 2h 41m 42s. Rate: 7.8 symbols/min [2025-10-31T19:20:55.462890] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-31T19:20:55.545436] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:20:55.573166] [DEBUG] [LOCAL ] IIPR: Loaded 28586 existing records from primary storage. [2025-10-31T19:20:55.573422] [INFO ] [MAIN ] IIPR: Loaded 28586 existing records. [2025-10-31T19:20:55.750714] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:20:55.750932] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-31T19:20:55.750980] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-31T19:20:55.751246] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-31T19:20:55.751302] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-31T19:20:56.108547] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:20:56.214346] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T19:20:56.257606] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-31T19:20:56.871600] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-31T19:20:57.057675] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-31T19:20:57.754866] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T19:20:57.857630] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-31T19:20:58.657668] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-31T19:20:58.969719] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T19:20:59.371718] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T19:20:59.457619] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-31T19:20:59.845964] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-31T19:21:00.257677] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-31T19:21:01.065452] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-31T19:21:01.069891] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-31T19:21:01.469136] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-31T19:21:01.857665] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-31T19:21:02.211132] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-31T19:21:02.657678] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-31T19:21:03.457636] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-31T19:21:03.497317] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-31T19:21:04.257686] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-31T19:21:04.391049] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-31T19:21:04.395047] [INFO ] [REMOTE ] IIM: Full fetch complete (24604 records). [2025-10-31T19:21:04.395125] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-31T19:21:04.762830] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-31T19:21:04.762911] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-31T19:21:04.763454] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-31T19:21:04.763494] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-31T19:21:04.764143] [DEBUG] [LOCAL ] IIM: Trimmed 24604 records to 15515 (keeping 200 days of data) [2025-10-31T19:21:04.860690] [DEBUG] [LOCAL ] IIM: Primary data saved (15515 records). [2025-10-31T19:21:04.860820] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-31T19:21:04.860895] [INFO ] [MAIN ] Update Progress: 1102/2365 symbols completed. IIM took 18.4s. Estimated remaining: 2h 41m 37s. Rate: 7.8 symbols/min [2025-10-31T19:21:05.035278] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:21:05.057682] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-31T19:21:05.076031] [DEBUG] [LOCAL ] IMAX: Loaded 43693 existing records from primary storage. [2025-10-31T19:21:05.076315] [INFO ] [MAIN ] IMAX: Loaded 43693 existing records. [2025-10-31T19:21:05.256069] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:21:05.256383] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-31T19:21:05.256582] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-31T19:21:05.256956] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-31T19:21:05.257042] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-31T19:21:05.425434] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T19:21:05.641704] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:21:05.750105] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-31T19:21:05.857637] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-31T19:21:06.657707] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-31T19:21:06.948668] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T19:21:07.457636] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-31T19:21:08.065963] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T19:21:08.262812] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-31T19:21:08.268932] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-31T19:21:09.057621] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-31T19:21:09.261131] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T19:21:09.857675] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-31T19:21:09.959951] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-31T19:21:10.495724] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-31T19:21:10.657671] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-31T19:21:10.959013] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-31T19:21:11.457692] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-31T19:21:11.984038] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T19:21:11.985289] [INFO ] [REMOTE ] IIF: Full fetch complete (8304 records). [2025-10-31T19:21:11.985357] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-31T19:21:12.262814] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-31T19:21:12.346431] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-31T19:21:12.346507] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-31T19:21:12.346735] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-31T19:21:12.346795] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-31T19:21:12.347186] [DEBUG] [LOCAL ] IIF: Trimmed 8304 records to 4977 (keeping 200 days of data) [2025-10-31T19:21:12.375834] [DEBUG] [LOCAL ] IIF: Primary data saved (4977 records). [2025-10-31T19:21:12.375959] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-31T19:21:12.376035] [INFO ] [MAIN ] Update Progress: 1103/2365 symbols completed. IIF took 40.1s. Estimated remaining: 2h 41m 29s. Rate: 7.8 symbols/min [2025-10-31T19:21:12.547469] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:21:12.589319] [DEBUG] [LOCAL ] INFA: Loaded 48452 existing records from primary storage. [2025-10-31T19:21:12.589625] [INFO ] [MAIN ] INFA: Loaded 48452 existing records. [2025-10-31T19:21:12.764666] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:21:12.764891] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-31T19:21:12.764939] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-31T19:21:12.765114] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-31T19:21:12.765153] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-31T19:21:13.062872] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-31T19:21:13.130430] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:21:13.363870] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T19:21:13.835357] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T19:21:13.857621] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-31T19:21:14.453199] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-31T19:21:14.657678] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-31T19:21:15.457624] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-31T19:21:16.170799] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T19:21:16.257694] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-31T19:21:16.592237] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-31T19:21:17.057635] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-31T19:21:17.254247] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T19:21:17.857700] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-31T19:21:18.132606] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-31T19:21:18.657620] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-31T19:21:18.828530] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-31T19:21:19.457692] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-31T19:21:19.733178] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T19:21:20.257739] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-31T19:21:20.455329] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T19:21:21.057740] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-31T19:21:21.457510] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T19:21:21.615511] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-31T19:21:21.857738] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-31T19:21:22.657829] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-31T19:21:22.661083] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T19:21:22.665517] [INFO ] [REMOTE ] IIIN: Full fetch complete (24941 records). [2025-10-31T19:21:22.665587] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-31T19:21:23.036970] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-31T19:21:23.037070] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-31T19:21:23.037683] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-31T19:21:23.037744] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-31T19:21:23.038376] [DEBUG] [LOCAL ] IIIN: Trimmed 24941 records to 16131 (keeping 200 days of data) [2025-10-31T19:21:23.133384] [DEBUG] [LOCAL ] IIIN: Primary data saved (16131 records). [2025-10-31T19:21:23.133498] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-31T19:21:23.133574] [INFO ] [MAIN ] Update Progress: 1104/2365 symbols completed. IIIN took 36.7s. Estimated remaining: 2h 41m 25s. Rate: 7.8 symbols/min [2025-10-31T19:21:23.306287] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:21:23.358429] [DEBUG] [LOCAL ] INFY: Loaded 53984 existing records from primary storage. [2025-10-31T19:21:23.358770] [INFO ] [MAIN ] INFY: Loaded 53984 existing records. [2025-10-31T19:21:23.461040] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-31T19:21:23.542390] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:21:23.542577] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-31T19:21:23.542623] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-31T19:21:23.543063] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-31T19:21:23.543118] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-31T19:21:23.929949] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-31T19:21:23.934311] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:21:24.257681] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-31T19:21:24.666446] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T19:21:25.057624] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-31T19:21:25.193294] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T19:21:25.857692] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-31T19:21:26.119007] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T19:21:26.657677] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-31T19:21:27.105380] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T19:21:27.457680] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-31T19:21:27.813516] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T19:21:28.257674] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-31T19:21:28.565535] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T19:21:29.057690] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-31T19:21:29.643761] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T19:21:29.652191] [INFO ] [REMOTE ] IIPR: Full fetch complete (43313 records). [2025-10-31T19:21:29.652362] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-31T19:21:29.863216] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-31T19:21:30.242083] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-31T19:21:30.242330] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-31T19:21:30.243504] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-31T19:21:30.243591] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-31T19:21:30.245365] [DEBUG] [LOCAL ] IIPR: Trimmed 43313 records to 28775 (keeping 200 days of data) [2025-10-31T19:21:30.406904] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-31T19:21:30.477491] [DEBUG] [LOCAL ] IIPR: Primary data saved (28775 records). [2025-10-31T19:21:30.477630] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-31T19:21:30.477745] [INFO ] [MAIN ] Update Progress: 1105/2365 symbols completed. IIPR took 35.1s. Estimated remaining: 2h 41m 17s. Rate: 7.8 symbols/min [2025-10-31T19:21:30.643592] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:21:30.669349] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-31T19:21:30.690189] [DEBUG] [LOCAL ] ING: Loaded 50976 existing records from primary storage. [2025-10-31T19:21:30.690487] [INFO ] [MAIN ] ING: Loaded 50976 existing records. [2025-10-31T19:21:30.865708] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:21:30.865965] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-31T19:21:30.866012] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-31T19:21:30.866250] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-31T19:21:30.866289] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-31T19:21:31.231224] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:21:31.247461] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-31T19:21:31.457706] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-31T19:21:31.870504] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T19:21:32.257703] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-31T19:21:32.722090] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T19:21:32.732863] [INFO ] [REMOTE ] IMAX: Full fetch complete (61595 records). [2025-10-31T19:21:32.733023] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-31T19:21:33.060616] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-31T19:21:33.169313] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-31T19:21:33.169393] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-31T19:21:33.170289] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-31T19:21:33.170393] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-31T19:21:33.171699] [DEBUG] [LOCAL ] IMAX: Trimmed 61595 records to 44012 (keeping 200 days of data) [2025-10-31T19:21:33.420834] [DEBUG] [LOCAL ] IMAX: Primary data saved (44012 records). [2025-10-31T19:21:33.420961] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-31T19:21:33.421038] [INFO ] [MAIN ] Update Progress: 1106/2365 symbols completed. IMAX took 28.6s. Estimated remaining: 2h 41m 3s. Rate: 7.8 symbols/min [2025-10-31T19:21:33.592881] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:21:33.624355] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T19:21:33.656881] [DEBUG] [LOCAL ] INGM: Loaded 27839 existing records from primary storage. [2025-10-31T19:21:33.657150] [INFO ] [MAIN ] INGM: Loaded 27839 existing records. [2025-10-31T19:21:33.848733] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:21:33.848965] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-31T19:21:33.849011] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-31T19:21:33.849179] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-31T19:21:33.849216] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-31T19:21:33.862804] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-31T19:21:34.235582] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:21:34.265755] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T19:21:34.657719] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-31T19:21:35.246725] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T19:21:35.457713] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-31T19:21:35.807517] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T19:21:36.135116] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T19:21:36.257632] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-31T19:21:37.023755] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-31T19:21:37.057609] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-31T19:21:37.857715] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-31T19:21:38.092475] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T19:21:38.657667] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-31T19:21:39.171887] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:21:39.457683] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-31T19:21:39.846392] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T19:21:40.257710] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-31T19:21:40.350021] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-31T19:21:41.057703] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-31T19:21:41.594890] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T19:21:41.857699] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-31T19:21:42.449358] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T19:21:42.657625] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-31T19:21:43.050339] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T19:21:43.457629] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-31T19:21:44.156811] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T19:21:44.257626] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-31T19:21:44.559732] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T19:21:45.057670] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-31T19:21:45.502292] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T19:21:45.857668] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-31T19:21:45.915310] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-31T19:21:46.657730] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-31T19:21:47.213104] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T19:21:47.457725] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-31T19:21:47.932927] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T19:21:47.943536] [INFO ] [REMOTE ] INFA: Full fetch complete (70475 records). [2025-10-31T19:21:47.943777] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-31T19:21:48.262907] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-31T19:21:48.353107] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-31T19:21:48.353198] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-31T19:21:48.354303] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-31T19:21:48.354373] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-31T19:21:48.355817] [DEBUG] [LOCAL ] INFA: Trimmed 70475 records to 48781 (keeping 200 days of data) [2025-10-31T19:21:48.648671] [DEBUG] [LOCAL ] INFA: Primary data saved (48781 records). [2025-10-31T19:21:48.648828] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-31T19:21:48.648928] [INFO ] [MAIN ] Update Progress: 1107/2365 symbols completed. INFA took 36.3s. Estimated remaining: 2h 41m 4s. Rate: 7.8 symbols/min [2025-10-31T19:21:48.818906] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:21:48.850282] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T19:21:48.888429] [DEBUG] [LOCAL ] INGR: Loaded 33885 existing records from primary storage. [2025-10-31T19:21:48.888730] [INFO ] [MAIN ] INGR: Loaded 33885 existing records. [2025-10-31T19:21:49.067180] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:21:49.062549] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-31T19:21:49.068595] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-31T19:21:49.068817] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-31T19:21:49.069208] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-31T19:21:49.069275] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-31T19:21:49.374626] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T19:21:49.458580] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:21:49.857694] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-31T19:21:50.371226] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T19:21:50.657637] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-31T19:21:50.843745] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T19:21:51.457687] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-31T19:21:52.028980] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T19:21:52.257705] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-31T19:21:53.038602] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-31T19:21:53.057613] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-31T19:21:53.323838] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-31T19:21:53.857679] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-31T19:21:54.657627] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-31T19:21:54.678562] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-31T19:21:54.720426] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-31T19:21:54.732960] [INFO ] [REMOTE ] INFY: Full fetch complete (77751 records). [2025-10-31T19:21:54.733095] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-31T19:21:55.131345] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-31T19:21:55.131434] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-31T19:21:55.132582] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-31T19:21:55.132677] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-31T19:21:55.134174] [DEBUG] [LOCAL ] INFY: Trimmed 77751 records to 54374 (keeping 200 days of data) [2025-10-31T19:21:55.460135] [DEBUG] [LOCAL ] INFY: Primary data saved (54374 records). [2025-10-31T19:21:55.460256] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-31T19:21:55.460516] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-31T19:21:55.462182] [INFO ] [MAIN ] Update Progress: 1108/2365 symbols completed. INFY took 32.3s. Estimated remaining: 2h 40m 56s. Rate: 7.8 symbols/min [2025-10-31T19:21:55.638767] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:21:55.685175] [DEBUG] [LOCAL ] INN: Loaded 41182 existing records from primary storage. [2025-10-31T19:21:55.685598] [INFO ] [MAIN ] INN: Loaded 41182 existing records. [2025-10-31T19:21:55.846757] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T19:21:55.893251] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:21:55.893432] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-31T19:21:55.893481] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-31T19:21:55.893695] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-31T19:21:55.893753] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-31T19:21:56.262254] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-31T19:21:56.262177] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:21:56.344503] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-31T19:21:57.057668] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-31T19:21:57.778101] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T19:21:57.857623] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-31T19:21:58.092140] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-31T19:21:58.657690] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-31T19:21:59.069013] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T19:21:59.457684] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-31T19:21:59.518165] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T19:22:00.257692] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-31T19:22:00.408697] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-31T19:22:01.057634] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-31T19:22:01.102720] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-31T19:22:01.857733] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-31T19:22:02.657672] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-31T19:22:02.702693] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T19:22:02.714425] [INFO ] [REMOTE ] ING: Full fetch complete (73801 records). [2025-10-31T19:22:02.714559] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-31T19:22:03.130340] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-31T19:22:03.130630] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-31T19:22:03.131722] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-31T19:22:03.132236] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-31T19:22:03.133464] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T19:22:03.142263] [DEBUG] [LOCAL ] ING: Trimmed 73801 records to 51363 (keeping 200 days of data) [2025-10-31T19:22:03.458419] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-31T19:22:03.460322] [DEBUG] [LOCAL ] ING: Primary data saved (51363 records). [2025-10-31T19:22:03.461471] [INFO ] [MAIN ] ING: Full history saved. [2025-10-31T19:22:03.461579] [INFO ] [MAIN ] Update Progress: 1109/2365 symbols completed. ING took 33.0s. Estimated remaining: 2h 40m 48s. Rate: 7.8 symbols/min [2025-10-31T19:22:03.643124] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:22:03.643334] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-31T19:22:03.643527] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-31T19:22:03.643764] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-31T19:22:03.643842] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-31T19:22:03.644129] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-31T19:22:03.644342] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-31T19:22:03.788973] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-31T19:22:03.828340] [INFO ] [REMOTE ] INGM: Full fetch complete (41901 records). [2025-10-31T19:22:03.848087] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-31T19:22:04.311734] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-31T19:22:04.331226] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:22:04.491403] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-31T19:22:04.491562] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-31T19:22:04.492332] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-31T19:22:04.492480] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-31T19:22:04.493340] [DEBUG] [LOCAL ] INGM: Trimmed 41901 records to 28133 (keeping 200 days of data) [2025-10-31T19:22:04.668057] [DEBUG] [LOCAL ] INGM: Primary data saved (28133 records). [2025-10-31T19:22:04.680816] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-31T19:22:04.682008] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T19:22:04.681296] [INFO ] [MAIN ] Update Progress: 1110/2365 symbols completed. INGM took 31.3s. Estimated remaining: 2h 40m 33s. Rate: 7.8 symbols/min [2025-10-31T19:22:04.856617] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:22:04.892473] [DEBUG] [LOCAL ] INSP: Loaded 39065 existing records from primary storage. [2025-10-31T19:22:04.892793] [INFO ] [MAIN ] INSP: Loaded 39065 existing records. [2025-10-31T19:22:05.064209] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-31T19:22:05.069003] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:22:05.069229] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-31T19:22:05.069302] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-31T19:22:05.070301] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-31T19:22:05.070381] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-31T19:22:05.504104] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:22:05.504320] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-31T19:22:05.520801] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T19:22:05.857685] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-31T19:22:06.657695] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-31T19:22:06.776316] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-31T19:22:07.457713] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-31T19:22:07.667221] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T19:22:08.257724] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-31T19:22:08.516816] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T19:22:09.057735] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-31T19:22:09.273769] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T19:22:09.857724] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-31T19:22:10.024081] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T19:22:10.657723] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-31T19:22:10.784304] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T19:22:11.457707] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-31T19:22:11.491079] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-31T19:22:12.257684] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-31T19:22:12.743890] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T19:22:12.951392] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-31T19:22:13.057680] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-31T19:22:13.803690] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-31T19:22:13.857625] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-31T19:22:14.575501] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T19:22:14.657682] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-31T19:22:15.457668] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-31T19:22:15.699251] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-31T19:22:16.257663] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-31T19:22:16.600302] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T19:22:17.057705] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-31T19:22:17.175778] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T19:22:17.857689] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-31T19:22:17.987668] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-31T19:22:18.657705] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-31T19:22:18.997746] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T19:22:19.006338] [INFO ] [REMOTE ] INGR: Full fetch complete (50721 records). [2025-10-31T19:22:19.006453] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-31T19:22:19.382705] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-31T19:22:19.382809] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-31T19:22:19.383598] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-31T19:22:19.383669] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-31T19:22:19.384737] [DEBUG] [LOCAL ] INGR: Trimmed 50721 records to 34154 (keeping 200 days of data) [2025-10-31T19:22:19.474002] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-31T19:22:19.628045] [DEBUG] [LOCAL ] INGR: Primary data saved (34154 records). [2025-10-31T19:22:19.628779] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-31T19:22:19.629723] [INFO ] [MAIN ] Update Progress: 1111/2365 symbols completed. INGR took 31.0s. Estimated remaining: 2h 40m 34s. Rate: 7.8 symbols/min [2025-10-31T19:22:19.629598] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T19:22:19.807707] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:22:19.843505] [DEBUG] [LOCAL ] INSW: Loaded 38900 existing records from primary storage. [2025-10-31T19:22:19.843816] [INFO ] [MAIN ] INSW: Loaded 38900 existing records. [2025-10-31T19:22:20.016611] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:22:20.016842] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-31T19:22:20.016889] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-31T19:22:20.017265] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-31T19:22:20.017324] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-31T19:22:20.263548] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-31T19:22:20.375409] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:22:20.479917] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T19:22:21.057673] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-31T19:22:21.257386] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-31T19:22:21.857625] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-31T19:22:21.978021] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T19:22:22.657670] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-31T19:22:22.966485] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-31T19:22:23.457630] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-31T19:22:23.739942] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T19:22:23.748379] [INFO ] [REMOTE ] INN: Full fetch complete (57740 records). [2025-10-31T19:22:23.748487] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-31T19:22:24.126570] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-31T19:22:24.126787] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-31T19:22:24.127607] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-31T19:22:24.127683] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-31T19:22:24.128872] [DEBUG] [LOCAL ] INN: Trimmed 57740 records to 41450 (keeping 200 days of data) [2025-10-31T19:22:24.298759] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-31T19:22:24.354850] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-31T19:22:24.393213] [DEBUG] [LOCAL ] INN: Primary data saved (41450 records). [2025-10-31T19:22:24.393326] [INFO ] [MAIN ] INN: Full history saved. [2025-10-31T19:22:24.394017] [INFO ] [MAIN ] Update Progress: 1112/2365 symbols completed. INN took 28.9s. Estimated remaining: 2h 40m 23s. Rate: 7.8 symbols/min [2025-10-31T19:22:24.558025] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:22:24.608256] [DEBUG] [LOCAL ] INVH: Loaded 53570 existing records from primary storage. [2025-10-31T19:22:24.608575] [INFO ] [MAIN ] INVH: Loaded 53570 existing records. [2025-10-31T19:22:24.783389] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:22:24.783592] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-31T19:22:24.783637] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-31T19:22:24.784009] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-31T19:22:24.784063] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-31T19:22:25.062918] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-31T19:22:25.134292] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:22:25.496494] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T19:22:25.857676] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-31T19:22:25.978686] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-31T19:22:26.657680] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-31T19:22:27.092543] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T19:22:27.457633] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-31T19:22:27.601917] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T19:22:28.257726] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-31T19:22:28.674215] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-31T19:22:29.050768] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-31T19:22:29.057627] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-31T19:22:29.857748] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-31T19:22:30.109155] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T19:22:30.657625] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-31T19:22:30.840736] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-31T19:22:31.457716] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-31T19:22:31.683201] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T19:22:32.257713] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-31T19:22:32.869460] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T19:22:33.057893] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-31T19:22:33.474691] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T19:22:33.857686] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-31T19:22:34.160052] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-31T19:22:34.657723] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-31T19:22:34.971338] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:22:35.457678] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-31T19:22:35.685452] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T19:22:36.257730] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-31T19:22:36.522394] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-31T19:22:36.531995] [INFO ] [REMOTE ] INR: Full fetch complete (38687 records). [2025-10-31T19:22:36.532135] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-31T19:22:36.739687] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-31T19:22:36.740175] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:22:36.740265] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:22:36.740363] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-31T19:22:36.740449] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-31T19:22:36.740489] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-31T19:22:36.740530] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-31T19:22:36.740591] [INFO ] [MAIN ] Update Progress: 1113/2365 symbols completed. INR took 33.3s. Estimated remaining: 2h 40m 20s. Rate: 7.8 symbols/min [2025-10-31T19:22:36.913078] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:22:36.941771] [DEBUG] [LOCAL ] INVX: Loaded 28601 existing records from primary storage. [2025-10-31T19:22:36.942082] [INFO ] [MAIN ] INVX: Loaded 28601 existing records. [2025-10-31T19:22:37.059440] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-31T19:22:37.140196] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:22:37.140404] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-31T19:22:37.140450] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-31T19:22:37.140678] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-31T19:22:37.140735] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-31T19:22:37.529542] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:22:37.530958] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T19:22:37.857673] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-31T19:22:38.257097] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T19:22:38.657725] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-31T19:22:39.055406] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-31T19:22:39.063678] [INFO ] [REMOTE ] INSW: Full fetch complete (58754 records). [2025-10-31T19:22:39.063830] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-31T19:22:39.449532] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-31T19:22:39.449620] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-31T19:22:39.450624] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-31T19:22:39.450714] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-31T19:22:39.452041] [DEBUG] [LOCAL ] INSW: Trimmed 58754 records to 39166 (keeping 200 days of data) [2025-10-31T19:22:39.504866] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-31T19:22:39.696194] [DEBUG] [LOCAL ] INSW: Primary data saved (39166 records). [2025-10-31T19:22:39.696494] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-31T19:22:39.696606] [INFO ] [MAIN ] Update Progress: 1114/2365 symbols completed. INSW took 20.1s. Estimated remaining: 2h 40m 8s. Rate: 7.8 symbols/min [2025-10-31T19:22:39.818091] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T19:22:39.896052] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:22:39.946448] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-31T19:22:39.946812] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-10-31T19:22:40.128889] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:22:40.129090] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-31T19:22:40.129136] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-31T19:22:40.129522] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-31T19:22:40.129579] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-31T19:22:40.269236] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-31T19:22:40.490098] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:22:40.803500] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T19:22:40.813671] [INFO ] [REMOTE ] INSP: Full fetch complete (54013 records). [2025-10-31T19:22:40.813776] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-31T19:22:41.065315] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-31T19:22:41.193329] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-31T19:22:41.193404] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-31T19:22:41.194198] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-31T19:22:41.194259] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-31T19:22:41.195377] [DEBUG] [LOCAL ] INSP: Trimmed 54013 records to 39422 (keeping 200 days of data) [2025-10-31T19:22:41.425326] [DEBUG] [LOCAL ] INSP: Primary data saved (39422 records). [2025-10-31T19:22:41.425440] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-31T19:22:41.425514] [INFO ] [MAIN ] Update Progress: 1115/2365 symbols completed. INSP took 36.7s. Estimated remaining: 2h 39m 53s. Rate: 7.8 symbols/min [2025-10-31T19:22:41.601750] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:22:41.635445] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-31T19:22:41.689027] [DEBUG] [LOCAL ] IOT: Loaded 53822 existing records from primary storage. [2025-10-31T19:22:41.689328] [INFO ] [MAIN ] IOT: Loaded 53822 existing records. [2025-10-31T19:22:41.864001] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-31T19:22:41.869449] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:22:41.870268] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-31T19:22:41.870340] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-31T19:22:41.870530] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-31T19:22:41.870571] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-31T19:22:42.225345] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:22:42.657725] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-31T19:22:42.870096] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T19:22:42.976631] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-31T19:22:43.457719] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-31T19:22:43.859963] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T19:22:44.257638] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-31T19:22:45.057616] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-31T19:22:45.280698] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-31T19:22:45.472140] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T19:22:45.843579] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-31T19:22:45.857614] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-31T19:22:46.657711] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-31T19:22:47.219052] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T19:22:47.457619] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-31T19:22:47.647883] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-31T19:22:48.257686] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-31T19:22:49.065828] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-31T19:22:49.071757] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-31T19:22:49.434201] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T19:22:49.857637] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-31T19:22:50.023438] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-31T19:22:50.657708] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-31T19:22:51.450550] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-31T19:22:51.461546] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-31T19:22:52.257692] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-31T19:22:52.421262] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T19:22:52.711802] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-31T19:22:53.057675] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-31T19:22:53.403880] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-31T19:22:53.857622] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-31T19:22:53.936078] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T19:22:54.657699] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-31T19:22:55.260017] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-31T19:22:55.457710] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-31T19:22:55.947136] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T19:22:56.257692] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-31T19:22:56.594695] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-31T19:22:57.057695] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-31T19:22:57.584485] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T19:22:57.857716] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-31T19:22:58.421260] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T19:22:58.657689] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-31T19:22:59.322138] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-31T19:22:59.335259] [INFO ] [REMOTE ] INVH: Full fetch complete (77005 records). [2025-10-31T19:22:59.335437] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-31T19:22:59.462807] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-31T19:22:59.740233] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-31T19:22:59.740373] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-31T19:22:59.741545] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-31T19:22:59.741610] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-31T19:22:59.743157] [DEBUG] [LOCAL ] INVH: Trimmed 77005 records to 53959 (keeping 200 days of data) [2025-10-31T19:23:00.064909] [DEBUG] [LOCAL ] INVH: Primary data saved (53959 records). [2025-10-31T19:23:00.065042] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-31T19:23:00.065720] [INFO ] [MAIN ] Update Progress: 1116/2365 symbols completed. INVH took 35.7s. Estimated remaining: 2h 39m 58s. Rate: 7.8 symbols/min [2025-10-31T19:23:00.241468] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:23:00.257692] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-31T19:23:00.292714] [DEBUG] [LOCAL ] IP: Loaded 53688 existing records from primary storage. [2025-10-31T19:23:00.293051] [INFO ] [MAIN ] IP: Loaded 53688 existing records. [2025-10-31T19:23:00.465083] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:23:00.465312] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-31T19:23:00.465358] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-31T19:23:00.465562] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-31T19:23:00.465617] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-31T19:23:00.809010] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:23:01.057633] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-31T19:23:05.697511] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (5.44 seconds). [2025-10-31T19:23:05.703799] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-31T19:23:05.768724] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (7.11 seconds). [2025-10-31T19:23:05.779974] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-31T19:23:06.631915] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (7.17 seconds). [2025-10-31T19:23:06.643927] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-31T19:23:06.709334] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (5.65 seconds). [2025-10-31T19:23:06.720301] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-31T19:23:06.803586] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T19:23:06.809814] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-31T19:23:07.932210] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T19:23:07.939060] [INFO ] [REMOTE ] INVX: Full fetch complete (42335 records). [2025-10-31T19:23:07.939195] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-31T19:23:08.264111] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-31T19:23:08.331064] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-31T19:23:08.414234] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-31T19:23:08.414628] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-31T19:23:08.415456] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-31T19:23:08.415535] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-31T19:23:08.447019] [DEBUG] [LOCAL ] INVX: Trimmed 42335 records to 28837 (keeping 200 days of data) [2025-10-31T19:23:08.450005] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-31T19:23:08.462290] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-31T19:23:08.573525] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-31T19:23:08.601167] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-31T19:23:08.668519] [DEBUG] [LOCAL ] INVX: Primary data saved (28837 records). [2025-10-31T19:23:08.668663] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-31T19:23:08.668762] [INFO ] [MAIN ] Update Progress: 1117/2365 symbols completed. INVX took 31.9s. Estimated remaining: 2h 39m 51s. Rate: 7.8 symbols/min [2025-10-31T19:23:10.107437] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-31T19:23:10.118596] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-31T19:23:10.226149] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-31T19:23:10.240046] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-31T19:23:10.274293] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-31T19:23:10.286865] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-31T19:23:11.606338] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T19:23:11.618630] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-31T19:23:12.009485] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-31T19:23:12.022139] [INFO ] [REMOTE ] IOT: Full fetch complete (77512 records). [2025-10-31T19:23:12.022306] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-31T19:23:12.415416] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-31T19:23:12.415537] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-31T19:23:12.416685] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-31T19:23:12.416772] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-31T19:23:12.418393] [DEBUG] [LOCAL ] IOT: Trimmed 77512 records to 54212 (keeping 200 days of data) [2025-10-31T19:23:12.661355] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-31T19:23:12.682507] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-31T19:23:12.783847] [DEBUG] [LOCAL ] IOT: Primary data saved (54212 records). [2025-10-31T19:23:12.783979] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-31T19:23:12.784498] [INFO ] [MAIN ] Update Progress: 1118/2365 symbols completed. IOT took 31.4s. Estimated remaining: 2h 39m 39s. Rate: 7.8 symbols/min [2025-10-31T19:23:12.925502] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:23:12.937028] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-31T19:23:14.235787] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T19:23:14.249628] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-31T19:23:14.732524] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-31T19:23:14.744205] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-31T19:23:15.799624] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T19:23:15.811061] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-31T19:23:16.782420] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-31T19:23:16.793800] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-31T19:23:17.123036] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T19:23:17.134168] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-31T19:23:18.402743] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T19:23:18.413933] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-31T19:23:19.197659] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-31T19:23:19.210147] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-31T19:23:19.210309] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-31T19:23:19.611492] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-31T19:23:19.611582] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-31T19:23:19.612669] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-31T19:23:19.612736] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-31T19:23:19.614282] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-10-31T19:23:19.931709] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-10-31T19:23:19.931834] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-31T19:23:19.931908] [INFO ] [MAIN ] Update Progress: 1119/2365 symbols completed. IONQ took 40.2s. Estimated remaining: 2h 39m 31s. Rate: 7.8 symbols/min [2025-10-31T19:23:20.060735] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T19:23:20.072900] [INFO ] [REMOTE ] IP: Full fetch complete (77435 records). [2025-10-31T19:23:20.073066] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-31T19:23:20.463461] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-31T19:23:20.463547] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-31T19:23:20.464523] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-31T19:23:20.464585] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-31T19:23:20.465972] [DEBUG] [LOCAL ] IP: Trimmed 77435 records to 54078 (keeping 200 days of data) [2025-10-31T19:23:20.787384] [DEBUG] [LOCAL ] IP: Primary data saved (54078 records). [2025-10-31T19:23:20.787510] [INFO ] [MAIN ] IP: Full history saved. [2025-10-31T19:23:20.788091] [INFO ] [MAIN ] Update Progress: 1120/2365 symbols completed. IP took 20.7s. Estimated remaining: 2h 39m 16s. Rate: 7.8 symbols/min [2025-10-31T19:23:21.455314] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:23:21.488699] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:23:21.513010] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:23:21.530333] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:23:21.548444] [DEBUG] [LOCAL ] IQI: Loaded 17528 existing records from primary storage. [2025-10-31T19:23:21.554859] [INFO ] [MAIN ] IQI: Loaded 17528 existing records. [2025-10-31T19:23:21.681988] [DEBUG] [LOCAL ] IPI: Loaded 21353 existing records from primary storage. [2025-10-31T19:23:21.699073] [INFO ] [MAIN ] IPI: Loaded 21353 existing records. [2025-10-31T19:23:21.913692] [DEBUG] [LOCAL ] IPG: Loaded 53716 existing records from primary storage. [2025-10-31T19:23:21.902618] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:23:21.931917] [DEBUG] [LOCAL ] IQV: Loaded 50235 existing records from primary storage. [2025-10-31T19:23:21.932122] [INFO ] [MAIN ] IPG: Loaded 53716 existing records. [2025-10-31T19:23:21.935770] [INFO ] [MAIN ] IQV: Loaded 50235 existing records. [2025-10-31T19:23:21.935669] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-31T19:23:21.957212] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-31T19:23:22.173277] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-31T19:23:22.212685] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-31T19:23:22.222629] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:23:22.253106] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-31T19:23:22.303924] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-31T19:23:22.370910] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-31T19:23:22.448742] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-31T19:23:22.418302] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:23:22.518745] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-31T19:23:22.553380] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:23:22.568056] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-31T19:23:22.603627] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-31T19:23:22.587916] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-31T19:23:22.614109] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-31T19:23:22.624554] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-31T19:23:22.749338] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-31T19:23:22.832390] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-31T19:23:23.377396] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:23:23.437991] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-31T19:23:23.741810] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:23:23.770264] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-31T19:23:23.877818] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:23:23.902223] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-31T19:23:23.941791] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:23:23.942195] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-31T19:23:24.247729] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T19:23:24.251808] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-31T19:23:24.480520] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-31T19:23:24.484452] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-31T19:23:24.978336] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-31T19:23:24.984514] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-31T19:23:25.060288] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T19:23:25.071019] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-31T19:23:25.146455] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T19:23:25.175541] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-31T19:23:25.177474] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-31T19:23:25.183558] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-31T19:23:25.626863] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-31T19:23:25.857698] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-31T19:23:25.902630] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-31T19:23:26.272216] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T19:23:26.571023] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T19:23:26.594454] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-31T19:23:26.657636] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-31T19:23:27.368862] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-31T19:23:27.457696] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-31T19:23:28.257690] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-31T19:23:28.695513] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T19:23:28.896795] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T19:23:29.057702] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-31T19:23:29.857686] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-31T19:23:30.411571] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-31T19:23:30.593004] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-31T19:23:30.657697] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-31T19:23:31.373685] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-31T19:23:31.457639] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-31T19:23:32.156910] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T19:23:32.257717] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-31T19:23:32.990031] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:23:33.057622] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-31T19:23:33.767322] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T19:23:33.857724] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-31T19:23:34.657696] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-31T19:23:35.183779] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T19:23:35.457704] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-31T19:23:36.003230] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T19:23:36.257685] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-31T19:23:36.769726] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:23:37.057730] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-31T19:23:37.567811] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:23:37.723279] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T19:23:37.857674] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-31T19:23:38.657735] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-31T19:23:39.138390] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T19:23:39.444005] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T19:23:39.450277] [INFO ] [REMOTE ] IPI: Full fetch complete (30249 records). [2025-10-31T19:23:39.450382] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-31T19:23:39.462842] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-31T19:23:39.844702] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-31T19:23:39.844814] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-31T19:23:39.846093] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-31T19:23:39.846164] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-31T19:23:39.847206] [DEBUG] [LOCAL ] IPI: Trimmed 30249 records to 21456 (keeping 200 days of data) [2025-10-31T19:23:39.981590] [DEBUG] [LOCAL ] IPI: Primary data saved (21456 records). [2025-10-31T19:23:39.981790] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-31T19:23:39.981904] [INFO ] [MAIN ] Update Progress: 1121/2365 symbols completed. IPI took 19.2s. Estimated remaining: 2h 39m 21s. Rate: 7.8 symbols/min [2025-10-31T19:23:40.165026] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:23:40.182232] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T19:23:40.238756] [DEBUG] [LOCAL ] IR: Loaded 53108 existing records from primary storage. [2025-10-31T19:23:40.239246] [INFO ] [MAIN ] IR: Loaded 53108 existing records. [2025-10-31T19:23:40.262836] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-31T19:23:40.437840] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:23:40.438117] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-31T19:23:40.438169] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-31T19:23:40.438638] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-31T19:23:40.438738] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-31T19:23:40.795870] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:23:41.057624] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-31T19:23:41.752328] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-31T19:23:41.857730] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-31T19:23:42.263559] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T19:23:42.657715] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-31T19:23:43.168416] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T19:23:43.457637] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-31T19:23:43.874511] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T19:23:44.020176] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-31T19:23:44.257673] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-31T19:23:45.057693] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-31T19:23:45.526921] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T19:23:45.696416] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T19:23:45.857628] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-31T19:23:46.657672] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-31T19:23:46.728596] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-31T19:23:46.732551] [INFO ] [REMOTE ] IQI: Full fetch complete (26096 records). [2025-10-31T19:23:46.732624] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-31T19:23:47.093995] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-31T19:23:47.094119] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-31T19:23:47.094712] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-31T19:23:47.094773] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-31T19:23:47.095475] [DEBUG] [LOCAL ] IQI: Trimmed 26096 records to 17740 (keeping 200 days of data) [2025-10-31T19:23:47.202024] [DEBUG] [LOCAL ] IQI: Primary data saved (17740 records). [2025-10-31T19:23:47.202159] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-31T19:23:47.202235] [INFO ] [MAIN ] Update Progress: 1122/2365 symbols completed. IQI took 26.4s. Estimated remaining: 2h 39m 13s. Rate: 7.8 symbols/min [2025-10-31T19:23:47.371533] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:23:47.415866] [DEBUG] [LOCAL ] IRM: Loaded 48898 existing records from primary storage. [2025-10-31T19:23:47.416182] [INFO ] [MAIN ] IRM: Loaded 48898 existing records. [2025-10-31T19:23:47.469949] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-31T19:23:47.597744] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:23:47.598001] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-31T19:23:47.598050] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-31T19:23:47.598350] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-31T19:23:47.598390] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-31T19:23:47.968081] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:23:48.003731] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T19:23:48.257679] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-31T19:23:48.826551] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T19:23:49.057694] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-31T19:23:49.551160] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T19:23:49.857734] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-31T19:23:50.349082] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T19:23:50.657670] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-31T19:23:51.028343] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T19:23:51.457674] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-31T19:23:51.813355] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T19:23:52.257717] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-31T19:23:52.906884] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T19:23:52.919420] [INFO ] [REMOTE ] IQV: Full fetch complete (72604 records). [2025-10-31T19:23:52.919664] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-31T19:23:53.071176] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-31T19:23:53.342927] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-31T19:23:53.343151] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-31T19:23:53.344800] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-31T19:23:53.344878] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-31T19:23:53.347003] [DEBUG] [LOCAL ] IQV: Trimmed 72604 records to 50593 (keeping 200 days of data) [2025-10-31T19:23:53.618204] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-31T19:23:53.737006] [DEBUG] [LOCAL ] IQV: Primary data saved (50593 records). [2025-10-31T19:23:53.737223] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-31T19:23:53.738183] [INFO ] [MAIN ] Update Progress: 1123/2365 symbols completed. IQV took 32.9s. Estimated remaining: 2h 39m 4s. Rate: 7.8 symbols/min [2025-10-31T19:23:53.862920] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-31T19:23:53.926575] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:23:53.957174] [DEBUG] [LOCAL ] IRS: Loaded 24030 existing records from primary storage. [2025-10-31T19:23:53.957559] [INFO ] [MAIN ] IRS: Loaded 24030 existing records. [2025-10-31T19:23:54.145598] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:23:54.145970] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-31T19:23:54.146024] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-31T19:23:54.146269] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-31T19:23:54.146326] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-31T19:23:54.557626] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:23:54.590364] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-31T19:23:54.657623] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-31T19:23:55.224227] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-31T19:23:55.457725] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-31T19:23:55.835125] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T19:23:56.257678] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-31T19:23:56.768890] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T19:23:57.057669] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-31T19:23:57.500824] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-31T19:23:57.845754] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T19:23:57.857604] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-31T19:23:58.593013] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T19:23:58.657639] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-31T19:23:59.457705] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-31T19:23:59.911573] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T19:24:00.257742] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-31T19:24:01.057694] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-31T19:24:01.118524] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-31T19:24:01.857630] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-31T19:24:02.114515] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-31T19:24:02.126916] [INFO ] [REMOTE ] IR: Full fetch complete (76505 records). [2025-10-31T19:24:02.127067] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-31T19:24:02.525441] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-31T19:24:02.525548] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-31T19:24:02.526788] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-31T19:24:02.526924] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-31T19:24:02.557559] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-31T19:24:02.568549] [DEBUG] [LOCAL ] IR: Trimmed 76505 records to 53498 (keeping 200 days of data) [2025-10-31T19:24:02.657726] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-31T19:24:02.886291] [DEBUG] [LOCAL ] IR: Primary data saved (53498 records). [2025-10-31T19:24:02.886431] [INFO ] [MAIN ] IR: Full history saved. [2025-10-31T19:24:02.887021] [INFO ] [MAIN ] Update Progress: 1124/2365 symbols completed. IR took 22.9s. Estimated remaining: 2h 38m 58s. Rate: 7.8 symbols/min [2025-10-31T19:24:03.053584] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:24:03.103112] [DEBUG] [LOCAL ] IRT: Loaded 50678 existing records from primary storage. [2025-10-31T19:24:03.103412] [INFO ] [MAIN ] IRT: Loaded 50678 existing records. [2025-10-31T19:24:03.282668] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:24:03.282927] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-31T19:24:03.283077] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-31T19:24:03.283435] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-31T19:24:03.283515] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-31T19:24:03.464509] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-31T19:24:03.582536] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-31T19:24:03.679864] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:24:04.257629] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-31T19:24:04.309273] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T19:24:04.310339] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-31T19:24:04.326830] [INFO ] [REMOTE ] IPG: Full fetch complete (77440 records). [2025-10-31T19:24:04.326968] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-31T19:24:04.744020] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-31T19:24:04.744103] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-31T19:24:04.745081] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-31T19:24:04.745142] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-31T19:24:04.746549] [DEBUG] [LOCAL ] IPG: Trimmed 77440 records to 54105 (keeping 200 days of data) [2025-10-31T19:24:05.065400] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-31T19:24:05.082728] [DEBUG] [LOCAL ] IPG: Primary data saved (54105 records). [2025-10-31T19:24:05.082875] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-31T19:24:05.082958] [INFO ] [MAIN ] Update Progress: 1125/2365 symbols completed. IPG took 44.3s. Estimated remaining: 2h 38m 44s. Rate: 7.8 symbols/min [2025-10-31T19:24:05.255454] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:24:05.271631] [DEBUG] [LOCAL ] ISD: Loaded 15350 existing records from primary storage. [2025-10-31T19:24:05.271887] [INFO ] [MAIN ] ISD: Loaded 15350 existing records. [2025-10-31T19:24:05.470169] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:24:05.470443] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-31T19:24:05.470500] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-31T19:24:05.470731] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-31T19:24:05.470786] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-31T19:24:05.857783] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:24:05.858292] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-31T19:24:05.888689] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-31T19:24:06.475029] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T19:24:06.661245] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-31T19:24:06.663088] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-31T19:24:07.432942] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T19:24:07.457617] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-31T19:24:08.160994] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T19:24:08.257678] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-31T19:24:08.956702] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-31T19:24:09.057667] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-31T19:24:09.766477] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-31T19:24:09.857667] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-31T19:24:10.657716] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-31T19:24:10.955340] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T19:24:11.457686] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-31T19:24:11.493609] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T19:24:12.257701] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-31T19:24:12.631270] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T19:24:13.057698] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-31T19:24:13.558955] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:24:13.857680] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-31T19:24:14.265325] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-31T19:24:14.657707] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-31T19:24:14.836350] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T19:24:15.457725] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-31T19:24:15.826129] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T19:24:15.915620] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-31T19:24:16.257693] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-31T19:24:17.057755] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-31T19:24:17.284053] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-31T19:24:17.291300] [INFO ] [REMOTE ] IRS: Full fetch complete (32992 records). [2025-10-31T19:24:17.291399] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-31T19:24:17.677784] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-31T19:24:17.677891] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-31T19:24:17.678562] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-31T19:24:17.678604] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-31T19:24:17.679352] [DEBUG] [LOCAL ] IRS: Trimmed 32992 records to 24281 (keeping 200 days of data) [2025-10-31T19:24:17.815106] [DEBUG] [LOCAL ] IRS: Primary data saved (24281 records). [2025-10-31T19:24:17.815229] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-31T19:24:17.815303] [INFO ] [MAIN ] Update Progress: 1126/2365 symbols completed. IRS took 24.1s. Estimated remaining: 2h 38m 42s. Rate: 7.8 symbols/min [2025-10-31T19:24:17.869190] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-31T19:24:17.986682] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:24:18.024361] [DEBUG] [LOCAL ] IT: Loaded 42409 existing records from primary storage. [2025-10-31T19:24:18.024676] [INFO ] [MAIN ] IT: Loaded 42409 existing records. [2025-10-31T19:24:18.200463] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:24:18.200886] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-31T19:24:18.200940] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-31T19:24:18.201205] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-31T19:24:18.201260] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-31T19:24:18.554812] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:24:18.569384] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T19:24:18.601260] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-31T19:24:18.657638] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-31T19:24:19.457672] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-31T19:24:19.716948] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T19:24:20.257681] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-31T19:24:20.659336] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T19:24:21.057674] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-31T19:24:21.526991] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-31T19:24:21.857708] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-31T19:24:22.376694] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-31T19:24:22.551939] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-31T19:24:22.657740] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-31T19:24:23.457667] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-31T19:24:23.817885] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T19:24:24.257615] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-31T19:24:24.424214] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T19:24:25.057673] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-31T19:24:25.599576] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-31T19:24:25.610386] [INFO ] [REMOTE ] IRM: Full fetch complete (71754 records). [2025-10-31T19:24:25.610533] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-31T19:24:25.862789] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-31T19:24:26.025455] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-31T19:24:26.025530] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-31T19:24:26.026553] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-31T19:24:26.026616] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-31T19:24:26.028012] [DEBUG] [LOCAL ] IRM: Trimmed 71754 records to 49238 (keeping 200 days of data) [2025-10-31T19:24:26.326487] [DEBUG] [LOCAL ] IRM: Primary data saved (49238 records). [2025-10-31T19:24:26.326721] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-31T19:24:26.326835] [INFO ] [MAIN ] Update Progress: 1127/2365 symbols completed. IRM took 39.1s. Estimated remaining: 2h 38m 35s. Rate: 7.8 symbols/min [2025-10-31T19:24:26.473080] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-31T19:24:26.551920] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:24:26.583228] [DEBUG] [LOCAL ] ITGR: Loaded 31710 existing records from primary storage. [2025-10-31T19:24:26.583478] [INFO ] [MAIN ] ITGR: Loaded 31710 existing records. [2025-10-31T19:24:26.662849] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-31T19:24:26.764244] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:24:26.764463] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-31T19:24:26.764509] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-31T19:24:26.764726] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-31T19:24:26.764781] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-31T19:24:27.117059] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:24:27.148383] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T19:24:27.457685] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-31T19:24:28.073962] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T19:24:28.094542] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T19:24:28.094122] [INFO ] [REMOTE ] IRT: Full fetch complete (72915 records). [2025-10-31T19:24:28.098228] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-31T19:24:28.258792] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-31T19:24:28.493775] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-31T19:24:28.493851] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-31T19:24:28.494796] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-31T19:24:28.494858] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-31T19:24:28.496136] [DEBUG] [LOCAL ] IRT: Trimmed 72915 records to 51059 (keeping 200 days of data) [2025-10-31T19:24:28.798050] [DEBUG] [LOCAL ] IRT: Primary data saved (51059 records). [2025-10-31T19:24:28.798226] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-31T19:24:28.798901] [INFO ] [MAIN ] Update Progress: 1128/2365 symbols completed. IRT took 25.9s. Estimated remaining: 2h 38m 22s. Rate: 7.8 symbols/min [2025-10-31T19:24:28.979303] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:24:29.014481] [DEBUG] [LOCAL ] ITT: Loaded 32270 existing records from primary storage. [2025-10-31T19:24:29.014771] [INFO ] [MAIN ] ITT: Loaded 32270 existing records. [2025-10-31T19:24:29.067031] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-31T19:24:29.136202] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-31T19:24:29.229769] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:24:29.229994] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-31T19:24:29.230046] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-31T19:24:29.230407] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-31T19:24:29.230454] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-31T19:24:29.588663] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:24:29.766619] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-31T19:24:29.857712] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-31T19:24:30.657677] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-31T19:24:30.956474] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T19:24:31.465150] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-31T19:24:31.469917] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T19:24:31.992714] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T19:24:32.257672] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-31T19:24:32.824531] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-31T19:24:33.057688] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-31T19:24:33.857712] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-31T19:24:33.899569] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-31T19:24:34.476440] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-31T19:24:34.657628] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-31T19:24:35.457661] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-31T19:24:35.680147] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T19:24:36.227719] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-31T19:24:36.233145] [INFO ] [REMOTE ] ISD: Full fetch complete (23560 records). [2025-10-31T19:24:36.233303] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-31T19:24:36.262748] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-31T19:24:36.646179] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-31T19:24:36.646272] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-31T19:24:36.646851] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-31T19:24:36.646914] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-31T19:24:36.647520] [DEBUG] [LOCAL ] ISD: Trimmed 23560 records to 15408 (keeping 200 days of data) [2025-10-31T19:24:36.739384] [DEBUG] [LOCAL ] ISD: Primary data saved (15408 records). [2025-10-31T19:24:36.739513] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-31T19:24:36.739592] [INFO ] [MAIN ] Update Progress: 1129/2365 symbols completed. ISD took 31.7s. Estimated remaining: 2h 38m 14s. Rate: 7.8 symbols/min [2025-10-31T19:24:36.906761] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:24:36.954310] [DEBUG] [LOCAL ] ITUB: Loaded 53683 existing records from primary storage. [2025-10-31T19:24:36.954638] [INFO ] [MAIN ] ITUB: Loaded 53683 existing records. [2025-10-31T19:24:37.062868] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-31T19:24:37.140349] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:24:37.140562] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-31T19:24:37.140618] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-31T19:24:37.140973] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-31T19:24:37.141032] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-31T19:24:37.499961] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:24:37.518596] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T19:24:37.857620] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-31T19:24:38.001207] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-31T19:24:38.657669] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-31T19:24:38.897883] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T19:24:39.457707] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-31T19:24:39.890749] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T19:24:40.257622] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-31T19:24:40.429846] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-31T19:24:41.057633] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-31T19:24:41.295842] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T19:24:41.862473] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-31T19:24:41.867664] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-31T19:24:42.657689] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-31T19:24:43.179434] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T19:24:43.457682] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-31T19:24:44.024468] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T19:24:44.257671] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-31T19:24:44.714851] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-31T19:24:45.057702] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-31T19:24:45.467280] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T19:24:45.857676] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-31T19:24:46.256582] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-31T19:24:46.657666] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-31T19:24:47.086635] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T19:24:47.457683] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-31T19:24:48.105759] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T19:24:48.116626] [INFO ] [REMOTE ] IT: Full fetch complete (58435 records). [2025-10-31T19:24:48.116802] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-31T19:24:48.267113] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-31T19:24:48.533435] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-31T19:24:48.533717] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-31T19:24:48.535223] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-31T19:24:48.537345] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T19:24:48.542983] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-31T19:24:48.544624] [DEBUG] [LOCAL ] IT: Trimmed 58435 records to 42733 (keeping 200 days of data) [2025-10-31T19:24:48.797780] [DEBUG] [LOCAL ] IT: Primary data saved (42733 records). [2025-10-31T19:24:48.797934] [INFO ] [MAIN ] IT: Full history saved. [2025-10-31T19:24:48.798527] [INFO ] [MAIN ] Update Progress: 1130/2365 symbols completed. IT took 31.0s. Estimated remaining: 2h 38m 11s. Rate: 7.8 symbols/min [2025-10-31T19:24:48.965521] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:24:49.010270] [DEBUG] [LOCAL ] ITW: Loaded 45877 existing records from primary storage. [2025-10-31T19:24:49.010590] [INFO ] [MAIN ] ITW: Loaded 45877 existing records. [2025-10-31T19:24:49.063584] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-31T19:24:49.191280] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:24:49.191487] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-31T19:24:49.191533] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-31T19:24:49.191779] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-31T19:24:49.191849] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-31T19:24:49.599191] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:24:49.631394] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T19:24:49.857684] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-31T19:24:50.090901] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T19:24:50.657698] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-31T19:24:50.852963] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-31T19:24:51.385242] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:24:51.457620] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-31T19:24:52.257695] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-31T19:24:52.404732] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-31T19:24:53.057677] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-31T19:24:53.366006] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T19:24:53.857762] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-31T19:24:54.274073] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T19:24:54.657739] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-31T19:24:54.837288] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T19:24:55.457715] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-31T19:24:55.927250] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-31T19:24:55.935789] [INFO ] [REMOTE ] ITGR: Full fetch complete (44909 records). [2025-10-31T19:24:55.935909] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-31T19:24:56.262775] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-31T19:24:56.333605] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-31T19:24:56.333709] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-31T19:24:56.334431] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-31T19:24:56.334472] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-31T19:24:56.335415] [DEBUG] [LOCAL ] ITGR: Trimmed 44909 records to 32079 (keeping 200 days of data) [2025-10-31T19:24:56.521201] [DEBUG] [LOCAL ] ITGR: Primary data saved (32079 records). [2025-10-31T19:24:56.521330] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-31T19:24:56.521405] [INFO ] [MAIN ] Update Progress: 1131/2365 symbols completed. ITGR took 30.2s. Estimated remaining: 2h 38m 4s. Rate: 7.8 symbols/min [2025-10-31T19:24:56.691282] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:24:56.731776] [DEBUG] [LOCAL ] IVR: Loaded 47926 existing records from primary storage. [2025-10-31T19:24:56.732069] [INFO ] [MAIN ] IVR: Loaded 47926 existing records. [2025-10-31T19:24:56.914305] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:24:56.914598] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-31T19:24:56.914667] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-31T19:24:56.915017] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-31T19:24:56.915059] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-31T19:24:57.048075] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-31T19:24:57.073279] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-31T19:24:57.319104] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:24:57.335523] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T19:24:57.857722] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-31T19:24:58.393584] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-31T19:24:58.657707] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-31T19:24:58.909001] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T19:24:59.457669] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-31T19:24:59.998399] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T19:25:00.257725] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-31T19:25:00.450308] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T19:25:01.057704] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-31T19:25:01.657213] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T19:25:01.857721] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-31T19:25:02.425767] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T19:25:02.657706] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-31T19:25:03.168977] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-31T19:25:03.457702] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-31T19:25:03.735528] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T19:25:04.257704] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-31T19:25:04.741126] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T19:25:05.057634] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-31T19:25:05.522440] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T19:25:05.857703] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-31T19:25:05.910632] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-31T19:25:06.657675] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-31T19:25:07.457726] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-31T19:25:07.624260] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T19:25:07.650584] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-31T19:25:07.668754] [INFO ] [REMOTE ] ITUB: Full fetch complete (77301 records). [2025-10-31T19:25:07.669111] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-31T19:25:08.253221] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-31T19:25:08.253312] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-31T19:25:08.254293] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-31T19:25:08.254363] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-31T19:25:08.255853] [DEBUG] [LOCAL ] ITUB: Trimmed 77301 records to 54073 (keeping 200 days of data) [2025-10-31T19:25:08.304058] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-31T19:25:08.595123] [DEBUG] [LOCAL ] ITUB: Primary data saved (54073 records). [2025-10-31T19:25:08.595261] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-31T19:25:08.595342] [INFO ] [MAIN ] Update Progress: 1132/2365 symbols completed. ITUB took 31.9s. Estimated remaining: 2h 38m 1s. Rate: 7.8 symbols/min [2025-10-31T19:25:08.766012] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:25:08.795863] [DEBUG] [LOCAL ] IVT: Loaded 31435 existing records from primary storage. [2025-10-31T19:25:08.796117] [INFO ] [MAIN ] IVT: Loaded 31435 existing records. [2025-10-31T19:25:08.982543] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:25:08.982949] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-31T19:25:08.983082] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-31T19:25:08.983359] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-31T19:25:08.983551] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-31T19:25:09.060689] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-31T19:25:09.210967] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-31T19:25:09.436786] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:25:09.522321] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T19:25:09.857673] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-31T19:25:10.265240] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-31T19:25:10.273793] [INFO ] [REMOTE ] ITT: Full fetch complete (47941 records). [2025-10-31T19:25:10.273913] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-31T19:25:10.659408] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-31T19:25:10.700191] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-31T19:25:10.701389] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-31T19:25:10.702298] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-31T19:25:10.702571] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-31T19:25:10.704040] [DEBUG] [LOCAL ] ITT: Trimmed 47941 records to 32531 (keeping 200 days of data) [2025-10-31T19:25:10.818034] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-31T19:25:10.948304] [DEBUG] [LOCAL ] ITT: Primary data saved (32531 records). [2025-10-31T19:25:10.948462] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-31T19:25:10.949089] [INFO ] [MAIN ] Update Progress: 1133/2365 symbols completed. ITT took 42.2s. Estimated remaining: 2h 37m 47s. Rate: 7.8 symbols/min [2025-10-31T19:25:11.136497] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:25:11.187748] [DEBUG] [LOCAL ] IVZ: Loaded 53516 existing records from primary storage. [2025-10-31T19:25:11.188131] [INFO ] [MAIN ] IVZ: Loaded 53516 existing records. [2025-10-31T19:25:11.372381] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:25:11.372579] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-31T19:25:11.372626] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-31T19:25:11.372946] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-31T19:25:11.373001] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-31T19:25:11.462698] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-31T19:25:11.719008] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:25:12.045525] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T19:25:12.257720] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-31T19:25:12.921747] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-31T19:25:13.057681] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-31T19:25:13.534964] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T19:25:13.857681] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-31T19:25:14.234518] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T19:25:14.657691] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-31T19:25:15.140086] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T19:25:15.457712] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-31T19:25:15.805008] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T19:25:16.257684] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-31T19:25:16.541661] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T19:25:17.057699] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-31T19:25:17.632361] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-31T19:25:17.857627] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-31T19:25:17.883167] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T19:25:18.657700] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-31T19:25:19.135122] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T19:25:19.457632] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-31T19:25:19.560329] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T19:25:20.257631] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-31T19:25:20.790106] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T19:25:21.057694] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-31T19:25:21.738501] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T19:25:21.749568] [INFO ] [REMOTE ] ITW: Full fetch complete (67039 records). [2025-10-31T19:25:21.749725] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-31T19:25:21.862814] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-31T19:25:22.130263] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-31T19:25:22.130390] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-31T19:25:22.131669] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-31T19:25:22.131754] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-31T19:25:22.133475] [DEBUG] [LOCAL ] ITW: Trimmed 67039 records to 46225 (keeping 200 days of data) [2025-10-31T19:25:22.440770] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T19:25:22.472748] [DEBUG] [LOCAL ] ITW: Primary data saved (46225 records). [2025-10-31T19:25:22.473219] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-31T19:25:22.473885] [INFO ] [MAIN ] Update Progress: 1134/2365 symbols completed. ITW took 33.7s. Estimated remaining: 2h 37m 44s. Rate: 7.8 symbols/min [2025-10-31T19:25:22.641539] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:25:22.662725] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-31T19:25:22.665669] [DEBUG] [LOCAL ] IX: Loaded 21627 existing records from primary storage. [2025-10-31T19:25:22.665920] [INFO ] [MAIN ] IX: Loaded 21627 existing records. [2025-10-31T19:25:22.847059] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:25:22.847280] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-31T19:25:22.847350] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-31T19:25:22.847582] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-31T19:25:22.847638] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-31T19:25:23.198241] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:25:23.466930] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-31T19:25:23.472756] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-31T19:25:23.484304] [INFO ] [REMOTE ] IVR: Full fetch complete (69010 records). [2025-10-31T19:25:23.484443] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-31T19:25:23.861330] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-31T19:25:23.861429] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-31T19:25:23.862395] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-31T19:25:23.862487] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-31T19:25:23.863859] [DEBUG] [LOCAL ] IVR: Trimmed 69010 records to 48289 (keeping 200 days of data) [2025-10-31T19:25:23.967946] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-31T19:25:24.009596] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T19:25:24.193577] [DEBUG] [LOCAL ] IVR: Primary data saved (48289 records). [2025-10-31T19:25:24.193737] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-31T19:25:24.193825] [INFO ] [MAIN ] Update Progress: 1135/2365 symbols completed. IVR took 27.7s. Estimated remaining: 2h 37m 30s. Rate: 7.8 symbols/min [2025-10-31T19:25:24.262875] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-31T19:25:24.360909] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:25:24.402511] [DEBUG] [LOCAL ] J: Loaded 40817 existing records from primary storage. [2025-10-31T19:25:24.402818] [INFO ] [MAIN ] J: Loaded 40817 existing records. [2025-10-31T19:25:24.601159] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:25:24.601390] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-31T19:25:24.601436] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-31T19:25:24.601779] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-31T19:25:24.601836] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-31T19:25:24.924627] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T19:25:24.997832] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:25:25.057638] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-31T19:25:25.857687] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-31T19:25:26.085776] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T19:25:26.657700] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-31T19:25:27.166462] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-31T19:25:27.412603] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-31T19:25:27.457607] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-31T19:25:28.257672] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-31T19:25:28.742944] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T19:25:29.057626] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-31T19:25:29.202577] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-31T19:25:29.857676] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-31T19:25:30.007961] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T19:25:30.657693] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-31T19:25:31.163581] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T19:25:31.457626] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-31T19:25:31.551415] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T19:25:32.257628] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-31T19:25:32.830307] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T19:25:33.057718] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-31T19:25:33.095144] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T19:25:33.857669] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-31T19:25:34.392686] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-31T19:25:34.657674] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-31T19:25:34.809901] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-31T19:25:35.457667] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-31T19:25:36.178822] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-31T19:25:36.191257] [INFO ] [REMOTE ] IVZ: Full fetch complete (77083 records). [2025-10-31T19:25:36.191395] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-31T19:25:36.260540] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-31T19:25:36.611825] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-31T19:25:36.612100] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-31T19:25:36.614763] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T19:25:36.613555] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-31T19:25:36.614919] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-31T19:25:36.625132] [DEBUG] [LOCAL ] IVZ: Trimmed 77083 records to 53906 (keeping 200 days of data) [2025-10-31T19:25:36.938873] [DEBUG] [LOCAL ] IVZ: Primary data saved (53906 records). [2025-10-31T19:25:36.938996] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-31T19:25:36.939516] [INFO ] [MAIN ] Update Progress: 1136/2365 symbols completed. IVZ took 26.0s. Estimated remaining: 2h 37m 28s. Rate: 7.8 symbols/min [2025-10-31T19:25:37.062725] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-31T19:25:37.115279] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:25:37.157521] [DEBUG] [LOCAL ] JBGS: Loaded 41513 existing records from primary storage. [2025-10-31T19:25:37.157823] [INFO ] [MAIN ] JBGS: Loaded 41513 existing records. [2025-10-31T19:25:37.337522] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:25:37.337902] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-31T19:25:37.337976] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-31T19:25:37.338295] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-31T19:25:37.338353] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-31T19:25:37.609555] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-31T19:25:37.726678] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:25:37.857617] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-31T19:25:37.975089] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T19:25:38.657639] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-31T19:25:38.956006] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T19:25:39.457676] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-31T19:25:39.743405] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-31T19:25:39.751755] [INFO ] [REMOTE ] IVT: Full fetch complete (45783 records). [2025-10-31T19:25:39.751862] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-31T19:25:40.135122] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-31T19:25:40.135196] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-31T19:25:40.135943] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-31T19:25:40.136004] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-31T19:25:40.136949] [DEBUG] [LOCAL ] IVT: Trimmed 45783 records to 31663 (keeping 200 days of data) [2025-10-31T19:25:40.283067] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-31T19:25:40.324624] [DEBUG] [LOCAL ] IVT: Primary data saved (31663 records). [2025-10-31T19:25:40.324763] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-31T19:25:40.324844] [INFO ] [MAIN ] Update Progress: 1137/2365 symbols completed. IVT took 31.7s. Estimated remaining: 2h 37m 15s. Rate: 7.8 symbols/min [2025-10-31T19:25:40.490383] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:25:40.529404] [DEBUG] [LOCAL ] JBI: Loaded 42232 existing records from primary storage. [2025-10-31T19:25:40.529742] [INFO ] [MAIN ] JBI: Loaded 42232 existing records. [2025-10-31T19:25:40.707192] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:25:40.707486] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-31T19:25:40.707694] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-31T19:25:40.708156] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-31T19:25:40.708216] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-31T19:25:41.035961] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T19:25:41.064577] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-31T19:25:41.153638] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:25:41.204145] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-31T19:25:41.857721] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-31T19:25:42.086757] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T19:25:42.609597] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T19:25:42.657606] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-31T19:25:43.412425] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-31T19:25:43.457606] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-31T19:25:43.515038] [DEBUG] [REMOTE ] IX: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-31T19:25:43.515214] [WARN ] [REMOTE ] IX: No data returned for month 2025-08 [2025-10-31T19:25:43.515298] [FATAL] [REMOTE ] IX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:25:43.515365] [FATAL] [MAIN ] IX: Failed to fetch primary data. [2025-10-31T19:25:43.515426] [WARN ] [MAIN ] IX: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:25:43.515492] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-31T19:25:43.515550] [DEBUG] [LOCAL ] IX: No primary data file found to delete. [2025-10-31T19:25:43.515600] [INFO ] [LOCAL ] IX: Starting deletion of derivative data. [2025-10-31T19:25:43.515779] [DEBUG] [LOCAL ] IX: Deleted derivative data file. [2025-10-31T19:25:43.515871] [INFO ] [MAIN ] Update Progress: 1138/2365 symbols completed. IX took 21.0s. Estimated remaining: 2h 37m 3s. Rate: 7.8 symbols/min [2025-10-31T19:25:43.684618] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:25:43.728985] [DEBUG] [LOCAL ] JBL: Loaded 48440 existing records from primary storage. [2025-10-31T19:25:43.729313] [INFO ] [MAIN ] JBL: Loaded 48440 existing records. [2025-10-31T19:25:43.904824] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:25:43.905034] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-31T19:25:43.905079] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-31T19:25:43.905266] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-31T19:25:43.905303] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-31T19:25:44.264107] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-31T19:25:44.269771] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:25:45.057708] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-31T19:25:45.299910] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T19:25:45.857717] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-31T19:25:46.340209] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T19:25:46.657728] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-31T19:25:46.883361] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-31T19:25:47.457629] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-31T19:25:47.798597] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T19:25:48.257734] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-31T19:25:48.645936] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T19:25:49.057702] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-31T19:25:49.401109] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-31T19:25:49.857663] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-31T19:25:50.033377] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T19:25:50.657613] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-31T19:25:50.845842] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-31T19:25:51.457667] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-31T19:25:51.776125] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T19:25:52.257727] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-31T19:25:52.528396] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T19:25:53.057752] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-31T19:25:53.713038] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T19:25:53.857613] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-31T19:25:54.078024] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T19:25:54.657736] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-31T19:25:55.218988] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T19:25:55.457677] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-31T19:25:55.762504] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T19:25:56.257754] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-31T19:25:56.591705] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T19:25:57.057697] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-31T19:25:57.353115] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T19:25:57.857688] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-31T19:25:58.248712] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T19:25:58.657671] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-31T19:25:59.119887] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T19:25:59.457682] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-31T19:25:59.668922] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T19:26:00.257719] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-31T19:26:00.795237] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T19:26:01.057721] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-31T19:26:01.485102] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T19:26:01.857767] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-31T19:26:02.243409] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T19:26:02.657746] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-31T19:26:02.822945] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T19:26:03.457710] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-31T19:26:03.773265] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T19:26:04.257746] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-31T19:26:04.858837] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T19:26:04.869357] [INFO ] [REMOTE ] J: Full fetch complete (60098 records). [2025-10-31T19:26:04.869474] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-31T19:26:05.062952] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-31T19:26:05.261864] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-31T19:26:05.262066] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-31T19:26:05.263194] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-31T19:26:05.263316] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-31T19:26:05.264923] [DEBUG] [LOCAL ] J: Trimmed 60098 records to 41158 (keeping 200 days of data) [2025-10-31T19:26:05.384704] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-31T19:26:05.557765] [DEBUG] [LOCAL ] J: Primary data saved (41158 records). [2025-10-31T19:26:05.557919] [INFO ] [MAIN ] J: Full history saved. [2025-10-31T19:26:05.558005] [INFO ] [MAIN ] Update Progress: 1139/2365 symbols completed. J took 41.4s. Estimated remaining: 2h 37m 10s. Rate: 7.8 symbols/min [2025-10-31T19:26:05.724081] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:05.751375] [DEBUG] [LOCAL ] JBND: Loaded 27948 existing records from primary storage. [2025-10-31T19:26:05.751661] [INFO ] [MAIN ] JBND: Loaded 27948 existing records. [2025-10-31T19:26:05.862862] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-31T19:26:05.934031] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:26:05.934280] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-31T19:26:05.934332] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-31T19:26:05.934577] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-31T19:26:05.934634] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-31T19:26:06.317466] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:06.549494] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T19:26:06.657728] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-31T19:26:07.189190] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-31T19:26:07.197460] [INFO ] [REMOTE ] JBGS: Full fetch complete (59116 records). [2025-10-31T19:26:07.197563] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-31T19:26:07.462819] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-31T19:26:07.582857] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-31T19:26:07.583019] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-31T19:26:07.583932] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-31T19:26:07.583994] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-31T19:26:07.585135] [DEBUG] [LOCAL ] JBGS: Trimmed 59116 records to 41752 (keeping 200 days of data) [2025-10-31T19:26:07.845678] [DEBUG] [LOCAL ] JBGS: Primary data saved (41752 records). [2025-10-31T19:26:07.850969] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-31T19:26:07.853688] [INFO ] [MAIN ] Update Progress: 1140/2365 symbols completed. JBGS took 30.9s. Estimated remaining: 2h 36m 57s. Rate: 7.8 symbols/min [2025-10-31T19:26:07.955833] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:26:08.053390] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:08.053620] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-31T19:26:08.053692] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-31T19:26:08.053779] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-31T19:26:08.053815] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-31T19:26:08.053854] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-31T19:26:08.053886] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-31T19:26:08.262845] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-31T19:26:08.421226] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:08.794608] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T19:26:08.979397] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T19:26:09.057665] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-31T19:26:09.706713] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-31T19:26:09.857621] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-31T19:26:10.624902] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T19:26:10.657619] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-31T19:26:11.457702] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-31T19:26:11.481174] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-31T19:26:12.257722] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-31T19:26:12.530039] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T19:26:13.057670] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-31T19:26:13.581951] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T19:26:13.839681] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T19:26:13.857605] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-31T19:26:14.009854] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T19:26:14.010120] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-31T19:26:14.010209] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:26:14.010254] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-31T19:26:14.010286] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:26:14.010321] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-31T19:26:14.010376] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-31T19:26:14.010415] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-31T19:26:14.010453] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-31T19:26:14.010497] [INFO ] [MAIN ] Update Progress: 1141/2365 symbols completed. JBS took 6.2s. Estimated remaining: 2h 36m 48s. Rate: 7.8 symbols/min [2025-10-31T19:26:14.174952] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:14.215675] [DEBUG] [LOCAL ] JBTM: Loaded 33249 existing records from primary storage. [2025-10-31T19:26:14.216092] [INFO ] [MAIN ] JBTM: Loaded 33249 existing records. [2025-10-31T19:26:14.407055] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:26:14.407387] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-31T19:26:14.407440] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-31T19:26:14.407705] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-31T19:26:14.407763] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-31T19:26:14.662863] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-31T19:26:14.851410] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:15.457639] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-31T19:26:15.676569] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T19:26:16.204132] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T19:26:16.257616] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-31T19:26:17.039577] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-31T19:26:17.057609] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-31T19:26:17.861475] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-31T19:26:17.863352] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-31T19:26:18.657703] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-31T19:26:18.675034] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T19:26:19.295210] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T19:26:19.306397] [INFO ] [REMOTE ] JBL: Full fetch complete (70470 records). [2025-10-31T19:26:19.306520] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-31T19:26:19.465807] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-31T19:26:19.699705] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-31T19:26:19.699790] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-31T19:26:19.700900] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-31T19:26:19.700979] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-31T19:26:19.702474] [DEBUG] [LOCAL ] JBL: Trimmed 70470 records to 48765 (keeping 200 days of data) [2025-10-31T19:26:20.001569] [DEBUG] [LOCAL ] JBL: Primary data saved (48765 records). [2025-10-31T19:26:20.001758] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-31T19:26:20.002409] [INFO ] [MAIN ] Update Progress: 1142/2365 symbols completed. JBL took 36.5s. Estimated remaining: 2h 36m 38s. Rate: 7.8 symbols/min [2025-10-31T19:26:20.166859] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:20.176825] [DEBUG] [LOCAL ] JCE: Loaded 7127 existing records from primary storage. [2025-10-31T19:26:20.177034] [INFO ] [MAIN ] JCE: Loaded 7127 existing records. [2025-10-31T19:26:20.264868] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-31T19:26:20.354993] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:26:20.355197] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-31T19:26:20.355245] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-31T19:26:20.355437] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-31T19:26:20.355494] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-31T19:26:20.712706] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:26:20.741340] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:21.057682] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-31T19:26:21.468537] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-31T19:26:21.682362] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-31T19:26:21.691182] [INFO ] [REMOTE ] JBI: Full fetch complete (62941 records). [2025-10-31T19:26:21.691333] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-31T19:26:21.869858] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-31T19:26:22.091721] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-31T19:26:22.091801] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-31T19:26:22.092631] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-31T19:26:22.092708] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-31T19:26:22.093831] [DEBUG] [LOCAL ] JBI: Trimmed 62941 records to 42497 (keeping 200 days of data) [2025-10-31T19:26:22.331338] [DEBUG] [LOCAL ] JBI: Primary data saved (42497 records). [2025-10-31T19:26:22.331471] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-31T19:26:22.331553] [INFO ] [MAIN ] Update Progress: 1143/2365 symbols completed. JBI took 42.0s. Estimated remaining: 2h 36m 25s. Rate: 7.8 symbols/min [2025-10-31T19:26:22.416716] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-31T19:26:22.519946] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:22.570321] [DEBUG] [LOCAL ] JCI: Loaded 53894 existing records from primary storage. [2025-10-31T19:26:22.570610] [INFO ] [MAIN ] JCI: Loaded 53894 existing records. [2025-10-31T19:26:22.662867] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-31T19:26:22.758887] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:26:22.759123] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-31T19:26:22.759169] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-31T19:26:22.759565] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-31T19:26:22.759605] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-31T19:26:23.127199] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:23.134111] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-31T19:26:23.457638] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-31T19:26:23.931339] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-31T19:26:24.257682] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-31T19:26:25.057723] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-31T19:26:25.145732] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-31T19:26:25.437026] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-31T19:26:25.857713] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-31T19:26:26.327018] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-31T19:26:26.657626] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-31T19:26:27.457630] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-31T19:26:27.810386] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-31T19:26:27.818797] [INFO ] [REMOTE ] JBND: Full fetch complete (37091 records). [2025-10-31T19:26:27.818916] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-31T19:26:28.269233] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-31T19:26:28.271687] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-31T19:26:28.272024] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-31T19:26:28.273722] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-31T19:26:28.273794] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-31T19:26:28.275008] [DEBUG] [LOCAL ] JBND: Trimmed 37091 records to 28197 (keeping 200 days of data) [2025-10-31T19:26:28.462281] [DEBUG] [LOCAL ] JBND: Primary data saved (28197 records). [2025-10-31T19:26:28.462428] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-31T19:26:28.462511] [INFO ] [MAIN ] Update Progress: 1144/2365 symbols completed. JBND took 22.9s. Estimated remaining: 2h 36m 15s. Rate: 7.8 symbols/min [2025-10-31T19:26:28.635316] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:28.685805] [DEBUG] [LOCAL ] JEF: Loaded 50513 existing records from primary storage. [2025-10-31T19:26:28.686344] [INFO ] [MAIN ] JEF: Loaded 50513 existing records. [2025-10-31T19:26:28.877111] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:26:28.884966] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-31T19:26:28.884743] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-31T19:26:28.887874] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-31T19:26:28.888485] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-31T19:26:28.888627] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-31T19:26:29.055765] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T19:26:29.061194] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-31T19:26:29.334998] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:29.857667] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-31T19:26:30.034530] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T19:26:30.240920] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T19:26:30.657711] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-31T19:26:31.457706] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-31T19:26:31.913192] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-31T19:26:32.005018] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T19:26:32.257746] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-31T19:26:32.827457] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-31T19:26:32.830124] [INFO ] [REMOTE ] JCE: Full fetch complete (9606 records). [2025-10-31T19:26:32.830195] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-31T19:26:33.067378] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-31T19:26:33.193671] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-31T19:26:33.193755] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-31T19:26:33.194002] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-31T19:26:33.194045] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-31T19:26:33.194491] [DEBUG] [LOCAL ] JCE: Trimmed 9606 records to 7178 (keeping 200 days of data) [2025-10-31T19:26:33.236337] [DEBUG] [LOCAL ] JCE: Primary data saved (7178 records). [2025-10-31T19:26:33.236440] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-31T19:26:33.236514] [INFO ] [MAIN ] Update Progress: 1145/2365 symbols completed. JCE took 13.2s. Estimated remaining: 2h 36m 5s. Rate: 7.8 symbols/min [2025-10-31T19:26:33.403941] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:33.445336] [DEBUG] [LOCAL ] JELD: Loaded 45741 existing records from primary storage. [2025-10-31T19:26:33.445730] [INFO ] [MAIN ] JELD: Loaded 45741 existing records. [2025-10-31T19:26:33.622312] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:26:33.622520] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-31T19:26:33.622569] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-31T19:26:33.622909] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-31T19:26:33.622967] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-31T19:26:33.862788] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-31T19:26:33.978754] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:34.344280] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T19:26:34.657702] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-31T19:26:34.930611] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-31T19:26:35.457678] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-31T19:26:36.017600] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-31T19:26:36.257696] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-31T19:26:36.366603] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T19:26:37.057613] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-31T19:26:37.226893] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T19:26:37.857632] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-31T19:26:37.955046] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T19:26:38.657630] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-31T19:26:38.872253] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T19:26:39.457630] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-31T19:26:39.614102] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T19:26:40.257677] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-31T19:26:40.766387] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T19:26:41.057637] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-31T19:26:41.196124] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T19:26:41.857678] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-31T19:26:41.941039] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-31T19:26:42.657699] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-31T19:26:43.185034] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T19:26:43.457673] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-31T19:26:43.739121] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T19:26:44.257713] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-31T19:26:44.390324] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-31T19:26:45.057687] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-31T19:26:45.344242] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T19:26:45.857732] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-31T19:26:46.409605] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T19:26:46.657673] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-31T19:26:47.065730] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T19:26:47.457695] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-31T19:26:47.757107] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-31T19:26:47.765870] [INFO ] [REMOTE ] JBTM: Full fetch complete (46987 records). [2025-10-31T19:26:47.765989] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-31T19:26:48.136526] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-31T19:26:48.136599] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-31T19:26:48.137336] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-31T19:26:48.137398] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-31T19:26:48.138343] [DEBUG] [LOCAL ] JBTM: Trimmed 46987 records to 33495 (keeping 200 days of data) [2025-10-31T19:26:48.259817] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-31T19:26:48.341322] [DEBUG] [LOCAL ] JBTM: Primary data saved (33495 records). [2025-10-31T19:26:48.341456] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-31T19:26:48.341964] [INFO ] [MAIN ] Update Progress: 1146/2365 symbols completed. JBTM took 34.3s. Estimated remaining: 2h 36m 5s. Rate: 7.8 symbols/min [2025-10-31T19:26:48.518765] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:48.549141] [DEBUG] [LOCAL ] JFR: Loaded 30957 existing records from primary storage. [2025-10-31T19:26:48.549399] [INFO ] [MAIN ] JFR: Loaded 30957 existing records. [2025-10-31T19:26:48.739075] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:26:48.739439] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-31T19:26:48.739619] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-31T19:26:48.740058] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-31T19:26:48.740144] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-31T19:26:49.060889] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-31T19:26:49.062881] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-31T19:26:49.166985] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:49.320102] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T19:26:49.857664] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-31T19:26:50.454447] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T19:26:50.657612] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-31T19:26:51.030279] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T19:26:51.457739] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-31T19:26:51.863267] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T19:26:52.257682] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-31T19:26:52.550627] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T19:26:53.057666] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-31T19:26:53.602073] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T19:26:53.857636] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-31T19:26:54.134734] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T19:26:54.657677] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-31T19:26:55.018713] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T19:26:55.457613] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-31T19:26:55.634319] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T19:26:56.257673] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-31T19:26:56.732795] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T19:26:56.746511] [INFO ] [REMOTE ] JELD: Full fetch complete (64465 records). [2025-10-31T19:26:56.746695] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-31T19:26:57.062817] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-31T19:26:57.129826] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-31T19:26:57.129897] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-31T19:26:57.130780] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-31T19:26:57.130841] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-31T19:26:57.132084] [DEBUG] [LOCAL ] JELD: Trimmed 64465 records to 46026 (keeping 200 days of data) [2025-10-31T19:26:57.381922] [DEBUG] [LOCAL ] JELD: Primary data saved (46026 records). [2025-10-31T19:26:57.382044] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-31T19:26:57.382708] [INFO ] [MAIN ] Update Progress: 1147/2365 symbols completed. JELD took 24.1s. Estimated remaining: 2h 35m 59s. Rate: 7.8 symbols/min [2025-10-31T19:26:57.557799] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:26:57.573138] [DEBUG] [LOCAL ] JGH: Loaded 12346 existing records from primary storage. [2025-10-31T19:26:57.573561] [INFO ] [MAIN ] JGH: Loaded 12346 existing records. [2025-10-31T19:26:57.786511] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:26:57.788987] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-31T19:26:57.789098] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-31T19:26:57.800492] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-31T19:26:57.801170] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-31T19:26:57.801274] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-31T19:26:57.863123] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-31T19:26:58.150160] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:26:58.396618] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-31T19:26:58.657617] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-31T19:26:58.862955] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-31T19:26:59.457701] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-31T19:26:59.759110] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T19:27:00.029252] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-31T19:27:00.257682] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-31T19:27:01.057681] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-31T19:27:01.480712] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T19:27:01.830334] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T19:27:01.857690] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-31T19:27:02.657718] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-31T19:27:03.438418] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T19:27:03.452209] [INFO ] [REMOTE ] JEF: Full fetch complete (73276 records). [2025-10-31T19:27:03.452382] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-31T19:27:03.465108] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-31T19:27:03.819680] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T19:27:03.977679] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-31T19:27:03.986999] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-31T19:27:03.991511] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-31T19:27:03.988751] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-31T19:27:03.992016] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-31T19:27:03.997046] [DEBUG] [LOCAL ] JEF: Trimmed 73276 records to 50888 (keeping 200 days of data) [2025-10-31T19:27:04.279522] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-31T19:27:04.416910] [DEBUG] [LOCAL ] JEF: Primary data saved (50888 records). [2025-10-31T19:27:04.417093] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-31T19:27:04.417219] [INFO ] [MAIN ] Update Progress: 1148/2365 symbols completed. JEF took 36.0s. Estimated remaining: 2h 35m 50s. Rate: 7.8 symbols/min [2025-10-31T19:27:04.660011] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:27:04.704171] [DEBUG] [LOCAL ] JHG: Loaded 47816 existing records from primary storage. [2025-10-31T19:27:04.704490] [INFO ] [MAIN ] JHG: Loaded 47816 existing records. [2025-10-31T19:27:04.905951] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:27:04.906180] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-31T19:27:04.906250] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-31T19:27:04.906431] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-31T19:27:04.906468] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-31T19:27:05.058041] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-31T19:27:05.276190] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:27:05.293099] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T19:27:05.857633] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-31T19:27:06.374938] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T19:27:06.657621] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-31T19:27:06.821427] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T19:27:07.068460] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-31T19:27:07.457677] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-31T19:27:08.257688] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-31T19:27:08.619495] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T19:27:08.978308] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-31T19:27:09.057671] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-31T19:27:09.857707] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-31T19:27:09.970801] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T19:27:10.657712] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-31T19:27:10.858500] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-31T19:27:11.457668] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-31T19:27:11.782366] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T19:27:11.790868] [INFO ] [REMOTE ] JFR: Full fetch complete (48380 records). [2025-10-31T19:27:11.790976] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-31T19:27:12.165561] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-31T19:27:12.165720] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-31T19:27:12.166734] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-31T19:27:12.166801] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-31T19:27:12.167952] [DEBUG] [LOCAL ] JFR: Trimmed 48380 records to 31240 (keeping 200 days of data) [2025-10-31T19:27:12.264799] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-31T19:27:12.355283] [DEBUG] [LOCAL ] JFR: Primary data saved (31240 records). [2025-10-31T19:27:12.355408] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-31T19:27:12.355510] [INFO ] [MAIN ] Update Progress: 1149/2365 symbols completed. JFR took 24.0s. Estimated remaining: 2h 35m 43s. Rate: 7.8 symbols/min [2025-10-31T19:27:12.530327] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:27:12.535838] [DEBUG] [LOCAL ] JHI: Loaded 4077 existing records from primary storage. [2025-10-31T19:27:12.536029] [INFO ] [MAIN ] JHI: Loaded 4077 existing records. [2025-10-31T19:27:12.715070] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:27:12.715541] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-31T19:27:12.715620] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-31T19:27:12.715889] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-31T19:27:12.715976] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-31T19:27:13.041444] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T19:27:13.056581] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-31T19:27:13.062496] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-31T19:27:13.142625] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:27:13.857675] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-31T19:27:14.359102] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-31T19:27:14.467326] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-31T19:27:14.657713] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-31T19:27:15.150845] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-31T19:27:15.457684] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-31T19:27:16.257684] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-31T19:27:16.546717] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-31T19:27:16.777674] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T19:27:17.057631] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-31T19:27:17.355598] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-31T19:27:17.857686] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-31T19:27:18.243759] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-31T19:27:18.657627] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-31T19:27:19.040306] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-31T19:27:19.457617] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-31T19:27:19.814820] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-31T19:27:20.257739] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-31T19:27:20.890402] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T19:27:20.903601] [INFO ] [REMOTE ] JCI: Full fetch complete (77653 records). [2025-10-31T19:27:20.903841] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-31T19:27:21.064531] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-31T19:27:21.317160] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-31T19:27:21.317238] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-31T19:27:21.318254] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-31T19:27:21.318317] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-31T19:27:21.319703] [DEBUG] [LOCAL ] JCI: Trimmed 77653 records to 54284 (keeping 200 days of data) [2025-10-31T19:27:21.663070] [DEBUG] [LOCAL ] JCI: Primary data saved (54284 records). [2025-10-31T19:27:21.663942] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-31T19:27:21.664026] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-31T19:27:21.667060] [INFO ] [MAIN ] Update Progress: 1150/2365 symbols completed. JCI took 59.3s. Estimated remaining: 2h 35m 37s. Rate: 7.8 symbols/min [2025-10-31T19:27:21.839371] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:27:21.843737] [DEBUG] [LOCAL ] JHS: Loaded 2990 existing records from primary storage. [2025-10-31T19:27:21.843910] [INFO ] [MAIN ] JHS: Loaded 2990 existing records. [2025-10-31T19:27:21.864444] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-31T19:27:22.024540] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:27:22.024797] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-31T19:27:22.024848] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-31T19:27:22.025037] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-31T19:27:22.025093] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-31T19:27:22.372407] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:27:22.514874] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-31T19:27:22.657625] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-31T19:27:23.204843] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-31T19:27:23.457617] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-31T19:27:24.257689] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-31T19:27:24.672298] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-31T19:27:24.701283] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-31T19:27:25.057704] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-31T19:27:25.413877] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-31T19:27:25.857684] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-31T19:27:26.657669] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-31T19:27:26.947562] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T19:27:27.021109] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-31T19:27:27.457702] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-31T19:27:27.840751] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-31T19:27:28.257718] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-31T19:27:28.600719] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-31T19:27:29.057713] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-31T19:27:29.448549] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-31T19:27:29.857680] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-31T19:27:30.657718] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-31T19:27:31.015087] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-31T19:27:31.113501] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-31T19:27:31.457680] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-31T19:27:32.257699] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-31T19:27:32.600870] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T19:27:32.617110] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-31T19:27:33.057620] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-31T19:27:33.485959] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T19:27:33.857716] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-31T19:27:34.657737] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-31T19:27:34.952770] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-31T19:27:35.041830] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T19:27:35.457689] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-31T19:27:36.249028] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-31T19:27:36.254073] [INFO ] [REMOTE ] JGH: Full fetch complete (16546 records). [2025-10-31T19:27:36.254147] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-31T19:27:36.265860] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-31T19:27:36.635349] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-31T19:27:36.635103] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-31T19:27:36.635722] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-31T19:27:36.637922] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-31T19:27:36.637988] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-31T19:27:36.638867] [DEBUG] [LOCAL ] JGH: Trimmed 16546 records to 12433 (keeping 200 days of data) [2025-10-31T19:27:36.715228] [DEBUG] [LOCAL ] JGH: Primary data saved (12433 records). [2025-10-31T19:27:36.715374] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-31T19:27:36.715455] [INFO ] [MAIN ] Update Progress: 1151/2365 symbols completed. JGH took 39.3s. Estimated remaining: 2h 35m 37s. Rate: 7.8 symbols/min [2025-10-31T19:27:36.887404] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:27:36.935051] [DEBUG] [LOCAL ] JHX: Loaded 53572 existing records from primary storage. [2025-10-31T19:27:36.935346] [INFO ] [MAIN ] JHX: Loaded 53572 existing records. [2025-10-31T19:27:37.071630] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-31T19:27:37.112097] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:27:37.112466] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-31T19:27:37.112520] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-31T19:27:37.113409] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-31T19:27:37.113467] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-31T19:27:37.469260] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:27:37.565124] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-31T19:27:37.857704] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-31T19:27:38.253460] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-31T19:27:38.657704] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-31T19:27:39.457693] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-31T19:27:39.933104] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-31T19:27:39.934387] [INFO ] [REMOTE ] JHS: Full fetch complete (4601 records). [2025-10-31T19:27:39.934453] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-31T19:27:40.262311] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-31T19:27:40.262406] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-31T19:27:40.340513] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-31T19:27:40.340604] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-31T19:27:40.340810] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-31T19:27:40.340886] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-31T19:27:40.341013] [INFO ] [REMOTE ] JHG: Full fetch complete (68882 records). [2025-10-31T19:27:40.341554] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-31T19:27:40.341886] [DEBUG] [LOCAL ] JHS: Trimmed 4601 records to 2996 (keeping 200 days of data) [2025-10-31T19:27:40.462409] [DEBUG] [LOCAL ] JHS: Primary data saved (2996 records). [2025-10-31T19:27:40.462618] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-31T19:27:40.468484] [INFO ] [MAIN ] Update Progress: 1152/2365 symbols completed. JHS took 18.8s. Estimated remaining: 2h 35m 25s. Rate: 7.8 symbols/min [2025-10-31T19:27:40.839706] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:27:40.938515] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T19:27:40.941991] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-31T19:27:40.942128] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-31T19:27:40.944408] [INFO ] [REMOTE ] JHI: Full fetch complete (5834 records). [2025-10-31T19:27:40.944671] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-31T19:27:40.945780] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-31T19:27:40.980916] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-31T19:27:41.019691] [DEBUG] [LOCAL ] JILL: Loaded 14990 existing records from primary storage. [2025-10-31T19:27:41.042036] [INFO ] [MAIN ] JILL: Loaded 14990 existing records. [2025-10-31T19:27:41.065135] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-31T19:27:41.082535] [DEBUG] [LOCAL ] JHG: Trimmed 68882 records to 48170 (keeping 200 days of data) [2025-10-31T19:27:41.581299] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:27:41.666875] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-31T19:27:41.667196] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-31T19:27:41.668689] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-31T19:27:41.668966] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-31T19:27:41.675140] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-31T19:27:41.675219] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-31T19:27:41.676095] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-31T19:27:41.676300] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-31T19:27:41.676233] [DEBUG] [LOCAL ] JHI: Trimmed 5834 records to 4111 (keeping 200 days of data) [2025-10-31T19:27:41.917814] [DEBUG] [LOCAL ] JHI: Primary data saved (4111 records). [2025-10-31T19:27:41.931305] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-31T19:27:41.935439] [INFO ] [MAIN ] Update Progress: 1153/2365 symbols completed. JHI took 29.6s. Estimated remaining: 2h 35m 11s. Rate: 7.8 symbols/min [2025-10-31T19:27:42.228344] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T19:27:42.292480] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-31T19:27:42.366343] [DEBUG] [LOCAL ] JHG: Primary data saved (48170 records). [2025-10-31T19:27:42.403547] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-31T19:27:42.403766] [INFO ] [MAIN ] Update Progress: 1154/2365 symbols completed. JHG took 38.0s. Estimated remaining: 2h 34m 56s. Rate: 7.8 symbols/min [2025-10-31T19:27:42.412470] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:27:42.585370] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:27:42.660666] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-31T19:27:42.680958] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:27:42.694550] [DEBUG] [LOCAL ] JKS: Loaded 38990 existing records from primary storage. [2025-10-31T19:27:42.694949] [INFO ] [MAIN ] JKS: Loaded 38990 existing records. [2025-10-31T19:27:42.908852] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:27:42.909142] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-31T19:27:42.909223] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-31T19:27:42.910680] [DEBUG] [LOCAL ] JLL: Loaded 30997 existing records from primary storage. [2025-10-31T19:27:42.910768] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-31T19:27:42.910895] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-31T19:27:42.932349] [INFO ] [MAIN ] JLL: Loaded 30997 existing records. [2025-10-31T19:27:43.044198] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T19:27:43.414858] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:27:43.443446] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-31T19:27:43.449130] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-31T19:27:43.461592] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-31T19:27:43.449427] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T19:27:43.478003] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-31T19:27:43.504068] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-31T19:27:43.507007] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:27:43.851704] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:27:44.257623] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-31T19:27:44.326767] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-31T19:27:45.057617] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-31T19:27:45.114112] [DEBUG] [REMOTE ] JHX: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-31T19:27:45.114294] [WARN ] [REMOTE ] JHX: No data returned for month 2025-04 [2025-10-31T19:27:45.114378] [FATAL] [REMOTE ] JHX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:27:45.114451] [FATAL] [MAIN ] JHX: Failed to fetch primary data. [2025-10-31T19:27:45.114511] [WARN ] [MAIN ] JHX: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:27:45.114586] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-31T19:27:45.114675] [DEBUG] [LOCAL ] JHX: No primary data file found to delete. [2025-10-31T19:27:45.114753] [INFO ] [LOCAL ] JHX: Starting deletion of derivative data. [2025-10-31T19:27:45.114923] [DEBUG] [LOCAL ] JHX: Deleted derivative data file. [2025-10-31T19:27:45.115335] [INFO ] [MAIN ] Update Progress: 1155/2365 symbols completed. JHX took 8.4s. Estimated remaining: 2h 34m 43s. Rate: 7.8 symbols/min [2025-10-31T19:27:45.293392] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:27:45.300864] [DEBUG] [LOCAL ] JLS: Loaded 3891 existing records from primary storage. [2025-10-31T19:27:45.301068] [INFO ] [MAIN ] JLS: Loaded 3891 existing records. [2025-10-31T19:27:45.485723] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:27:45.486081] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-31T19:27:45.486264] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-31T19:27:45.486569] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-31T19:27:45.486638] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-31T19:27:45.693760] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-31T19:27:45.870975] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-31T19:27:45.911762] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:27:46.657694] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-31T19:27:47.023875] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-31T19:27:47.047540] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T19:27:47.457721] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-31T19:27:48.257727] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-31T19:27:48.673284] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T19:27:48.788421] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T19:27:49.057703] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-31T19:27:49.857716] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-31T19:27:50.320175] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T19:27:50.536376] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-31T19:27:50.657670] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-31T19:27:51.457709] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-31T19:27:51.764286] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T19:27:51.822466] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-31T19:27:52.257768] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-31T19:27:53.057737] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-31T19:27:53.339257] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-31T19:27:53.406136] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-31T19:27:53.857727] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-31T19:27:54.284763] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T19:27:54.657702] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-31T19:27:55.457672] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-31T19:27:55.743984] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T19:27:56.130872] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-31T19:27:56.257670] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-31T19:27:56.892914] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T19:27:57.057639] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-31T19:27:57.857686] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-31T19:27:58.057583] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T19:27:58.545930] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T19:27:58.657705] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-31T19:27:59.247450] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-31T19:27:59.457683] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-31T19:28:00.257614] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-31T19:28:00.446198] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T19:28:00.645309] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-31T19:28:01.057714] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-31T19:28:01.857629] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-31T19:28:02.039842] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-31T19:28:02.196525] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-31T19:28:02.657700] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-31T19:28:03.275444] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-31T19:28:03.457715] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-31T19:28:04.085530] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T19:28:04.257667] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-31T19:28:05.057634] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-31T19:28:05.144510] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T19:28:05.734231] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T19:28:05.737508] [INFO ] [REMOTE ] JILL: Full fetch complete (22133 records). [2025-10-31T19:28:05.737582] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-31T19:28:05.862760] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-31T19:28:06.109131] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-31T19:28:06.109210] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-31T19:28:06.109739] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-31T19:28:06.109802] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-31T19:28:06.110405] [DEBUG] [LOCAL ] JILL: Trimmed 22133 records to 15090 (keeping 200 days of data) [2025-10-31T19:28:06.206950] [DEBUG] [LOCAL ] JILL: Primary data saved (15090 records). [2025-10-31T19:28:06.207074] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-31T19:28:06.207155] [INFO ] [MAIN ] Update Progress: 1156/2365 symbols completed. JILL took 25.7s. Estimated remaining: 2h 34m 49s. Rate: 7.8 symbols/min [2025-10-31T19:28:06.377517] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:28:06.429274] [DEBUG] [LOCAL ] JMIA: Loaded 51567 existing records from primary storage. [2025-10-31T19:28:06.429631] [INFO ] [MAIN ] JMIA: Loaded 51567 existing records. [2025-10-31T19:28:06.604662] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:28:06.604887] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-31T19:28:06.604934] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-31T19:28:06.605614] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-31T19:28:06.605709] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-31T19:28:06.667419] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-31T19:28:06.960844] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:28:07.022727] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T19:28:07.105298] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-31T19:28:07.457751] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-31T19:28:08.257687] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-31T19:28:08.602337] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-31T19:28:08.710258] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T19:28:08.719524] [INFO ] [REMOTE ] JKS: Full fetch complete (58500 records). [2025-10-31T19:28:08.719681] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-31T19:28:09.062862] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-31T19:28:09.115221] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-31T19:28:09.115308] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-31T19:28:09.116164] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-31T19:28:09.116225] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-31T19:28:09.117446] [DEBUG] [LOCAL ] JKS: Trimmed 58500 records to 39317 (keeping 200 days of data) [2025-10-31T19:28:09.344865] [DEBUG] [LOCAL ] JKS: Primary data saved (39317 records). [2025-10-31T19:28:09.344965] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-31T19:28:09.345041] [INFO ] [MAIN ] Update Progress: 1157/2365 symbols completed. JKS took 27.4s. Estimated remaining: 2h 34m 37s. Rate: 7.8 symbols/min [2025-10-31T19:28:09.857718] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-31T19:28:10.227765] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-31T19:28:10.456601] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:28:10.657692] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-31T19:28:11.457677] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-31T19:28:11.944707] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T19:28:12.257706] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-31T19:28:12.426254] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T19:28:12.708348] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-31T19:28:12.709931] [INFO ] [REMOTE ] JLS: Full fetch complete (5743 records). [2025-10-31T19:28:12.710003] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-31T19:28:13.062795] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-31T19:28:13.097581] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-31T19:28:13.097721] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-31T19:28:13.098010] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-31T19:28:13.098073] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-31T19:28:13.098830] [DEBUG] [LOCAL ] JLS: Trimmed 5743 records to 3911 (keeping 200 days of data) [2025-10-31T19:28:13.125051] [DEBUG] [LOCAL ] JLS: Primary data saved (3911 records). [2025-10-31T19:28:13.125173] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-31T19:28:13.125269] [INFO ] [MAIN ] Update Progress: 1158/2365 symbols completed. JLS took 28.0s. Estimated remaining: 2h 34m 25s. Rate: 7.8 symbols/min [2025-10-31T19:28:13.857691] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-31T19:28:14.148599] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T19:28:14.657737] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-31T19:28:15.112544] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T19:28:15.457667] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-31T19:28:15.484056] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T19:28:16.257693] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-31T19:28:16.771248] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T19:28:17.057732] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-31T19:28:17.328038] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T19:28:17.857676] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-31T19:28:18.360624] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T19:28:18.657620] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-31T19:28:18.685713] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T19:28:19.457741] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-31T19:28:19.855602] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-31T19:28:20.257690] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-31T19:28:20.371176] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T19:28:21.057754] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-31T19:28:21.656171] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T19:28:21.857632] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-31T19:28:22.018282] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-31T19:28:22.024977] [INFO ] [REMOTE ] JLL: Full fetch complete (44885 records). [2025-10-31T19:28:22.025150] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-31T19:28:22.397872] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-31T19:28:22.397960] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-31T19:28:22.398703] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-31T19:28:22.398762] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-31T19:28:22.399692] [DEBUG] [LOCAL ] JLL: Trimmed 44885 records to 31184 (keeping 200 days of data) [2025-10-31T19:28:22.584600] [DEBUG] [LOCAL ] JLL: Primary data saved (31184 records). [2025-10-31T19:28:22.584765] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-31T19:28:22.584858] [INFO ] [MAIN ] Update Progress: 1159/2365 symbols completed. JLL took 40.2s. Estimated remaining: 2h 34m 19s. Rate: 7.8 symbols/min [2025-10-31T19:28:23.373611] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T19:28:23.384841] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-31T19:28:24.982221] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-31T19:28:24.995572] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-31T19:28:26.730928] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-31T19:28:26.752365] [INFO ] [REMOTE ] JMIA: Full fetch complete (73532 records). [2025-10-31T19:28:26.752582] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-31T19:28:27.150839] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-31T19:28:27.150943] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-31T19:28:27.152258] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-31T19:28:27.152337] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-31T19:28:27.154249] [DEBUG] [LOCAL ] JMIA: Trimmed 73532 records to 51936 (keeping 200 days of data) [2025-10-31T19:28:27.452274] [DEBUG] [LOCAL ] JMIA: Primary data saved (51936 records). [2025-10-31T19:28:27.452406] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-31T19:28:27.452484] [INFO ] [MAIN ] Update Progress: 1160/2365 symbols completed. JMIA took 21.2s. Estimated remaining: 2h 34m 8s. Rate: 7.8 symbols/min [2025-10-31T19:28:28.130925] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:28:28.155337] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:28:28.128919] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:28:28.183029] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:28:28.183493] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-31T19:28:28.183536] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-31T19:28:28.183792] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-31T19:28:28.183841] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-31T19:28:28.183884] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-31T19:28:28.183914] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-31T19:28:28.356975] [DEBUG] [LOCAL ] JOE: Loaded 23343 existing records from primary storage. [2025-10-31T19:28:28.384917] [INFO ] [MAIN ] JOE: Loaded 23343 existing records. [2025-10-31T19:28:28.660808] [DEBUG] [LOCAL ] JOBY: Loaded 54200 existing records from primary storage. [2025-10-31T19:28:28.776218] [INFO ] [MAIN ] JOBY: Loaded 54200 existing records. [2025-10-31T19:28:28.771876] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-31T19:28:28.874382] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:28:28.890396] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-10-31T19:28:28.871365] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:28:28.919826] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-31T19:28:28.967097] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-31T19:28:28.998701] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-31T19:28:29.023975] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-31T19:28:29.036135] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-31T19:28:29.190213] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:28:29.237952] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-31T19:28:29.294871] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-31T19:28:29.294726] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-31T19:28:29.327598] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:28:29.327837] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-31T19:28:29.327988] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-31T19:28:29.333556] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-31T19:28:29.333733] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-31T19:28:29.334827] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-31T19:28:29.340065] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-31T19:28:29.379139] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-31T19:28:29.708921] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-31T19:28:29.730180] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-31T19:28:29.988102] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:28:30.049335] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-31T19:28:30.049212] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-31T19:28:30.113469] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-31T19:28:30.337695] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:28:30.353463] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-31T19:28:30.375982] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:28:30.376525] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-31T19:28:30.452810] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-31T19:28:30.454325] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-31T19:28:30.741152] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-31T19:28:30.742446] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-31T19:28:30.955598] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T19:28:30.974836] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-31T19:28:31.457631] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-31T19:28:31.776687] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-31T19:28:32.072987] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-31T19:28:32.257692] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-31T19:28:32.556186] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-31T19:28:33.057721] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-31T19:28:33.338366] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-31T19:28:33.791679] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-31T19:28:33.857628] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-31T19:28:34.657691] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-31T19:28:35.441546] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T19:28:35.462622] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-31T19:28:35.465938] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T19:28:35.750431] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-31T19:28:36.257731] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-31T19:28:37.057681] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-31T19:28:37.857632] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-31T19:28:37.939262] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-31T19:28:37.966565] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-31T19:28:38.145128] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-31T19:28:38.145995] [INFO ] [REMOTE ] JMM: Full fetch complete (2328 records). [2025-10-31T19:28:38.146062] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-31T19:28:38.343247] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-31T19:28:38.343501] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:28:38.343587] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:28:38.343721] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-31T19:28:38.343809] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-31T19:28:38.343856] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-31T19:28:38.343901] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-31T19:28:38.343963] [INFO ] [MAIN ] Update Progress: 1161/2365 symbols completed. JMM took 10.9s. Estimated remaining: 2h 34m 4s. Rate: 7.8 symbols/min [2025-10-31T19:28:38.516859] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:28:38.526014] [DEBUG] [LOCAL ] JOF: Loaded 6959 existing records from primary storage. [2025-10-31T19:28:38.526297] [INFO ] [MAIN ] JOF: Loaded 6959 existing records. [2025-10-31T19:28:38.669316] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-31T19:28:38.711458] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:28:38.712319] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-31T19:28:38.712394] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-31T19:28:38.712568] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-31T19:28:38.712622] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-31T19:28:39.075638] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:28:39.457626] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-31T19:28:40.257763] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-31T19:28:40.612089] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-31T19:28:40.644713] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-31T19:28:41.057685] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-31T19:28:41.100895] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-31T19:28:41.857626] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-31T19:28:41.987081] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-31T19:28:42.208610] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-31T19:28:42.657738] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-31T19:28:43.188477] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-31T19:28:43.457671] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-31T19:28:43.986728] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T19:28:44.257735] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-31T19:28:44.692109] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T19:28:45.057676] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-31T19:28:45.857705] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-31T19:28:46.658510] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-31T19:28:46.663454] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-31T19:28:46.985133] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-31T19:28:47.457701] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-31T19:28:47.524622] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-31T19:28:47.862767] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T19:28:48.257676] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-31T19:28:49.057695] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-31T19:28:49.857616] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-31T19:28:49.922710] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-31T19:28:50.642235] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T19:28:50.657617] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-31T19:28:51.137207] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-31T19:28:51.422420] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-31T19:28:51.457622] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-31T19:28:51.976213] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-31T19:28:52.257670] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-31T19:28:53.057698] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-31T19:28:53.521759] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-31T19:28:53.857732] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-31T19:28:54.247731] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-31T19:28:54.657619] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-31T19:28:54.790223] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-31T19:28:55.457687] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-31T19:28:56.188253] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:28:56.257807] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-31T19:28:56.263404] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-31T19:28:56.834082] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T19:28:56.836309] [INFO ] [REMOTE ] JOF: Full fetch complete (9701 records). [2025-10-31T19:28:56.836377] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-31T19:28:57.062875] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-31T19:28:57.210567] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-31T19:28:57.210671] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-31T19:28:57.210926] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-31T19:28:57.210966] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-31T19:28:57.211385] [DEBUG] [LOCAL ] JOF: Trimmed 9701 records to 7024 (keeping 200 days of data) [2025-10-31T19:28:57.253775] [DEBUG] [LOCAL ] JOF: Primary data saved (7024 records). [2025-10-31T19:28:57.253917] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-31T19:28:57.253996] [INFO ] [MAIN ] Update Progress: 1162/2365 symbols completed. JOF took 18.9s. Estimated remaining: 2h 34m 8s. Rate: 7.8 symbols/min [2025-10-31T19:28:57.429861] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:28:57.462457] [DEBUG] [LOCAL ] JPC: Loaded 36844 existing records from primary storage. [2025-10-31T19:28:57.462793] [INFO ] [MAIN ] JPC: Loaded 36844 existing records. [2025-10-31T19:28:57.642358] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:28:57.642551] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-31T19:28:57.642598] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-31T19:28:57.643215] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-31T19:28:57.643273] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-31T19:28:57.885224] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-31T19:28:58.015437] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:28:58.028454] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T19:28:58.657701] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-31T19:28:59.457626] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-31T19:28:59.666424] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T19:28:59.849132] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-31T19:29:00.257625] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-31T19:29:00.396052] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-31T19:29:00.401561] [INFO ] [REMOTE ] JOE: Full fetch complete (35054 records). [2025-10-31T19:29:00.401729] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-31T19:29:00.811021] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-31T19:29:00.811103] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-31T19:29:00.811763] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-31T19:29:00.811823] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-31T19:29:00.812725] [DEBUG] [LOCAL ] JOE: Trimmed 35054 records to 23537 (keeping 200 days of data) [2025-10-31T19:29:00.954142] [DEBUG] [LOCAL ] JOE: Primary data saved (23537 records). [2025-10-31T19:29:00.954296] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-31T19:29:00.954381] [INFO ] [MAIN ] Update Progress: 1163/2365 symbols completed. JOE took 33.5s. Estimated remaining: 2h 33m 56s. Rate: 7.8 symbols/min [2025-10-31T19:29:01.064543] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-31T19:29:01.141815] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:29:01.192062] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-31T19:29:01.192367] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-10-31T19:29:01.380700] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:29:01.381034] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-31T19:29:01.381100] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-31T19:29:01.381458] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-31T19:29:01.381529] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-31T19:29:01.586442] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-31T19:29:01.853371] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:29:01.857621] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-31T19:29:02.657673] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-31T19:29:03.347820] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-31T19:29:03.457696] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-31T19:29:03.495113] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-31T19:29:03.664803] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-31T19:29:04.257736] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-31T19:29:04.985381] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-31T19:29:05.057688] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-31T19:29:05.681753] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T19:29:05.695230] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-31T19:29:05.695381] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-31T19:29:05.871033] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-31T19:29:06.097883] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-31T19:29:06.098081] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-31T19:29:06.099209] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-31T19:29:06.099340] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-31T19:29:06.100797] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 54533 (keeping 200 days of data) [2025-10-31T19:29:06.218797] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-31T19:29:06.478961] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-10-31T19:29:06.479104] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-31T19:29:06.480274] [INFO ] [MAIN ] Update Progress: 1164/2365 symbols completed. JNJ took 39.0s. Estimated remaining: 2h 33m 46s. Rate: 7.8 symbols/min [2025-10-31T19:29:06.662866] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-31T19:29:06.664909] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:29:06.698855] [DEBUG] [LOCAL ] JQC: Loaded 33527 existing records from primary storage. [2025-10-31T19:29:06.699121] [INFO ] [MAIN ] JQC: Loaded 33527 existing records. [2025-10-31T19:29:06.875793] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:29:06.876000] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-31T19:29:06.876047] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-31T19:29:06.876238] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-31T19:29:06.876282] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-31T19:29:07.229892] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:29:07.457635] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-31T19:29:07.575788] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-31T19:29:08.029828] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-31T19:29:08.257623] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-31T19:29:08.437743] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T19:29:09.057668] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-31T19:29:09.857682] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-31T19:29:10.284999] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-31T19:29:10.657627] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-31T19:29:10.723741] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T19:29:10.799811] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-31T19:29:11.457687] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-31T19:29:12.257674] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-31T19:29:12.424262] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T19:29:12.951624] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-31T19:29:12.964082] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-31T19:29:12.964223] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-31T19:29:13.062829] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-31T19:29:13.371787] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-31T19:29:13.371888] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-31T19:29:13.372893] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-31T19:29:13.372952] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-31T19:29:13.374381] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 54590 (keeping 200 days of data) [2025-10-31T19:29:13.688350] [DEBUG] [LOCAL ] JOBY: Primary data saved (54590 records). [2025-10-31T19:29:13.688492] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-31T19:29:13.688570] [INFO ] [MAIN ] Update Progress: 1165/2365 symbols completed. JOBY took 46.2s. Estimated remaining: 2h 33m 38s. Rate: 7.8 symbols/min [2025-10-31T19:29:13.856123] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:29:13.857625] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-31T19:29:13.874428] [DEBUG] [LOCAL ] JRI: Loaded 15128 existing records from primary storage. [2025-10-31T19:29:13.874679] [INFO ] [MAIN ] JRI: Loaded 15128 existing records. [2025-10-31T19:29:14.070718] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:29:14.071549] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-31T19:29:14.071709] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-31T19:29:14.072429] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-31T19:29:14.072611] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-31T19:29:14.328266] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T19:29:14.552181] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-31T19:29:14.559345] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:29:14.657624] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-31T19:29:14.788325] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-31T19:29:15.457675] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-31T19:29:16.244631] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-31T19:29:16.257598] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-31T19:29:16.324991] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T19:29:17.057636] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-31T19:29:17.857617] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-31T19:29:17.948745] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T19:29:17.990020] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-31T19:29:18.574070] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T19:29:18.657625] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-31T19:29:19.457669] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-31T19:29:19.520890] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-31T19:29:20.257671] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-31T19:29:20.454736] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-31T19:29:21.057683] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-31T19:29:21.616209] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-31T19:29:21.857629] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-31T19:29:22.192483] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-31T19:29:22.657678] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-31T19:29:22.887321] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T19:29:23.457718] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-31T19:29:23.846803] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T19:29:24.257707] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-31T19:29:24.566926] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:29:25.057679] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-31T19:29:25.831627] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-31T19:29:25.857624] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-31T19:29:26.024456] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-31T19:29:26.657711] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-31T19:29:27.044878] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T19:29:27.053831] [INFO ] [REMOTE ] JPC: Full fetch complete (54795 records). [2025-10-31T19:29:27.053948] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-31T19:29:27.425720] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-31T19:29:27.425802] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-31T19:29:27.426686] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-31T19:29:27.426748] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-31T19:29:27.427774] [DEBUG] [LOCAL ] JPC: Trimmed 54795 records to 37151 (keeping 200 days of data) [2025-10-31T19:29:27.474118] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-31T19:29:27.643047] [DEBUG] [LOCAL ] JPC: Primary data saved (37151 records). [2025-10-31T19:29:27.643179] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-31T19:29:27.643710] [INFO ] [MAIN ] Update Progress: 1166/2365 symbols completed. JPC took 30.4s. Estimated remaining: 2h 33m 37s. Rate: 7.8 symbols/min [2025-10-31T19:29:27.810933] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:29:27.823886] [DEBUG] [LOCAL ] JRS: Loaded 11528 existing records from primary storage. [2025-10-31T19:29:27.824128] [INFO ] [MAIN ] JRS: Loaded 11528 existing records. [2025-10-31T19:29:27.997766] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:29:27.997983] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-31T19:29:27.998034] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-31T19:29:27.998219] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-31T19:29:27.998258] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-31T19:29:28.263669] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-31T19:29:28.358919] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:29:28.404246] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-31T19:29:28.436679] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-31T19:29:28.933291] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-31T19:29:29.057673] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-31T19:29:29.673723] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-31T19:29:29.857664] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-31T19:29:30.418693] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-31T19:29:30.657687] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-31T19:29:31.297083] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-31T19:29:31.310912] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-31T19:29:31.311091] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-31T19:29:31.462955] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-31T19:29:31.801985] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-31T19:29:31.802143] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-31T19:29:31.803964] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-31T19:29:31.804053] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-31T19:29:31.805954] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 54574 (keeping 200 days of data) [2025-10-31T19:29:32.260550] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-31T19:29:32.294819] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-10-31T19:29:32.294989] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-31T19:29:32.295082] [INFO ] [MAIN ] Update Progress: 1167/2365 symbols completed. JPM took 31.3s. Estimated remaining: 2h 33m 26s. Rate: 7.8 symbols/min [2025-10-31T19:29:32.520041] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:29:32.571992] [DEBUG] [LOCAL ] JXN: Loaded 43882 existing records from primary storage. [2025-10-31T19:29:32.572301] [INFO ] [MAIN ] JXN: Loaded 43882 existing records. [2025-10-31T19:29:32.758280] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:29:32.759356] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-31T19:29:32.767175] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-31T19:29:32.780341] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-31T19:29:32.780702] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-31T19:29:32.837198] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-31T19:29:32.851387] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T19:29:32.868488] [INFO ] [REMOTE ] JQC: Full fetch complete (49634 records). [2025-10-31T19:29:32.885520] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-31T19:29:33.058883] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-31T19:29:33.561583] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:29:33.578912] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-31T19:29:33.578997] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-31T19:29:33.579810] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-31T19:29:33.579872] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-31T19:29:33.581035] [DEBUG] [LOCAL ] JQC: Trimmed 49634 records to 33804 (keeping 200 days of data) [2025-10-31T19:29:33.787383] [DEBUG] [LOCAL ] JQC: Primary data saved (33804 records). [2025-10-31T19:29:33.788355] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-31T19:29:33.789564] [INFO ] [MAIN ] Update Progress: 1168/2365 symbols completed. JQC took 27.3s. Estimated remaining: 2h 33m 12s. Rate: 7.8 symbols/min [2025-10-31T19:29:33.788798] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T19:29:33.864214] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-31T19:29:33.967329] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:29:34.015747] [DEBUG] [LOCAL ] K: Loaded 50625 existing records from primary storage. [2025-10-31T19:29:34.016055] [INFO ] [MAIN ] K: Loaded 50625 existing records. [2025-10-31T19:29:34.191334] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:29:34.191564] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-31T19:29:34.191610] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-31T19:29:34.192238] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-31T19:29:34.192293] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-31T19:29:34.547806] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:29:34.563450] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T19:29:34.657700] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-31T19:29:35.457708] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-31T19:29:35.854518] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T19:29:36.019469] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-31T19:29:36.257691] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-31T19:29:36.753302] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T19:29:37.057694] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-31T19:29:37.857665] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-31T19:29:38.259072] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-31T19:29:38.382387] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-31T19:29:38.657675] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-31T19:29:39.195149] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-31T19:29:39.457704] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-31T19:29:40.257713] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-31T19:29:40.553153] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T19:29:40.920535] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T19:29:41.057693] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-31T19:29:41.585212] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T19:29:41.857722] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-31T19:29:42.657695] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-31T19:29:43.105664] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-31T19:29:43.390068] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-31T19:29:43.394063] [INFO ] [REMOTE ] JRI: Full fetch complete (22563 records). [2025-10-31T19:29:43.394147] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-31T19:29:43.462964] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-31T19:29:43.760924] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-31T19:29:43.761002] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-31T19:29:43.761491] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-31T19:29:43.761536] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-31T19:29:43.762138] [DEBUG] [LOCAL ] JRI: Trimmed 22563 records to 15232 (keeping 200 days of data) [2025-10-31T19:29:43.851692] [DEBUG] [LOCAL ] JRI: Primary data saved (15232 records). [2025-10-31T19:29:43.851828] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-31T19:29:43.851903] [INFO ] [MAIN ] Update Progress: 1169/2365 symbols completed. JRI took 30.2s. Estimated remaining: 2h 33m 7s. Rate: 7.8 symbols/min [2025-10-31T19:29:44.023629] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:29:44.038239] [DEBUG] [LOCAL ] KAI: Loaded 13407 existing records from primary storage. [2025-10-31T19:29:44.038451] [INFO ] [MAIN ] KAI: Loaded 13407 existing records. [2025-10-31T19:29:44.217174] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:29:44.217424] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-31T19:29:44.217471] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-31T19:29:44.217628] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-31T19:29:44.217736] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-31T19:29:44.262790] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-31T19:29:44.589597] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:29:44.646943] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T19:29:44.970788] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-31T19:29:45.057683] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-31T19:29:45.720094] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T19:29:45.857684] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-31T19:29:46.657686] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-31T19:29:47.071877] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T19:29:47.140379] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-31T19:29:47.457691] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-31T19:29:48.065100] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-31T19:29:48.257729] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-31T19:29:49.057673] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-31T19:29:49.510190] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T19:29:49.857678] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-31T19:29:50.064550] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-31T19:29:50.599876] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-31T19:29:50.603147] [INFO ] [REMOTE ] JRS: Full fetch complete (16141 records). [2025-10-31T19:29:50.603222] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-31T19:29:50.662877] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-31T19:29:50.987294] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-31T19:29:50.987395] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-31T19:29:50.987796] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-31T19:29:50.987889] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-31T19:29:50.988373] [DEBUG] [LOCAL ] JRS: Trimmed 16141 records to 11587 (keeping 200 days of data) [2025-10-31T19:29:51.055291] [DEBUG] [LOCAL ] JRS: Primary data saved (11587 records). [2025-10-31T19:29:51.055418] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-31T19:29:51.055494] [INFO ] [MAIN ] Update Progress: 1170/2365 symbols completed. JRS took 23.4s. Estimated remaining: 2h 32m 59s. Rate: 7.8 symbols/min [2025-10-31T19:29:51.219708] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:29:51.254596] [DEBUG] [LOCAL ] KAR: Loaded 39836 existing records from primary storage. [2025-10-31T19:29:51.254896] [INFO ] [MAIN ] KAR: Loaded 39836 existing records. [2025-10-31T19:29:51.429743] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:29:51.430025] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-31T19:29:51.430082] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-31T19:29:51.430993] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-31T19:29:51.431054] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-31T19:29:51.462867] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-31T19:29:51.792907] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:29:52.082152] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T19:29:52.126306] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-31T19:29:52.257685] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-31T19:29:52.953633] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-31T19:29:53.057666] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-31T19:29:53.707600] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T19:29:53.857688] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-31T19:29:54.657712] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-31T19:29:55.070364] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T19:29:55.419050] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-31T19:29:55.457614] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-31T19:29:56.257698] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-31T19:29:56.386308] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T19:29:57.055611] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-31T19:29:57.059606] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-31T19:29:57.857623] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-31T19:29:58.253913] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T19:29:58.494132] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-31T19:29:58.657673] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-31T19:29:59.335084] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T19:29:59.457674] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-31T19:30:00.022147] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-31T19:30:00.257720] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-31T19:30:01.057711] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-31T19:30:01.452025] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T19:30:01.510331] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-31T19:30:01.857693] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-31T19:30:02.657672] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-31T19:30:03.276433] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-31T19:30:03.457680] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-31T19:30:03.810789] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T19:30:04.257698] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-31T19:30:04.610068] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T19:30:05.057630] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-31T19:30:05.262457] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-31T19:30:05.527874] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T19:30:05.857668] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-31T19:30:06.657637] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-31T19:30:06.748164] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-31T19:30:06.752191] [INFO ] [REMOTE ] KAI: Full fetch complete (19689 records). [2025-10-31T19:30:06.752314] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-31T19:30:07.133150] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-31T19:30:07.133227] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-31T19:30:07.133703] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-31T19:30:07.133766] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-31T19:30:07.134376] [DEBUG] [LOCAL ] KAI: Trimmed 19689 records to 13540 (keeping 200 days of data) [2025-10-31T19:30:07.217983] [DEBUG] [LOCAL ] KAI: Primary data saved (13540 records). [2025-10-31T19:30:07.218113] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-31T19:30:07.218188] [INFO ] [MAIN ] Update Progress: 1171/2365 symbols completed. KAI took 23.4s. Estimated remaining: 2h 32m 60s. Rate: 7.8 symbols/min [2025-10-31T19:30:07.392501] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:30:07.412837] [DEBUG] [LOCAL ] KB: Loaded 22655 existing records from primary storage. [2025-10-31T19:30:07.413109] [INFO ] [MAIN ] KB: Loaded 22655 existing records. [2025-10-31T19:30:07.459926] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-31T19:30:07.635587] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:30:07.636342] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-31T19:30:07.636437] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-31T19:30:07.636963] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-31T19:30:07.637027] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-31T19:30:07.822378] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T19:30:08.056426] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:30:08.257676] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-31T19:30:08.897456] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T19:30:09.018987] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-31T19:30:09.057619] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-31T19:30:09.857695] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-31T19:30:09.917976] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-31T19:30:10.657689] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-31T19:30:10.943458] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T19:30:11.457623] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-31T19:30:11.578797] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T19:30:12.257624] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-31T19:30:12.386082] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-31T19:30:13.057630] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-31T19:30:13.763679] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-31T19:30:13.776980] [INFO ] [REMOTE ] K: Full fetch complete (72290 records). [2025-10-31T19:30:13.777228] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-31T19:30:13.865036] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-31T19:30:14.220904] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-31T19:30:14.221115] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-31T19:30:14.222534] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-31T19:30:14.222776] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-31T19:30:14.224957] [DEBUG] [LOCAL ] K: Trimmed 72290 records to 50992 (keeping 200 days of data) [2025-10-31T19:30:14.486525] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T19:30:14.598534] [DEBUG] [LOCAL ] K: Primary data saved (50992 records). [2025-10-31T19:30:14.598816] [INFO ] [MAIN ] K: Full history saved. [2025-10-31T19:30:14.599611] [INFO ] [MAIN ] Update Progress: 1172/2365 symbols completed. K took 40.8s. Estimated remaining: 2h 32m 52s. Rate: 7.8 symbols/min [2025-10-31T19:30:14.662729] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-31T19:30:14.771920] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:30:14.787317] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T19:30:14.815782] [DEBUG] [LOCAL ] KBDC: Loaded 22864 existing records from primary storage. [2025-10-31T19:30:14.816064] [INFO ] [MAIN ] KBDC: Loaded 22864 existing records. [2025-10-31T19:30:15.015778] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:30:15.016042] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-31T19:30:15.016096] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-31T19:30:15.016705] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-31T19:30:15.016769] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-31T19:30:15.375311] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:30:15.457689] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-31T19:30:15.823165] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T19:30:16.262972] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-31T19:30:16.267339] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-31T19:30:16.937986] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T19:30:17.057677] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-31T19:30:17.857718] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-31T19:30:18.081427] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T19:30:18.384041] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T19:30:18.657699] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-31T19:30:19.457692] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-31T19:30:19.611886] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-31T19:30:20.257708] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-31T19:30:20.713722] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T19:30:20.724202] [INFO ] [REMOTE ] JXN: Full fetch complete (65003 records). [2025-10-31T19:30:20.724344] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-31T19:30:21.068778] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-31T19:30:21.126451] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-31T19:30:21.126594] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-31T19:30:21.127533] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-31T19:30:21.127609] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-31T19:30:21.128932] [DEBUG] [LOCAL ] JXN: Trimmed 65003 records to 44191 (keeping 200 days of data) [2025-10-31T19:30:21.365576] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:30:21.430570] [DEBUG] [LOCAL ] JXN: Primary data saved (44191 records). [2025-10-31T19:30:21.430728] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-31T19:30:21.430819] [INFO ] [MAIN ] Update Progress: 1173/2365 symbols completed. JXN took 49.1s. Estimated remaining: 2h 32m 43s. Rate: 7.8 symbols/min [2025-10-31T19:30:21.607173] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:30:21.647461] [DEBUG] [LOCAL ] KBH: Loaded 48840 existing records from primary storage. [2025-10-31T19:30:21.647785] [INFO ] [MAIN ] KBH: Loaded 48840 existing records. [2025-10-31T19:30:21.860245] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-31T19:30:21.868034] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:30:21.869012] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-31T19:30:21.869149] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-31T19:30:21.869982] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-31T19:30:21.870042] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-31T19:30:22.158584] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T19:30:22.265801] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:30:22.657662] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-31T19:30:23.307409] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-31T19:30:23.316938] [INFO ] [REMOTE ] KAR: Full fetch complete (57160 records). [2025-10-31T19:30:23.317086] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-31T19:30:23.458742] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-31T19:30:23.635838] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-31T19:30:23.759101] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-31T19:30:23.759182] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-31T19:30:23.760019] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-31T19:30:23.760080] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-31T19:30:23.761188] [DEBUG] [LOCAL ] KAR: Trimmed 57160 records to 40108 (keeping 200 days of data) [2025-10-31T19:30:23.984130] [DEBUG] [LOCAL ] KAR: Primary data saved (40108 records). [2025-10-31T19:30:23.984245] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-31T19:30:23.984826] [INFO ] [MAIN ] Update Progress: 1174/2365 symbols completed. KAR took 32.9s. Estimated remaining: 2h 32m 30s. Rate: 7.8 symbols/min [2025-10-31T19:30:24.152422] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:30:24.199078] [DEBUG] [LOCAL ] KBR: Loaded 48323 existing records from primary storage. [2025-10-31T19:30:24.199370] [INFO ] [MAIN ] KBR: Loaded 48323 existing records. [2025-10-31T19:30:24.259341] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-31T19:30:24.411986] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:30:24.412331] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-31T19:30:24.412492] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-31T19:30:24.418577] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-31T19:30:24.426543] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-31T19:30:24.432854] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T19:30:24.787722] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:30:25.057616] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-31T19:30:25.591607] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T19:30:25.845428] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-31T19:30:25.857598] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-31T19:30:26.528326] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-31T19:30:26.657905] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-31T19:30:27.457763] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-31T19:30:27.813732] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-31T19:30:28.051772] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T19:30:28.257633] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-31T19:30:28.889213] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-31T19:30:29.057676] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-31T19:30:29.725894] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-31T19:30:29.857711] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-31T19:30:30.642308] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T19:30:30.646504] [INFO ] [REMOTE ] KB: Full fetch complete (33069 records). [2025-10-31T19:30:30.646582] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-31T19:30:30.666939] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-31T19:30:31.013949] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-31T19:30:31.014023] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-31T19:30:31.014623] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-31T19:30:31.014695] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-31T19:30:31.015495] [DEBUG] [LOCAL ] KB: Trimmed 33069 records to 22759 (keeping 200 days of data) [2025-10-31T19:30:31.148664] [DEBUG] [LOCAL ] KB: Primary data saved (22759 records). [2025-10-31T19:30:31.148780] [INFO ] [MAIN ] KB: Full history saved. [2025-10-31T19:30:31.148855] [INFO ] [MAIN ] Update Progress: 1175/2365 symbols completed. KB took 23.9s. Estimated remaining: 2h 32m 22s. Rate: 7.8 symbols/min [2025-10-31T19:30:31.329196] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:30:31.377502] [DEBUG] [LOCAL ] KD: Loaded 52662 existing records from primary storage. [2025-10-31T19:30:31.377828] [INFO ] [MAIN ] KD: Loaded 52662 existing records. [2025-10-31T19:30:31.460886] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-31T19:30:31.529828] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T19:30:31.584033] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:30:31.584213] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-31T19:30:31.584259] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-31T19:30:31.584460] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-31T19:30:31.584539] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-31T19:30:31.934601] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:30:32.257694] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-31T19:30:32.665472] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T19:30:32.942226] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T19:30:33.057703] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-31T19:30:33.857703] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-31T19:30:34.111584] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-31T19:30:34.657715] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-31T19:30:34.712382] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-31T19:30:35.457679] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-31T19:30:35.878759] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T19:30:36.257671] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-31T19:30:36.848903] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:30:37.057703] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-31T19:30:37.399283] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T19:30:37.857667] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-31T19:30:38.292406] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T19:30:38.657692] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-31T19:30:38.923877] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T19:30:38.931297] [INFO ] [REMOTE ] KBDC: Full fetch complete (31761 records). [2025-10-31T19:30:38.931389] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-31T19:30:39.306494] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-31T19:30:39.306569] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-31T19:30:39.307284] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-31T19:30:39.307347] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-31T19:30:39.308178] [DEBUG] [LOCAL ] KBDC: Trimmed 31761 records to 23147 (keeping 200 days of data) [2025-10-31T19:30:39.444888] [DEBUG] [LOCAL ] KBDC: Primary data saved (23147 records). [2025-10-31T19:30:39.445004] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-31T19:30:39.445079] [INFO ] [MAIN ] Update Progress: 1176/2365 symbols completed. KBDC took 24.8s. Estimated remaining: 2h 32m 15s. Rate: 7.8 symbols/min [2025-10-31T19:30:39.462923] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-31T19:30:39.634076] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:30:39.640216] [DEBUG] [LOCAL ] KEN: Loaded 4169 existing records from primary storage. [2025-10-31T19:30:39.640376] [INFO ] [MAIN ] KEN: Loaded 4169 existing records. [2025-10-31T19:30:39.830061] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:30:39.830341] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-31T19:30:39.830430] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-31T19:30:39.830682] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-31T19:30:39.830792] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-31T19:30:40.210308] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-31T19:30:40.239105] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:30:40.257638] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-31T19:30:40.709745] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T19:30:41.057738] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-31T19:30:41.633391] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T19:30:41.857681] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-31T19:30:42.618142] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-31T19:30:42.657614] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-31T19:30:43.038161] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-31T19:30:43.457681] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-31T19:30:43.756244] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T19:30:43.811082] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-31T19:30:44.257691] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-31T19:30:45.057671] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-31T19:30:45.412488] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-31T19:30:45.857692] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-31T19:30:46.350009] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-31T19:30:46.657680] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-31T19:30:46.957326] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-31T19:30:47.212979] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-31T19:30:47.457710] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-31T19:30:47.838219] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-31T19:30:48.257733] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-31T19:30:49.057666] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-31T19:30:49.440241] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-31T19:30:49.857684] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-31T19:30:50.319218] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:30:50.657710] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-31T19:30:51.148337] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T19:30:51.457679] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-31T19:30:51.872994] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T19:30:52.257713] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-31T19:30:52.678573] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T19:30:53.057676] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-31T19:30:53.431680] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-31T19:30:53.857692] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-31T19:30:54.547556] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T19:30:54.560344] [INFO ] [REMOTE ] KBR: Full fetch complete (70207 records). [2025-10-31T19:30:54.560639] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-31T19:30:54.666766] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-31T19:30:55.048849] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-31T19:30:55.048962] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-31T19:30:55.050061] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-31T19:30:55.050272] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-31T19:30:55.052395] [DEBUG] [LOCAL ] KBR: Trimmed 70207 records to 48706 (keeping 200 days of data) [2025-10-31T19:30:55.320289] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-31T19:30:55.322221] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T19:30:55.424300] [DEBUG] [LOCAL ] KBR: Primary data saved (48706 records). [2025-10-31T19:30:55.424456] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-31T19:30:55.424537] [INFO ] [MAIN ] Update Progress: 1177/2365 symbols completed. KBR took 31.4s. Estimated remaining: 2h 32m 16s. Rate: 7.8 symbols/min [2025-10-31T19:30:55.462781] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-31T19:30:55.606080] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:30:55.639884] [DEBUG] [LOCAL ] KEP: Loaded 32930 existing records from primary storage. [2025-10-31T19:30:55.640219] [INFO ] [MAIN ] KEP: Loaded 32930 existing records. [2025-10-31T19:30:55.849446] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:30:55.849769] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-31T19:30:55.849822] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-31T19:30:55.850150] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-31T19:30:55.850206] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-31T19:30:56.207707] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:30:56.257718] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-31T19:30:56.763467] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:30:57.057635] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-31T19:30:57.118556] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T19:30:57.485016] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-31T19:30:57.857682] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-31T19:30:58.251438] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-31T19:30:58.657685] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-31T19:30:59.423731] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-31T19:30:59.457695] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-31T19:31:00.219961] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-31T19:31:00.257612] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-31T19:31:01.025593] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-31T19:31:01.057613] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-31T19:31:01.857639] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-31T19:31:01.999873] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T19:31:02.657685] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-31T19:31:03.091860] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-31T19:31:03.257762] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-31T19:31:03.457679] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-31T19:31:03.864376] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-31T19:31:04.257688] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-31T19:31:05.057673] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-31T19:31:05.445795] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-31T19:31:05.607949] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-31T19:31:05.618998] [INFO ] [REMOTE ] KBH: Full fetch complete (70840 records). [2025-10-31T19:31:05.619156] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-31T19:31:05.866121] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-31T19:31:06.009533] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-31T19:31:06.009615] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-31T19:31:06.010579] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-31T19:31:06.010665] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-31T19:31:06.012007] [DEBUG] [LOCAL ] KBH: Trimmed 70840 records to 49171 (keeping 200 days of data) [2025-10-31T19:31:06.300038] [DEBUG] [LOCAL ] KBH: Primary data saved (49171 records). [2025-10-31T19:31:06.300172] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-31T19:31:06.300251] [INFO ] [MAIN ] Update Progress: 1178/2365 symbols completed. KBH took 44.9s. Estimated remaining: 2h 32m 11s. Rate: 7.8 symbols/min [2025-10-31T19:31:06.464606] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:31:06.500888] [DEBUG] [LOCAL ] KEX: Loaded 39084 existing records from primary storage. [2025-10-31T19:31:06.501173] [INFO ] [MAIN ] KEX: Loaded 39084 existing records. [2025-10-31T19:31:06.657946] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-31T19:31:06.663783] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T19:31:06.680403] [INFO ] [REMOTE ] KEN: Full fetch complete (5801 records). [2025-10-31T19:31:06.686163] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-31T19:31:06.685992] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:31:06.686449] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-31T19:31:06.722824] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-31T19:31:06.736142] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-31T19:31:06.781189] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-31T19:31:07.378817] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-31T19:31:07.394215] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-31T19:31:07.409817] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-31T19:31:07.413343] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-31T19:31:07.434985] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:31:07.435444] [DEBUG] [LOCAL ] KEN: Trimmed 5801 records to 4181 (keeping 200 days of data) [2025-10-31T19:31:07.461169] [DEBUG] [LOCAL ] KEN: Primary data saved (4181 records). [2025-10-31T19:31:07.461321] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-31T19:31:07.461460] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-31T19:31:07.461582] [INFO ] [MAIN ] Update Progress: 1179/2365 symbols completed. KEN took 28.0s. Estimated remaining: 2h 31m 57s. Rate: 7.8 symbols/min [2025-10-31T19:31:07.634566] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:31:07.634784] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-31T19:31:07.634826] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-31T19:31:07.634938] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-31T19:31:07.634980] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-31T19:31:07.635021] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-31T19:31:07.635052] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-31T19:31:08.006736] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:31:08.133548] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-31T19:31:08.257724] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-31T19:31:08.635231] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T19:31:09.057689] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-31T19:31:09.857746] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-31T19:31:09.946591] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-31T19:31:09.960312] [INFO ] [REMOTE ] KD: Full fetch complete (76048 records). [2025-10-31T19:31:09.960563] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-31T19:31:10.388563] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T19:31:10.425389] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-31T19:31:10.426501] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-31T19:31:10.427633] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-31T19:31:10.427727] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-31T19:31:10.429433] [DEBUG] [LOCAL ] KD: Trimmed 76048 records to 53040 (keeping 200 days of data) [2025-10-31T19:31:10.683950] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-31T19:31:10.734553] [DEBUG] [LOCAL ] KD: Primary data saved (53040 records). [2025-10-31T19:31:10.734746] [INFO ] [MAIN ] KD: Full history saved. [2025-10-31T19:31:10.734841] [INFO ] [MAIN ] Update Progress: 1180/2365 symbols completed. KD took 39.6s. Estimated remaining: 2h 31m 45s. Rate: 7.8 symbols/min [2025-10-31T19:31:10.906243] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:31:10.929716] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T19:31:10.971580] [DEBUG] [LOCAL ] KEYS: Loaded 43224 existing records from primary storage. [2025-10-31T19:31:10.971921] [INFO ] [MAIN ] KEYS: Loaded 43224 existing records. [2025-10-31T19:31:11.144614] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:31:11.144864] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-31T19:31:11.144909] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-31T19:31:11.145672] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-31T19:31:11.145731] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-31T19:31:11.462880] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-31T19:31:11.498924] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:31:11.548772] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-31T19:31:12.257669] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-31T19:31:12.848109] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:31:13.057679] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-31T19:31:13.301117] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T19:31:13.857706] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-31T19:31:14.260950] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T19:31:14.657701] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-31T19:31:14.792041] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T19:31:15.457670] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-31T19:31:16.257725] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-31T19:31:16.325554] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-31T19:31:16.404956] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-31T19:31:17.057724] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-31T19:31:17.412410] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T19:31:17.857672] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-31T19:31:18.391770] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T19:31:18.657687] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-31T19:31:19.029857] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T19:31:19.039135] [INFO ] [REMOTE ] KEP: Full fetch complete (42781 records). [2025-10-31T19:31:19.039264] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-31T19:31:19.458581] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-31T19:31:19.459282] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-31T19:31:19.460087] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-31T19:31:19.460866] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-31T19:31:19.461014] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-31T19:31:19.462212] [DEBUG] [LOCAL ] KEP: Trimmed 42781 records to 33186 (keeping 200 days of data) [2025-10-31T19:31:19.658769] [DEBUG] [LOCAL ] KEP: Primary data saved (33186 records). [2025-10-31T19:31:19.658984] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-31T19:31:19.659107] [INFO ] [MAIN ] Update Progress: 1181/2365 symbols completed. KEP took 24.2s. Estimated remaining: 2h 31m 38s. Rate: 7.8 symbols/min [2025-10-31T19:31:19.831511] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:31:19.835500] [DEBUG] [LOCAL ] KF: Loaded 2310 existing records from primary storage. [2025-10-31T19:31:19.844275] [INFO ] [MAIN ] KF: Loaded 2310 existing records. [2025-10-31T19:31:19.953791] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T19:31:20.049264] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:31:20.049502] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-31T19:31:20.049549] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-31T19:31:20.049794] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-31T19:31:20.049850] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-31T19:31:20.264555] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-31T19:31:20.398901] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:31:20.707480] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:31:21.057672] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-31T19:31:21.601492] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-31T19:31:21.857700] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-31T19:31:22.211941] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-31T19:31:22.374949] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-31T19:31:22.657635] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-31T19:31:23.457673] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-31T19:31:23.918457] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:31:24.257723] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-31T19:31:24.480054] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T19:31:24.543972] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-31T19:31:25.057690] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-31T19:31:25.481182] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-31T19:31:25.857669] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-31T19:31:26.657712] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-31T19:31:27.158444] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T19:31:27.457727] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-31T19:31:27.575490] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-31T19:31:28.257823] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-31T19:31:28.627422] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T19:31:28.809544] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-31T19:31:29.057731] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-31T19:31:29.857697] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-31T19:31:30.266778] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-31T19:31:30.268957] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T19:31:30.657746] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-31T19:31:31.457697] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-31T19:31:31.814636] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-31T19:31:31.985194] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-31T19:31:32.257735] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-31T19:31:33.057682] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-31T19:31:33.594855] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-31T19:31:33.867183] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-31T19:31:33.871676] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T19:31:34.474843] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-31T19:31:34.487226] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-31T19:31:34.487391] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-31T19:31:34.664462] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-31T19:31:34.688734] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-31T19:31:34.689552] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:31:34.689623] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:31:34.689718] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-31T19:31:34.689783] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-31T19:31:34.689820] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-31T19:31:34.689860] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-31T19:31:34.689917] [INFO ] [MAIN ] Update Progress: 1182/2365 symbols completed. KEY took 27.2s. Estimated remaining: 2h 31m 38s. Rate: 7.8 symbols/min [2025-10-31T19:31:34.859697] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:31:34.879839] [DEBUG] [LOCAL ] KFRC: Loaded 21214 existing records from primary storage. [2025-10-31T19:31:34.880069] [INFO ] [MAIN ] KFRC: Loaded 21214 existing records. [2025-10-31T19:31:35.059474] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:31:35.059742] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-31T19:31:35.059794] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-31T19:31:35.060111] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-31T19:31:35.060168] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-31T19:31:35.418985] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:31:35.457716] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-31T19:31:35.802356] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T19:31:35.969680] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-31T19:31:36.257697] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-31T19:31:37.057689] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-31T19:31:37.335880] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T19:31:37.492846] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-31T19:31:37.857697] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-31T19:31:38.527536] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-31T19:31:38.657677] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-31T19:31:38.874665] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-10-31T19:31:39.457683] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-31T19:31:40.257734] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-31T19:31:40.514882] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T19:31:40.550671] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-31T19:31:41.057727] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-31T19:31:41.356938] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-31T19:31:41.857675] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-31T19:31:42.620216] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T19:31:42.657691] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-31T19:31:43.457690] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-31T19:31:43.848848] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T19:31:43.886424] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-31T19:31:43.887573] [INFO ] [REMOTE ] KF: Full fetch complete (3396 records). [2025-10-31T19:31:43.887691] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-31T19:31:44.260109] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-31T19:31:44.264725] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-31T19:31:44.265817] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-31T19:31:44.265992] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-31T19:31:44.266033] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-31T19:31:44.266380] [DEBUG] [LOCAL ] KF: Trimmed 3396 records to 2349 (keeping 200 days of data) [2025-10-31T19:31:44.281893] [DEBUG] [LOCAL ] KF: Primary data saved (2349 records). [2025-10-31T19:31:44.281987] [INFO ] [MAIN ] KF: Full history saved. [2025-10-31T19:31:44.282063] [INFO ] [MAIN ] Update Progress: 1183/2365 symbols completed. KF took 24.6s. Estimated remaining: 2h 31m 32s. Rate: 7.8 symbols/min [2025-10-31T19:31:44.459139] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:31:44.469378] [DEBUG] [LOCAL ] KFS: Loaded 8755 existing records from primary storage. [2025-10-31T19:31:44.469664] [INFO ] [MAIN ] KFS: Loaded 8755 existing records. [2025-10-31T19:31:44.642905] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:31:44.643146] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-31T19:31:44.643194] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-31T19:31:44.643502] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-31T19:31:44.643559] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-31T19:31:45.000294] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:31:45.057688] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-31T19:31:45.645771] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T19:31:45.657422] [INFO ] [REMOTE ] KEX: Full fetch complete (56437 records). [2025-10-31T19:31:45.657710] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-31T19:31:45.858939] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-31T19:31:46.112142] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-31T19:31:46.112515] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-31T19:31:46.113727] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-31T19:31:46.113984] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-31T19:31:46.116229] [DEBUG] [LOCAL ] KEX: Trimmed 56437 records to 39459 (keeping 200 days of data) [2025-10-31T19:31:46.277160] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T19:31:46.295370] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-31T19:31:46.410402] [DEBUG] [LOCAL ] KEX: Primary data saved (39459 records). [2025-10-31T19:31:46.410545] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-31T19:31:46.410624] [INFO ] [MAIN ] Update Progress: 1184/2365 symbols completed. KEX took 40.1s. Estimated remaining: 2h 31m 19s. Rate: 7.8 symbols/min [2025-10-31T19:31:46.574674] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:31:46.602873] [DEBUG] [LOCAL ] KFY: Loaded 29305 existing records from primary storage. [2025-10-31T19:31:46.603117] [INFO ] [MAIN ] KFY: Loaded 29305 existing records. [2025-10-31T19:31:46.662869] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-31T19:31:46.788634] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:31:46.788950] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-31T19:31:46.789026] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-31T19:31:46.789367] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-31T19:31:46.789436] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-31T19:31:47.180838] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:31:47.426754] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-31T19:31:47.457614] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-31T19:31:48.257685] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-31T19:31:48.581826] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-31T19:31:48.926183] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-31T19:31:49.057621] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-31T19:31:49.857617] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-31T19:31:50.428731] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-31T19:31:50.439968] [INFO ] [REMOTE ] KEYS: Full fetch complete (63375 records). [2025-10-31T19:31:50.440242] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-31T19:31:50.494353] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-31T19:31:50.663060] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-31T19:31:50.883459] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-31T19:31:50.883569] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-31T19:31:50.884882] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-31T19:31:50.884948] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-31T19:31:50.886397] [DEBUG] [LOCAL ] KEYS: Trimmed 63375 records to 43604 (keeping 200 days of data) [2025-10-31T19:31:51.148292] [DEBUG] [LOCAL ] KEYS: Primary data saved (43604 records). [2025-10-31T19:31:51.148420] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-31T19:31:51.148497] [INFO ] [MAIN ] Update Progress: 1185/2365 symbols completed. KEYS took 40.4s. Estimated remaining: 2h 31m 8s. Rate: 7.8 symbols/min [2025-10-31T19:31:51.313181] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:31:51.364169] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-10-31T19:31:51.364505] [INFO ] [MAIN ] KGC: Loaded 54089 existing records. [2025-10-31T19:31:51.462145] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-31T19:31:51.574954] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:31:51.575305] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-31T19:31:51.575367] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-31T19:31:51.575987] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-31T19:31:51.576064] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-31T19:31:51.705812] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T19:31:51.906746] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-31T19:31:51.971119] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:31:52.257608] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-31T19:31:53.057668] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-31T19:31:53.636351] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-31T19:31:53.857711] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-31T19:31:53.976755] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T19:31:54.657703] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-31T19:31:55.039771] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-31T19:31:55.161666] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T19:31:55.457726] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-31T19:31:56.208382] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T19:31:56.257614] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-31T19:31:57.057632] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-31T19:31:57.159931] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T19:31:57.587799] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T19:31:57.857726] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-31T19:31:58.316585] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-31T19:31:58.657675] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-31T19:31:59.457691] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-31T19:31:59.483461] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-31T19:32:00.257716] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-31T19:32:01.057682] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-31T19:32:01.176634] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-31T19:32:01.288554] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-31T19:32:01.608057] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-31T19:32:01.857674] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-31T19:32:02.657711] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-31T19:32:03.189062] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-31T19:32:03.465209] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-31T19:32:03.473447] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-31T19:32:04.245702] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T19:32:04.257602] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-31T19:32:05.057701] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-31T19:32:05.194525] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-31T19:32:05.413366] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-31T19:32:05.857703] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-31T19:32:06.657750] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-31T19:32:07.372616] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-31T19:32:07.457626] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-31T19:32:07.567771] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T19:32:07.930491] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-31T19:32:08.257716] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-31T19:32:09.057684] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-31T19:32:09.238730] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-31T19:32:09.245420] [INFO ] [REMOTE ] KFRC: Full fetch complete (27788 records). [2025-10-31T19:32:09.245570] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-31T19:32:09.651506] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-31T19:32:09.651603] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-31T19:32:09.652265] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-31T19:32:09.652328] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-31T19:32:09.653181] [DEBUG] [LOCAL ] KFRC: Trimmed 27788 records to 21473 (keeping 200 days of data) [2025-10-31T19:32:09.766966] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T19:32:09.774453] [INFO ] [REMOTE ] KFS: Full fetch complete (11416 records). [2025-10-31T19:32:09.775871] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-31T19:32:09.869691] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-31T19:32:09.907111] [DEBUG] [LOCAL ] KFRC: Primary data saved (21473 records). [2025-10-31T19:32:09.918067] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-31T19:32:09.918195] [INFO ] [MAIN ] Update Progress: 1186/2365 symbols completed. KFRC took 35.2s. Estimated remaining: 2h 31m 12s. Rate: 7.8 symbols/min [2025-10-31T19:32:10.266187] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:10.345985] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-31T19:32:10.346068] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-31T19:32:10.346329] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-31T19:32:10.346367] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-31T19:32:10.346946] [DEBUG] [LOCAL ] KFS: Trimmed 11416 records to 8805 (keeping 200 days of data) [2025-10-31T19:32:10.397780] [DEBUG] [LOCAL ] KFS: Primary data saved (8805 records). [2025-10-31T19:32:10.407752] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-31T19:32:10.407876] [INFO ] [MAIN ] Update Progress: 1187/2365 symbols completed. KFS took 26.1s. Estimated remaining: 2h 30m 57s. Rate: 7.8 symbols/min [2025-10-31T19:32:10.559809] [DEBUG] [LOCAL ] KGS: Loaded 46195 existing records from primary storage. [2025-10-31T19:32:10.571714] [INFO ] [MAIN ] KGS: Loaded 46195 existing records. [2025-10-31T19:32:10.664513] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-31T19:32:10.658979] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:10.772011] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:32:10.772336] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-31T19:32:10.772387] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-31T19:32:10.772579] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-31T19:32:10.772615] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-31T19:32:11.072420] [DEBUG] [LOCAL ] KIM: Loaded 53378 existing records from primary storage. [2025-10-31T19:32:11.095555] [INFO ] [MAIN ] KIM: Loaded 53378 existing records. [2025-10-31T19:32:11.279548] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:11.369843] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:32:11.370263] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-31T19:32:11.370345] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-31T19:32:11.370867] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-31T19:32:11.370969] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-31T19:32:11.462882] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-31T19:32:11.594078] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-31T19:32:11.743451] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T19:32:11.810759] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:12.257690] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-31T19:32:12.761271] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:32:13.057693] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-31T19:32:13.439731] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T19:32:13.857631] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-31T19:32:14.571982] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-31T19:32:14.657675] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-31T19:32:15.350963] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-31T19:32:15.357805] [INFO ] [REMOTE ] KFY: Full fetch complete (43440 records). [2025-10-31T19:32:15.357935] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-31T19:32:15.457770] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-31T19:32:15.740491] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-31T19:32:15.740590] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-31T19:32:15.741488] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-31T19:32:15.741602] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-31T19:32:15.742639] [DEBUG] [LOCAL ] KFY: Trimmed 43440 records to 29577 (keeping 200 days of data) [2025-10-31T19:32:15.870593] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T19:32:15.958058] [DEBUG] [LOCAL ] KFY: Primary data saved (29577 records). [2025-10-31T19:32:15.958195] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-31T19:32:15.958274] [INFO ] [MAIN ] Update Progress: 1188/2365 symbols completed. KFY took 29.5s. Estimated remaining: 2h 30m 47s. Rate: 7.8 symbols/min [2025-10-31T19:32:16.123314] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:16.145098] [DEBUG] [LOCAL ] KIO: Loaded 21821 existing records from primary storage. [2025-10-31T19:32:16.145341] [INFO ] [MAIN ] KIO: Loaded 21821 existing records. [2025-10-31T19:32:16.262912] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-31T19:32:16.325989] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:32:16.326232] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-31T19:32:16.326286] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-31T19:32:16.326508] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-31T19:32:16.326565] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-31T19:32:16.714128] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:16.755034] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:32:17.057618] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-31T19:32:17.528822] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T19:32:17.762725] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-31T19:32:17.857610] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-31T19:32:18.610158] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T19:32:18.657629] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-31T19:32:19.382015] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-31T19:32:19.457688] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-31T19:32:20.153687] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T19:32:20.257691] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-31T19:32:21.057733] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-31T19:32:21.564784] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-31T19:32:21.851127] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-31T19:32:21.858973] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-31T19:32:22.657681] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-31T19:32:22.932961] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-31T19:32:23.457710] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-31T19:32:24.233901] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-31T19:32:24.257677] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-31T19:32:24.332334] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-31T19:32:25.057736] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-31T19:32:25.677116] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-31T19:32:25.854193] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-31T19:32:25.858616] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-31T19:32:26.658274] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-31T19:32:26.658373] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-31T19:32:27.457715] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-31T19:32:28.257691] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-31T19:32:28.338352] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-31T19:32:28.727949] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T19:32:29.057681] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-31T19:32:29.361242] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-31T19:32:29.857719] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-31T19:32:30.438719] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-31T19:32:30.657683] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-31T19:32:30.976763] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T19:32:31.457682] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-31T19:32:31.950501] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-31T19:32:32.257740] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-31T19:32:32.706432] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T19:32:33.057671] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-31T19:32:33.857673] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-31T19:32:33.876362] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-31T19:32:34.140632] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-31T19:32:34.153806] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-31T19:32:34.153978] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-31T19:32:34.582296] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-31T19:32:34.582382] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-31T19:32:34.583473] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-31T19:32:34.583539] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-31T19:32:34.585055] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 54479 (keeping 200 days of data) [2025-10-31T19:32:34.681114] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-31T19:32:34.923504] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-10-31T19:32:34.923631] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-31T19:32:34.923744] [INFO ] [MAIN ] Update Progress: 1189/2365 symbols completed. KGC took 43.8s. Estimated remaining: 2h 30m 51s. Rate: 7.8 symbols/min [2025-10-31T19:32:35.095966] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:35.150391] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T19:32:35.180383] [DEBUG] [LOCAL ] KKR: Loaded 53882 existing records from primary storage. [2025-10-31T19:32:35.180734] [INFO ] [MAIN ] KKR: Loaded 53882 existing records. [2025-10-31T19:32:35.359367] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:32:35.359783] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-31T19:32:35.359887] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-31T19:32:35.360230] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-31T19:32:35.360288] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-31T19:32:35.459885] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-31T19:32:35.493210] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-31T19:32:35.736685] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:36.257688] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-31T19:32:36.845572] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T19:32:36.856699] [INFO ] [REMOTE ] KGS: Full fetch complete (66636 records). [2025-10-31T19:32:36.856864] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-31T19:32:37.066070] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-31T19:32:37.269044] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-31T19:32:37.269120] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-31T19:32:37.270002] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-31T19:32:37.270063] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-31T19:32:37.271270] [DEBUG] [LOCAL ] KGS: Trimmed 66636 records to 46559 (keeping 200 days of data) [2025-10-31T19:32:37.528393] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T19:32:37.591793] [DEBUG] [LOCAL ] KGS: Primary data saved (46559 records). [2025-10-31T19:32:37.591923] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-31T19:32:37.592003] [INFO ] [MAIN ] Update Progress: 1190/2365 symbols completed. KGS took 27.7s. Estimated remaining: 2h 30m 38s. Rate: 7.8 symbols/min [2025-10-31T19:32:37.773969] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:37.781577] [DEBUG] [LOCAL ] KKRS: Loaded 5447 existing records from primary storage. [2025-10-31T19:32:37.781809] [INFO ] [MAIN ] KKRS: Loaded 5447 existing records. [2025-10-31T19:32:37.862809] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-31T19:32:37.974429] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:32:37.974689] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-31T19:32:37.974748] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-31T19:32:37.974923] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-31T19:32:37.974978] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-31T19:32:38.339040] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:38.495207] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-31T19:32:38.657700] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-31T19:32:39.002439] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-31T19:32:39.084687] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T19:32:39.457697] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-31T19:32:39.861782] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-31T19:32:40.257716] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-31T19:32:41.057624] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-31T19:32:41.217215] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-31T19:32:41.224441] [INFO ] [REMOTE ] KIO: Full fetch complete (32724 records). [2025-10-31T19:32:41.224720] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-31T19:32:41.640981] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-31T19:32:41.641105] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-31T19:32:41.642174] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-31T19:32:41.642243] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-31T19:32:41.643506] [DEBUG] [LOCAL ] KIO: Trimmed 32724 records to 21988 (keeping 200 days of data) [2025-10-31T19:32:41.798359] [DEBUG] [LOCAL ] KIO: Primary data saved (21988 records). [2025-10-31T19:32:41.798560] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-31T19:32:41.798702] [INFO ] [MAIN ] Update Progress: 1191/2365 symbols completed. KIO took 25.8s. Estimated remaining: 2h 30m 27s. Rate: 7.8 symbols/min [2025-10-31T19:32:41.867355] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-31T19:32:41.989679] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:41.989998] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-31T19:32:41.990042] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-31T19:32:41.990128] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-31T19:32:41.990168] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-31T19:32:41.990210] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-31T19:32:41.990245] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-31T19:32:42.372236] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:42.577358] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-31T19:32:42.657731] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-31T19:32:43.239876] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-31T19:32:43.457716] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-31T19:32:43.868721] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-31T19:32:44.209452] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-31T19:32:44.222591] [INFO ] [REMOTE ] KIM: Full fetch complete (76978 records). [2025-10-31T19:32:44.222863] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-31T19:32:44.262823] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-31T19:32:44.668294] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-31T19:32:44.668392] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-31T19:32:44.669425] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-31T19:32:44.669490] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-31T19:32:44.670955] [DEBUG] [LOCAL ] KIM: Trimmed 76978 records to 53768 (keeping 200 days of data) [2025-10-31T19:32:44.994395] [DEBUG] [LOCAL ] KIM: Primary data saved (53768 records). [2025-10-31T19:32:44.994562] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-31T19:32:44.994685] [INFO ] [MAIN ] Update Progress: 1192/2365 symbols completed. KIM took 34.6s. Estimated remaining: 2h 30m 15s. Rate: 7.8 symbols/min [2025-10-31T19:32:45.062756] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-31T19:32:45.165704] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:45.165884] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-31T19:32:45.165920] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-31T19:32:45.166031] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-31T19:32:45.166070] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-31T19:32:45.166110] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-31T19:32:45.166140] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-31T19:32:45.267924] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T19:32:45.268279] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-31T19:32:45.273904] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:32:45.279078] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-31T19:32:45.289361] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:32:45.306818] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-31T19:32:45.319346] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-31T19:32:45.325575] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-31T19:32:45.327201] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-31T19:32:45.343060] [INFO ] [MAIN ] Update Progress: 1193/2365 symbols completed. KKRT took 3.5s. Estimated remaining: 2h 29m 60s. Rate: 7.8 symbols/min [2025-10-31T19:32:45.687046] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:45.706780] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:45.762639] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-31T19:32:45.785599] [DEBUG] [LOCAL ] KLC: Loaded 36054 existing records from primary storage. [2025-10-31T19:32:45.785912] [INFO ] [MAIN ] KLC: Loaded 36054 existing records. [2025-10-31T19:32:45.862724] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-31T19:32:45.968457] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:32:45.968720] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-31T19:32:45.968778] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-31T19:32:45.969013] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-31T19:32:45.969070] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-31T19:32:46.319123] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:46.657709] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-31T19:32:47.121426] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-31T19:32:47.236561] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T19:32:47.457729] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-31T19:32:47.928724] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-31T19:32:48.257690] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-31T19:32:49.057634] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-31T19:32:49.076695] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-31T19:32:49.478949] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-31T19:32:49.857689] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-31T19:32:50.657693] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-31T19:32:50.805940] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T19:32:50.806236] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-31T19:32:50.806328] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:32:50.806378] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-31T19:32:50.806456] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:32:50.806530] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-31T19:32:50.806592] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-31T19:32:50.806627] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-31T19:32:50.806709] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-31T19:32:50.806766] [INFO ] [MAIN ] Update Progress: 1194/2365 symbols completed. KLAR took 5.8s. Estimated remaining: 2h 29m 50s. Rate: 7.8 symbols/min [2025-10-31T19:32:50.976701] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:32:51.027236] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-31T19:32:51.027564] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-10-31T19:32:51.205141] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:32:51.205525] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-31T19:32:51.205686] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-31T19:32:51.206079] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-31T19:32:51.206237] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-31T19:32:51.457811] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-31T19:32:51.562736] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-31T19:32:51.608350] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:32:52.257737] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-31T19:32:52.291385] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T19:32:53.057694] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-31T19:32:53.863095] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-31T19:32:53.885246] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-31T19:32:54.417481] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T19:32:54.657696] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-31T19:32:54.831561] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T19:32:55.457731] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-31T19:32:56.140433] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T19:32:56.257676] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-31T19:32:56.615762] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-31T19:32:56.871686] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T19:32:57.057689] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-31T19:32:57.444557] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-31T19:32:57.857667] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-31T19:32:58.657674] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-31T19:32:58.877554] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T19:32:59.457677] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-31T19:32:59.883121] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-31T19:33:00.068047] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T19:33:00.257669] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-31T19:33:00.634133] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-31T19:33:00.635406] [INFO ] [REMOTE ] KKRS: Full fetch complete (7511 records). [2025-10-31T19:33:00.635474] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-31T19:33:01.007217] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-31T19:33:01.007301] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-31T19:33:01.007514] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-31T19:33:01.007580] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-31T19:33:01.008124] [DEBUG] [LOCAL ] KKRS: Trimmed 7511 records to 5495 (keeping 200 days of data) [2025-10-31T19:33:01.042555] [DEBUG] [LOCAL ] KKRS: Primary data saved (5495 records). [2025-10-31T19:33:01.042718] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-31T19:33:01.042811] [INFO ] [MAIN ] Update Progress: 1195/2365 symbols completed. KKRS took 23.5s. Estimated remaining: 2h 29m 45s. Rate: 7.8 symbols/min [2025-10-31T19:33:01.063695] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-31T19:33:01.235391] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:33:01.241256] [DEBUG] [LOCAL ] KMPB: Loaded 3403 existing records from primary storage. [2025-10-31T19:33:01.241694] [INFO ] [MAIN ] KMPB: Loaded 3403 existing records. [2025-10-31T19:33:01.479240] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:33:01.479470] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-31T19:33:01.479517] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-31T19:33:01.479674] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-31T19:33:01.479731] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-31T19:33:01.842720] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:33:01.857613] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-31T19:33:02.278928] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-31T19:33:02.406508] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T19:33:02.657609] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-31T19:33:03.457739] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-31T19:33:03.691148] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T19:33:04.257666] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-31T19:33:04.958953] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T19:33:05.057617] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-31T19:33:05.507337] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T19:33:05.857723] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-31T19:33:06.496220] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T19:33:06.657611] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-31T19:33:06.754934] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T19:33:07.457697] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-31T19:33:08.033971] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T19:33:08.257628] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-31T19:33:08.533830] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-31T19:33:09.064291] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-31T19:33:09.106271] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-31T19:33:09.128271] [INFO ] [REMOTE ] KKR: Full fetch complete (77655 records). [2025-10-31T19:33:09.128496] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-31T19:33:09.670914] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-31T19:33:09.671000] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-31T19:33:09.672016] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-31T19:33:09.672085] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-31T19:33:09.673577] [DEBUG] [LOCAL ] KKR: Trimmed 77655 records to 54272 (keeping 200 days of data) [2025-10-31T19:33:09.865203] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-31T19:33:10.014373] [DEBUG] [LOCAL ] KKR: Primary data saved (54272 records). [2025-10-31T19:33:10.014517] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-31T19:33:10.014599] [INFO ] [MAIN ] Update Progress: 1196/2365 symbols completed. KKR took 35.1s. Estimated remaining: 2h 29m 38s. Rate: 7.8 symbols/min [2025-10-31T19:33:10.192798] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:33:10.229488] [DEBUG] [LOCAL ] KMPR: Loaded 40881 existing records from primary storage. [2025-10-31T19:33:10.229792] [INFO ] [MAIN ] KMPR: Loaded 40881 existing records. [2025-10-31T19:33:10.333362] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-31T19:33:10.409171] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:33:10.409461] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-31T19:33:10.409510] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-31T19:33:10.409845] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-31T19:33:10.409900] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-31T19:33:10.662775] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-31T19:33:10.786748] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:33:10.816905] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-31T19:33:11.103078] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-31T19:33:11.457630] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-31T19:33:11.759758] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-31T19:33:12.257686] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-31T19:33:13.057732] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-31T19:33:13.695457] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-31T19:33:13.816010] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T19:33:13.857699] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-31T19:33:14.657696] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-31T19:33:15.321523] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T19:33:15.457619] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-31T19:33:15.538492] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-31T19:33:16.257632] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-31T19:33:16.444138] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T19:33:17.022625] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-31T19:33:17.041719] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-31T19:33:17.041937] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-31T19:33:17.062868] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-31T19:33:17.466285] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-31T19:33:17.466352] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-31T19:33:17.467500] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-31T19:33:17.467574] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-31T19:33:17.469123] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 54473 (keeping 200 days of data) [2025-10-31T19:33:17.795010] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-10-31T19:33:17.795148] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-31T19:33:17.795232] [INFO ] [MAIN ] Update Progress: 1197/2365 symbols completed. KMI took 27.0s. Estimated remaining: 2h 29m 31s. Rate: 7.8 symbols/min [2025-10-31T19:33:17.857622] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-31T19:33:17.977365] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-31T19:33:18.214520] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-31T19:33:18.657682] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-31T19:33:18.964428] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-31T19:33:19.457717] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-31T19:33:20.257665] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-31T19:33:20.514325] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T19:33:21.057637] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-31T19:33:21.164127] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-31T19:33:21.425138] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-31T19:33:21.857709] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-31T19:33:22.657687] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-31T19:33:23.062772] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-31T19:33:23.071832] [INFO ] [REMOTE ] KLC: Full fetch complete (50970 records). [2025-10-31T19:33:23.072014] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-31T19:33:23.459638] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-31T19:33:23.472236] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-31T19:33:23.472313] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-31T19:33:23.473882] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-31T19:33:23.474291] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-31T19:33:23.475473] [DEBUG] [LOCAL ] KLC: Trimmed 50970 records to 36340 (keeping 200 days of data) [2025-10-31T19:33:23.679205] [DEBUG] [LOCAL ] KLC: Primary data saved (36340 records). [2025-10-31T19:33:23.679428] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-31T19:33:23.679633] [INFO ] [MAIN ] Update Progress: 1198/2365 symbols completed. KLC took 38.3s. Estimated remaining: 2h 29m 21s. Rate: 7.8 symbols/min [2025-10-31T19:33:23.698990] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T19:33:23.870795] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T19:33:24.257723] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-31T19:33:25.057623] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-31T19:33:25.139342] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-31T19:33:25.385080] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-31T19:33:25.386196] [INFO ] [REMOTE ] KMPB: Full fetch complete (4909 records). [2025-10-31T19:33:25.386261] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-31T19:33:25.747715] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-31T19:33:25.747797] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-31T19:33:25.747973] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-31T19:33:25.748035] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-31T19:33:25.748388] [DEBUG] [LOCAL ] KMPB: Trimmed 4909 records to 3429 (keeping 200 days of data) [2025-10-31T19:33:25.773396] [DEBUG] [LOCAL ] KMPB: Primary data saved (3429 records). [2025-10-31T19:33:25.773669] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-31T19:33:25.773774] [INFO ] [MAIN ] Update Progress: 1199/2365 symbols completed. KMPB took 24.7s. Estimated remaining: 2h 29m 8s. Rate: 7.8 symbols/min [2025-10-31T19:33:25.857630] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-31T19:33:26.858228] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T19:33:26.865868] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-31T19:33:27.951863] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T19:33:27.960868] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-31T19:33:29.148310] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T19:33:29.158208] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-31T19:33:30.302933] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T19:33:30.313262] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-31T19:33:31.643551] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-31T19:33:31.653559] [INFO ] [REMOTE ] KMPR: Full fetch complete (54336 records). [2025-10-31T19:33:31.653683] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-31T19:33:32.045055] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-31T19:33:32.045143] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-31T19:33:32.045966] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-31T19:33:32.046027] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-31T19:33:32.047060] [DEBUG] [LOCAL ] KMPR: Trimmed 54336 records to 41175 (keeping 200 days of data) [2025-10-31T19:33:32.318761] [DEBUG] [LOCAL ] KMPR: Primary data saved (41175 records). [2025-10-31T19:33:32.318886] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-31T19:33:32.318960] [INFO ] [MAIN ] Update Progress: 1200/2365 symbols completed. KMPR took 22.3s. Estimated remaining: 2h 28m 59s. Rate: 7.8 symbols/min [2025-10-31T19:33:32.946841] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:33:33.023436] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:33:33.042275] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:33:33.106551] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:33:33.172518] [DEBUG] [LOCAL ] KNF: Loaded 36957 existing records from primary storage. [2025-10-31T19:33:33.173384] [INFO ] [MAIN ] KNF: Loaded 36957 existing records. [2025-10-31T19:33:33.239803] [DEBUG] [LOCAL ] KN: Loaded 38395 existing records from primary storage. [2025-10-31T19:33:33.278240] [DEBUG] [LOCAL ] KMT: Loaded 42640 existing records from primary storage. [2025-10-31T19:33:33.264506] [INFO ] [MAIN ] KN: Loaded 38395 existing records. [2025-10-31T19:33:33.310900] [INFO ] [MAIN ] KMT: Loaded 42640 existing records. [2025-10-31T19:33:33.380875] [DEBUG] [LOCAL ] KMX: Loaded 53673 existing records from primary storage. [2025-10-31T19:33:33.491131] [INFO ] [MAIN ] KMX: Loaded 53673 existing records. [2025-10-31T19:33:33.736493] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:33:33.788410] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-31T19:33:33.846828] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-31T19:33:33.863635] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:33:33.877763] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-31T19:33:33.886483] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-31T19:33:33.903841] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-31T19:33:33.916206] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-31T19:33:33.915909] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:33:33.922384] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-31T19:33:33.922523] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-31T19:33:33.944003] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-31T19:33:33.988677] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-31T19:33:34.138444] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-31T19:33:34.163590] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-31T19:33:34.207994] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:33:34.222852] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-31T19:33:34.284560] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-31T19:33:34.426739] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-31T19:33:34.453757] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-31T19:33:35.376108] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:33:35.347669] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:33:35.443711] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-31T19:33:35.444231] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-31T19:33:35.492954] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:33:35.493287] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-31T19:33:35.692697] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:33:35.692986] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-31T19:33:36.477981] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-31T19:33:36.484937] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-31T19:33:36.512528] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T19:33:36.520058] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-31T19:33:36.562863] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T19:33:36.570827] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-31T19:33:37.029445] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T19:33:37.039904] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-31T19:33:37.233186] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T19:33:37.239586] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-31T19:33:37.439131] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T19:33:37.447113] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-31T19:33:37.614268] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T19:33:37.857732] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-31T19:33:38.070781] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T19:33:38.149014] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-31T19:33:38.524612] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T19:33:38.657627] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-31T19:33:38.900035] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-31T19:33:39.457669] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-31T19:33:39.608311] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T19:33:40.257713] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-31T19:33:40.624043] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T19:33:41.057674] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-31T19:33:41.401777] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T19:33:41.857680] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-31T19:33:42.332016] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T19:33:42.657714] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-31T19:33:42.816182] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-31T19:33:43.457706] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-31T19:33:43.974183] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T19:33:44.257681] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-31T19:33:44.555947] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-31T19:33:45.057684] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-31T19:33:45.783672] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T19:33:45.857618] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-31T19:33:46.166792] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T19:33:46.657681] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-31T19:33:47.215235] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T19:33:47.457717] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-31T19:33:47.915690] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:33:48.257618] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-31T19:33:48.312153] [DEBUG] [REMOTE ] KMX: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-31T19:33:48.312434] [WARN ] [REMOTE ] KMX: No data returned for month 2025-07 [2025-10-31T19:33:48.312522] [FATAL] [REMOTE ] KMX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:33:48.312596] [FATAL] [MAIN ] KMX: Failed to fetch primary data. [2025-10-31T19:33:48.312692] [WARN ] [MAIN ] KMX: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:33:48.312763] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-31T19:33:48.312844] [DEBUG] [LOCAL ] KMX: No primary data file found to delete. [2025-10-31T19:33:48.312897] [INFO ] [LOCAL ] KMX: Starting deletion of derivative data. [2025-10-31T19:33:48.313175] [DEBUG] [LOCAL ] KMX: Deleted derivative data file. [2025-10-31T19:33:48.313260] [INFO ] [MAIN ] Update Progress: 1201/2365 symbols completed. KMX took 16.0s. Estimated remaining: 2h 28m 60s. Rate: 7.8 symbols/min [2025-10-31T19:33:48.489019] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:33:48.512490] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T19:33:48.527526] [DEBUG] [LOCAL ] KNOP: Loaded 9800 existing records from primary storage. [2025-10-31T19:33:48.527780] [INFO ] [MAIN ] KNOP: Loaded 9800 existing records. [2025-10-31T19:33:48.703846] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:33:48.704084] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-31T19:33:48.704132] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-31T19:33:48.704293] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-31T19:33:48.704330] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-31T19:33:49.056823] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:33:49.057605] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-31T19:33:49.766550] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-31T19:33:49.857634] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-31T19:33:50.312534] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-31T19:33:50.657673] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-31T19:33:51.228623] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T19:33:51.457682] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-31T19:33:52.257735] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-31T19:33:52.482390] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T19:33:53.057737] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-31T19:33:53.330139] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T19:33:53.857611] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-31T19:33:54.020172] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T19:33:54.657702] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-31T19:33:54.966036] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T19:33:55.272880] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-31T19:33:55.457706] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-31T19:33:56.257706] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-31T19:33:56.516162] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T19:33:56.775495] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-31T19:33:57.057665] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-31T19:33:57.857686] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-31T19:33:58.068371] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-31T19:33:58.657671] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-31T19:33:59.122264] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T19:33:59.132549] [INFO ] [REMOTE ] KMT: Full fetch complete (61796 records). [2025-10-31T19:33:59.132811] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-31T19:33:59.467181] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-31T19:33:59.577498] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-31T19:33:59.577674] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-31T19:33:59.578892] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-31T19:33:59.578957] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-31T19:33:59.580188] [DEBUG] [LOCAL ] KMT: Trimmed 61796 records to 42929 (keeping 200 days of data) [2025-10-31T19:33:59.811660] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T19:33:59.870626] [DEBUG] [LOCAL ] KMT: Primary data saved (42929 records). [2025-10-31T19:33:59.870779] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-31T19:33:59.870869] [INFO ] [MAIN ] Update Progress: 1202/2365 symbols completed. KMT took 27.6s. Estimated remaining: 2h 28m 56s. Rate: 7.8 symbols/min [2025-10-31T19:34:00.041472] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:00.060059] [DEBUG] [LOCAL ] KNSL: Loaded 18874 existing records from primary storage. [2025-10-31T19:34:00.060278] [INFO ] [MAIN ] KNSL: Loaded 18874 existing records. [2025-10-31T19:34:00.231743] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:34:00.231944] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-31T19:34:00.231989] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-31T19:34:00.232196] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-31T19:34:00.232251] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-31T19:34:00.262979] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-31T19:34:00.614856] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:00.637049] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-31T19:34:01.057713] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-31T19:34:01.371256] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:34:01.857679] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-31T19:34:02.087120] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T19:34:02.366310] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-31T19:34:02.657667] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-31T19:34:03.457691] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-31T19:34:03.939450] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T19:34:03.948726] [INFO ] [REMOTE ] KNF: Full fetch complete (51753 records). [2025-10-31T19:34:03.948840] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-31T19:34:04.084966] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T19:34:04.262863] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-31T19:34:04.338713] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-31T19:34:04.338789] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-31T19:34:04.339553] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-31T19:34:04.339593] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-31T19:34:04.340697] [DEBUG] [LOCAL ] KNF: Trimmed 51753 records to 37240 (keeping 200 days of data) [2025-10-31T19:34:04.554676] [DEBUG] [LOCAL ] KNF: Primary data saved (37240 records). [2025-10-31T19:34:04.554799] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-31T19:34:04.554874] [INFO ] [MAIN ] Update Progress: 1203/2365 symbols completed. KNF took 32.2s. Estimated remaining: 2h 28m 45s. Rate: 7.8 symbols/min [2025-10-31T19:34:04.738597] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:04.779098] [DEBUG] [LOCAL ] KNTK: Loaded 47507 existing records from primary storage. [2025-10-31T19:34:04.779406] [INFO ] [MAIN ] KNTK: Loaded 47507 existing records. [2025-10-31T19:34:04.900979] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-31T19:34:04.965468] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:34:04.965685] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-31T19:34:04.965745] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-31T19:34:04.965920] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-31T19:34:04.965958] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-31T19:34:05.065981] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-31T19:34:05.325364] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:05.857665] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-31T19:34:06.049070] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T19:34:06.657682] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-31T19:34:07.148255] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-31T19:34:07.158316] [INFO ] [REMOTE ] KN: Full fetch complete (56953 records). [2025-10-31T19:34:07.158466] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-31T19:34:07.289877] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T19:34:07.462778] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-31T19:34:07.569200] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-31T19:34:07.569283] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-31T19:34:07.570213] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-31T19:34:07.570280] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-31T19:34:07.571486] [DEBUG] [LOCAL ] KN: Trimmed 56953 records to 38691 (keeping 200 days of data) [2025-10-31T19:34:07.800908] [DEBUG] [LOCAL ] KN: Primary data saved (38691 records). [2025-10-31T19:34:07.801067] [INFO ] [MAIN ] KN: Full history saved. [2025-10-31T19:34:07.801881] [INFO ] [MAIN ] Update Progress: 1204/2365 symbols completed. KN took 35.5s. Estimated remaining: 2h 28m 33s. Rate: 7.8 symbols/min [2025-10-31T19:34:07.995909] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:08.047892] [DEBUG] [LOCAL ] KNX: Loaded 53028 existing records from primary storage. [2025-10-31T19:34:08.048271] [INFO ] [MAIN ] KNX: Loaded 53028 existing records. [2025-10-31T19:34:08.243398] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:34:08.244686] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-31T19:34:08.244488] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T19:34:08.244792] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-31T19:34:08.247901] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-31T19:34:08.248595] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-31T19:34:08.248543] [INFO ] [REMOTE ] KNOP: Full fetch complete (14643 records). [2025-10-31T19:34:08.248760] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-31T19:34:08.262721] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-31T19:34:08.937799] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:09.020344] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-31T19:34:09.020499] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-31T19:34:09.020920] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-31T19:34:09.021002] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-31T19:34:09.021573] [DEBUG] [LOCAL ] KNOP: Trimmed 14643 records to 9845 (keeping 200 days of data) [2025-10-31T19:34:09.062386] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-31T19:34:09.081808] [DEBUG] [LOCAL ] KNOP: Primary data saved (9845 records). [2025-10-31T19:34:09.082010] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-31T19:34:09.082286] [INFO ] [MAIN ] Update Progress: 1205/2365 symbols completed. KNOP took 20.8s. Estimated remaining: 2h 28m 20s. Rate: 7.8 symbols/min [2025-10-31T19:34:09.199143] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T19:34:09.271241] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:09.271431] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-31T19:34:09.271469] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-31T19:34:09.271582] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-31T19:34:09.271625] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-31T19:34:09.271706] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-31T19:34:09.271751] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-31T19:34:09.618208] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:09.857694] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-31T19:34:10.615828] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T19:34:10.657610] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-31T19:34:11.457700] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-31T19:34:11.806370] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T19:34:11.900716] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-31T19:34:12.257678] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-31T19:34:12.753875] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:34:13.057681] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-31T19:34:13.652329] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T19:34:13.675971] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T19:34:13.857676] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-31T19:34:14.657685] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-31T19:34:14.745813] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-31T19:34:15.457704] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-31T19:34:15.995412] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T19:34:16.257716] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-31T19:34:17.057740] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-31T19:34:17.299215] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T19:34:17.348122] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-31T19:34:17.722894] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-31T19:34:17.857699] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-31T19:34:18.657689] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-31T19:34:19.339599] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-31T19:34:19.457661] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-31T19:34:19.844996] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-31T19:34:20.257734] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-31T19:34:20.437693] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-31T19:34:21.057630] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-31T19:34:21.857681] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-31T19:34:22.217984] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-31T19:34:22.281014] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-31T19:34:22.657669] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-31T19:34:23.106855] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T19:34:23.457693] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-31T19:34:24.176057] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T19:34:24.257716] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-31T19:34:24.552327] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-31T19:34:25.057673] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-31T19:34:25.486217] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T19:34:25.857639] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-31T19:34:26.390381] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T19:34:26.567327] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-31T19:34:26.657628] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-31T19:34:27.372750] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-31T19:34:27.457700] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-31T19:34:28.257685] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-31T19:34:28.891786] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T19:34:29.057613] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-31T19:34:29.144890] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-31T19:34:29.150322] [INFO ] [REMOTE ] KNSL: Full fetch complete (27405 records). [2025-10-31T19:34:29.150410] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-31T19:34:29.514085] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-31T19:34:29.514180] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-31T19:34:29.514760] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-31T19:34:29.514820] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-31T19:34:29.515452] [DEBUG] [LOCAL ] KNSL: Trimmed 27405 records to 19031 (keeping 200 days of data) [2025-10-31T19:34:29.630390] [DEBUG] [LOCAL ] KNSL: Primary data saved (19031 records). [2025-10-31T19:34:29.630521] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-31T19:34:29.630595] [INFO ] [MAIN ] Update Progress: 1206/2365 symbols completed. KNSL took 29.8s. Estimated remaining: 2h 28m 24s. Rate: 7.8 symbols/min [2025-10-31T19:34:29.796500] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:29.844912] [DEBUG] [LOCAL ] KODK: Loaded 43618 existing records from primary storage. [2025-10-31T19:34:29.845250] [INFO ] [MAIN ] KODK: Loaded 43618 existing records. [2025-10-31T19:34:29.867584] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-31T19:34:30.036712] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:34:30.036995] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-31T19:34:30.037045] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-31T19:34:30.037310] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-31T19:34:30.037350] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-31T19:34:30.400849] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:30.425908] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T19:34:30.657626] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-31T19:34:31.457683] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-31T19:34:31.917922] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-31T19:34:31.958433] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:34:32.257679] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-31T19:34:32.556728] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T19:34:33.057632] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-31T19:34:33.472563] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T19:34:33.857671] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-31T19:34:34.389161] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-31T19:34:34.657668] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-31T19:34:35.457674] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-31T19:34:35.692721] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-31T19:34:35.912096] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-31T19:34:36.257735] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-31T19:34:36.624073] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T19:34:37.057716] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-31T19:34:37.277074] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-31T19:34:37.857673] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-31T19:34:38.657667] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-31T19:34:39.011497] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T19:34:39.056073] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-31T19:34:39.457684] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-31T19:34:40.013633] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T19:34:40.257684] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-31T19:34:40.572708] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-31T19:34:41.057713] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-31T19:34:41.857618] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-31T19:34:42.089387] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-31T19:34:42.122252] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T19:34:42.448540] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-31T19:34:42.461768] [INFO ] [REMOTE ] KNX: Full fetch complete (76373 records). [2025-10-31T19:34:42.461952] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-31T19:34:42.665432] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-31T19:34:42.850394] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-31T19:34:42.850469] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-31T19:34:42.851462] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-31T19:34:42.851525] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-31T19:34:42.852883] [DEBUG] [LOCAL ] KNX: Trimmed 76373 records to 53418 (keeping 200 days of data) [2025-10-31T19:34:43.171723] [DEBUG] [LOCAL ] KNX: Primary data saved (53418 records). [2025-10-31T19:34:43.171853] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-31T19:34:43.172579] [INFO ] [MAIN ] Update Progress: 1207/2365 symbols completed. KNX took 35.4s. Estimated remaining: 2h 28m 22s. Rate: 7.8 symbols/min [2025-10-31T19:34:43.342715] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:43.368589] [DEBUG] [LOCAL ] KOF: Loaded 26181 existing records from primary storage. [2025-10-31T19:34:43.368885] [INFO ] [MAIN ] KOF: Loaded 26181 existing records. [2025-10-31T19:34:43.458842] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-31T19:34:43.555191] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:34:43.555570] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-31T19:34:43.555687] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-31T19:34:43.555922] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-31T19:34:43.555979] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-31T19:34:43.893235] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T19:34:43.947202] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-31T19:34:43.958259] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-31T19:34:44.029307] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:44.199728] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-31T19:34:44.200493] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:34:44.200565] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:34:44.200637] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-31T19:34:44.200765] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-31T19:34:44.200845] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-31T19:34:44.200892] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-31T19:34:44.200953] [INFO ] [MAIN ] Update Progress: 1208/2365 symbols completed. KO took 35.1s. Estimated remaining: 2h 28m 8s. Rate: 7.8 symbols/min [2025-10-31T19:34:44.262889] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-31T19:34:44.370811] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:44.388007] [DEBUG] [LOCAL ] KOP: Loaded 17265 existing records from primary storage. [2025-10-31T19:34:44.388231] [INFO ] [MAIN ] KOP: Loaded 17265 existing records. [2025-10-31T19:34:44.563226] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:34:44.563451] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-31T19:34:44.563497] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-31T19:34:44.563691] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-31T19:34:44.563750] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-31T19:34:44.916337] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:44.962485] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T19:34:44.975290] [INFO ] [REMOTE ] KNTK: Full fetch complete (66323 records). [2025-10-31T19:34:44.975527] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-31T19:34:45.062864] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-31T19:34:45.420185] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-31T19:34:45.420305] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-31T19:34:45.421807] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-31T19:34:45.421878] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-31T19:34:45.423800] [DEBUG] [LOCAL ] KNTK: Trimmed 66323 records to 47829 (keeping 200 days of data) [2025-10-31T19:34:45.692564] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T19:34:45.787764] [DEBUG] [LOCAL ] KNTK: Primary data saved (47829 records). [2025-10-31T19:34:45.787959] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-31T19:34:45.788096] [INFO ] [MAIN ] Update Progress: 1209/2365 symbols completed. KNTK took 41.2s. Estimated remaining: 2h 27m 55s. Rate: 7.8 symbols/min [2025-10-31T19:34:45.863794] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-31T19:34:45.994184] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:45.999384] [DEBUG] [LOCAL ] KORE: Loaded 2327 existing records from primary storage. [2025-10-31T19:34:45.999551] [INFO ] [MAIN ] KORE: Loaded 2327 existing records. [2025-10-31T19:34:46.236683] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:34:46.237105] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-31T19:34:46.237282] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-31T19:34:46.237468] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-31T19:34:46.237545] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-31T19:34:46.360087] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:34:46.639660] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:46.657684] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-31T19:34:47.255586] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-31T19:34:47.457617] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-31T19:34:47.550219] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T19:34:48.176327] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-31T19:34:48.257670] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-31T19:34:49.057711] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-31T19:34:49.088308] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T19:34:49.410786] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-31T19:34:49.857675] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-31T19:34:50.657627] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-31T19:34:50.733406] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-31T19:34:51.457720] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-31T19:34:51.738786] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-31T19:34:51.829706] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-31T19:34:52.257715] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-31T19:34:52.570803] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-31T19:34:53.057662] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-31T19:34:53.339260] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-31T19:34:53.857661] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-31T19:34:54.524637] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-31T19:34:54.657676] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-31T19:34:54.931326] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-31T19:34:55.457686] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-31T19:34:56.155216] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T19:34:56.257679] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-31T19:34:57.057677] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-31T19:34:57.559070] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T19:34:57.569024] [INFO ] [REMOTE ] KODK: Full fetch complete (63107 records). [2025-10-31T19:34:57.569143] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-31T19:34:57.857670] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-31T19:34:57.953813] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-31T19:34:57.954100] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-31T19:34:57.955104] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-31T19:34:57.955263] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-31T19:34:57.972675] [DEBUG] [LOCAL ] KODK: Trimmed 63107 records to 43881 (keeping 200 days of data) [2025-10-31T19:34:57.974216] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-31T19:34:58.220494] [DEBUG] [LOCAL ] KODK: Primary data saved (43881 records). [2025-10-31T19:34:58.220620] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-31T19:34:58.220731] [INFO ] [MAIN ] Update Progress: 1210/2365 symbols completed. KODK took 28.6s. Estimated remaining: 2h 27m 51s. Rate: 7.8 symbols/min [2025-10-31T19:34:58.383853] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:34:58.434579] [DEBUG] [LOCAL ] KOS: Loaded 53472 existing records from primary storage. [2025-10-31T19:34:58.434994] [INFO ] [MAIN ] KOS: Loaded 53472 existing records. [2025-10-31T19:34:58.614051] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:34:58.614251] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-31T19:34:58.614297] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-31T19:34:58.614556] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-31T19:34:58.614596] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-31T19:34:58.665987] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-31T19:34:58.807186] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T19:34:58.997213] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:34:59.063831] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-31T19:34:59.457677] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-31T19:34:59.734144] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-31T19:35:00.257635] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-31T19:35:00.566399] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-31T19:35:01.057702] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-31T19:35:01.731807] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-31T19:35:01.733205] [INFO ] [REMOTE ] KORE: Full fetch complete (3660 records). [2025-10-31T19:35:01.733274] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-31T19:35:01.862852] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-31T19:35:02.095236] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-31T19:35:02.095313] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-31T19:35:02.095433] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-31T19:35:02.095471] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-31T19:35:02.095864] [DEBUG] [LOCAL ] KORE: Trimmed 3660 records to 2354 (keeping 200 days of data) [2025-10-31T19:35:02.108998] [DEBUG] [LOCAL ] KORE: Primary data saved (2354 records). [2025-10-31T19:35:02.109099] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-31T19:35:02.109172] [INFO ] [MAIN ] Update Progress: 1211/2365 symbols completed. KORE took 16.3s. Estimated remaining: 2h 27m 40s. Rate: 7.8 symbols/min [2025-10-31T19:35:02.281169] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:35:02.330155] [DEBUG] [LOCAL ] KR: Loaded 54071 existing records from primary storage. [2025-10-31T19:35:02.330470] [INFO ] [MAIN ] KR: Loaded 54071 existing records. [2025-10-31T19:35:02.509113] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:35:02.509344] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-31T19:35:02.509391] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-31T19:35:02.509699] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-31T19:35:02.509775] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-31T19:35:02.661116] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-31T19:35:02.873370] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:35:02.889096] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-31T19:35:03.457679] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-31T19:35:03.509221] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-31T19:35:04.233320] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-31T19:35:04.257700] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-31T19:35:04.950574] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T19:35:05.057735] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-31T19:35:05.863311] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-31T19:35:05.865898] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T19:35:06.657668] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-31T19:35:07.198604] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T19:35:07.457728] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-31T19:35:08.148812] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-31T19:35:08.186391] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:35:08.257637] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-31T19:35:09.057679] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-31T19:35:09.097415] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-31T19:35:09.857632] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-31T19:35:10.342497] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T19:35:10.657634] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-31T19:35:11.104244] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:35:11.457724] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-31T19:35:11.712253] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-31T19:35:11.718601] [INFO ] [REMOTE ] KOF: Full fetch complete (37810 records). [2025-10-31T19:35:11.718782] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-31T19:35:12.087901] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-31T19:35:12.087983] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-31T19:35:12.088682] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-31T19:35:12.088742] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-31T19:35:12.089573] [DEBUG] [LOCAL ] KOF: Trimmed 37810 records to 26323 (keeping 200 days of data) [2025-10-31T19:35:12.248666] [DEBUG] [LOCAL ] KOF: Primary data saved (26323 records). [2025-10-31T19:35:12.248799] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-31T19:35:12.248876] [INFO ] [MAIN ] Update Progress: 1212/2365 symbols completed. KOF took 29.1s. Estimated remaining: 2h 27m 35s. Rate: 7.8 symbols/min [2025-10-31T19:35:12.262750] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-31T19:35:12.435379] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:35:12.476042] [DEBUG] [LOCAL ] KRC: Loaded 48251 existing records from primary storage. [2025-10-31T19:35:12.476338] [INFO ] [MAIN ] KRC: Loaded 48251 existing records. [2025-10-31T19:35:12.651200] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:35:12.651371] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-31T19:35:12.651416] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-31T19:35:12.651730] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-31T19:35:12.651786] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-31T19:35:13.005603] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:35:13.040091] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-31T19:35:13.057608] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-31T19:35:13.472580] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T19:35:13.721894] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T19:35:13.857735] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-31T19:35:14.657677] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-31T19:35:15.044022] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T19:35:15.416761] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T19:35:15.457611] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-31T19:35:16.257731] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-31T19:35:16.839505] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-31T19:35:17.057693] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-31T19:35:17.076667] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-31T19:35:17.857708] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-31T19:35:18.657868] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-31T19:35:18.697983] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T19:35:19.117699] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T19:35:19.292356] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T19:35:19.296732] [INFO ] [REMOTE ] KOP: Full fetch complete (25450 records). [2025-10-31T19:35:19.296815] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-31T19:35:19.465177] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-31T19:35:19.658203] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-31T19:35:19.658289] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-31T19:35:19.658863] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-31T19:35:19.658931] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-31T19:35:19.659601] [DEBUG] [LOCAL ] KOP: Trimmed 25450 records to 17407 (keeping 200 days of data) [2025-10-31T19:35:19.761452] [DEBUG] [LOCAL ] KOP: Primary data saved (17407 records). [2025-10-31T19:35:19.761588] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-31T19:35:19.761690] [INFO ] [MAIN ] Update Progress: 1213/2365 symbols completed. KOP took 35.6s. Estimated remaining: 2h 27m 27s. Rate: 7.8 symbols/min [2025-10-31T19:35:19.927019] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:35:19.962862] [DEBUG] [LOCAL ] KREF: Loaded 38100 existing records from primary storage. [2025-10-31T19:35:19.963165] [INFO ] [MAIN ] KREF: Loaded 38100 existing records. [2025-10-31T19:35:20.143068] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:35:20.143301] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-31T19:35:20.143348] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-31T19:35:20.143554] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-31T19:35:20.143595] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-31T19:35:20.262900] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-31T19:35:20.509966] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:35:20.826898] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-31T19:35:21.057694] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-31T19:35:21.708254] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T19:35:21.857611] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-31T19:35:21.921107] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T19:35:22.657679] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-31T19:35:23.184546] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T19:35:23.399634] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-31T19:35:23.457632] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-31T19:35:24.257616] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-31T19:35:24.428084] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T19:35:25.057677] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-31T19:35:25.430088] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-31T19:35:25.857693] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-31T19:35:26.158484] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T19:35:26.657714] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-31T19:35:27.069133] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T19:35:27.457627] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-31T19:35:28.123840] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-31T19:35:28.257680] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-31T19:35:28.573266] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T19:35:29.057724] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-31T19:35:29.597566] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-31T19:35:29.857736] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-31T19:35:30.370062] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T19:35:30.657677] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-31T19:35:30.948843] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-31T19:35:31.457637] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-31T19:35:31.958207] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:35:32.257698] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-31T19:35:32.456257] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T19:35:33.057704] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-31T19:35:33.546140] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T19:35:33.857689] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-31T19:35:34.201696] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-31T19:35:34.657669] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-31T19:35:35.340709] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-31T19:35:35.457692] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-31T19:35:35.574573] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-31T19:35:36.257737] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-31T19:35:36.799160] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-31T19:35:37.057719] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-31T19:35:37.544962] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T19:35:37.857710] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-31T19:35:38.447928] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-31T19:35:38.657701] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-31T19:35:39.075425] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T19:35:39.457727] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-31T19:35:40.234982] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-31T19:35:40.248974] [INFO ] [REMOTE ] KOS: Full fetch complete (77036 records). [2025-10-31T19:35:40.249452] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-31T19:35:40.263735] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-31T19:35:40.671921] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-31T19:35:40.672047] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-31T19:35:40.673682] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-31T19:35:40.673767] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-31T19:35:40.676105] [DEBUG] [LOCAL ] KOS: Trimmed 77036 records to 53855 (keeping 200 days of data) [2025-10-31T19:35:41.058360] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-31T19:35:41.066008] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-31T19:35:41.086383] [DEBUG] [LOCAL ] KOS: Primary data saved (53855 records). [2025-10-31T19:35:41.086732] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-31T19:35:41.086859] [INFO ] [MAIN ] Update Progress: 1214/2365 symbols completed. KOS took 42.9s. Estimated remaining: 2h 27m 32s. Rate: 7.8 symbols/min [2025-10-31T19:35:41.314586] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:35:41.367581] [DEBUG] [LOCAL ] KRG: Loaded 49575 existing records from primary storage. [2025-10-31T19:35:41.368065] [INFO ] [MAIN ] KRG: Loaded 49575 existing records. [2025-10-31T19:35:41.571758] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:35:41.572231] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-31T19:35:41.572297] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-31T19:35:41.573194] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-31T19:35:41.573261] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-31T19:35:41.858771] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-31T19:35:41.935458] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-31T19:35:41.979179] [INFO ] [REMOTE ] KRC: Full fetch complete (70086 records). [2025-10-31T19:35:41.997158] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-31T19:35:42.038127] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:35:42.340247] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T19:35:42.477330] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-31T19:35:42.477461] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-31T19:35:42.478498] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-31T19:35:42.478715] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-31T19:35:42.480773] [DEBUG] [LOCAL ] KRC: Trimmed 70086 records to 48599 (keeping 200 days of data) [2025-10-31T19:35:42.619617] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-31T19:35:42.642290] [INFO ] [REMOTE ] KR: Full fetch complete (77844 records). [2025-10-31T19:35:42.643298] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-31T19:35:42.667048] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-31T19:35:43.176412] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-31T19:35:43.177083] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-31T19:35:43.178448] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-31T19:35:43.178537] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-31T19:35:43.182671] [DEBUG] [LOCAL ] KR: Trimmed 77844 records to 54461 (keeping 200 days of data) [2025-10-31T19:35:43.466766] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-31T19:35:43.517200] [DEBUG] [LOCAL ] KRC: Primary data saved (48599 records). [2025-10-31T19:35:43.517326] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-31T19:35:43.518031] [INFO ] [MAIN ] Update Progress: 1215/2365 symbols completed. KRC took 31.3s. Estimated remaining: 2h 27m 20s. Rate: 7.8 symbols/min [2025-10-31T19:35:43.774052] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:35:43.778185] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-31T19:35:43.786819] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-31T19:35:43.789502] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-31T19:35:43.789937] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-31T19:35:43.791882] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-31T19:35:43.791803] [DEBUG] [LOCAL ] KR: Primary data saved (54461 records). [2025-10-31T19:35:43.792029] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-31T19:35:43.807203] [INFO ] [MAIN ] KR: Full history saved. [2025-10-31T19:35:43.823627] [INFO ] [MAIN ] Update Progress: 1216/2365 symbols completed. KR took 41.7s. Estimated remaining: 2h 27m 5s. Rate: 7.8 symbols/min [2025-10-31T19:35:44.213942] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:35:44.287505] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T19:35:44.382695] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:35:44.378634] [INFO ] [REMOTE ] KREF: Full fetch complete (53266 records). [2025-10-31T19:35:44.382955] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-31T19:35:44.383226] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-31T19:35:44.494018] [DEBUG] [LOCAL ] KRO: Loaded 26694 existing records from primary storage. [2025-10-31T19:35:44.504784] [INFO ] [MAIN ] KRO: Loaded 26694 existing records. [2025-10-31T19:35:44.587154] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T19:35:44.648768] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-31T19:35:44.674215] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:35:44.719387] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-31T19:35:44.761301] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:35:44.816257] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-31T19:35:44.839881] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-31T19:35:44.886187] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-31T19:35:44.907467] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:35:44.918247] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-31T19:35:44.918505] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-31T19:35:44.946834] [INFO ] [MAIN ] Update Progress: 1217/2365 symbols completed. KRMN took 1.4s. Estimated remaining: 2h 26m 51s. Rate: 7.8 symbols/min [2025-10-31T19:35:44.956857] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-31T19:35:45.030509] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-31T19:35:45.035837] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-31T19:35:45.036131] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-31T19:35:45.063208] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-31T19:35:45.110908] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-31T19:35:45.137424] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-31T19:35:45.144226] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-31T19:35:45.196315] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-31T19:35:45.317639] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:35:45.317779] [DEBUG] [LOCAL ] KREF: Trimmed 53266 records to 38409 (keeping 200 days of data) [2025-10-31T19:35:45.756627] [DEBUG] [LOCAL ] KRP: Loaded 35661 existing records from primary storage. [2025-10-31T19:35:45.825496] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:35:45.843583] [INFO ] [MAIN ] KRP: Loaded 35661 existing records. [2025-10-31T19:35:45.843310] [DEBUG] [LOCAL ] KREF: Primary data saved (38409 records). [2025-10-31T19:35:45.865426] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-31T19:35:45.844123] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-31T19:35:45.876956] [INFO ] [MAIN ] Update Progress: 1218/2365 symbols completed. KREF took 26.1s. Estimated remaining: 2h 26m 37s. Rate: 7.8 symbols/min [2025-10-31T19:35:46.243384] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:35:46.265441] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:35:46.265701] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-31T19:35:46.265762] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-31T19:35:46.266062] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-31T19:35:46.266117] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-31T19:35:46.604431] [DEBUG] [LOCAL ] KSS: Loaded 53957 existing records from primary storage. [2025-10-31T19:35:46.631491] [INFO ] [MAIN ] KSS: Loaded 53957 existing records. [2025-10-31T19:35:46.812260] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-31T19:35:46.847253] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T19:35:46.821776] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:35:46.847810] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-31T19:35:46.919724] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:35:46.919975] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-31T19:35:46.920024] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-31T19:35:46.920354] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-31T19:35:46.920407] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-31T19:35:47.277284] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:35:47.457672] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-31T19:35:48.121884] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T19:35:48.257685] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-31T19:35:48.769321] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T19:35:48.839690] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-31T19:35:49.057680] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-31T19:35:49.857726] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-31T19:35:50.295607] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T19:35:50.657682] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-31T19:35:51.340171] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-31T19:35:51.457694] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-31T19:35:51.811160] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T19:35:52.172720] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-31T19:35:52.257686] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-31T19:35:53.057676] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-31T19:35:53.747554] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-31T19:35:53.857611] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-31T19:35:54.066522] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T19:35:54.657638] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-31T19:35:55.405930] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-31T19:35:55.457620] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-31T19:35:55.843755] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T19:35:56.257671] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-31T19:35:56.865318] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T19:35:57.057707] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-31T19:35:57.349141] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T19:35:57.857708] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-31T19:35:58.459699] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-31T19:35:58.642512] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-31T19:35:58.657681] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-31T19:35:59.457670] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-31T19:35:59.485117] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-31T19:36:00.257749] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-31T19:36:00.651007] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T19:36:01.057672] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-31T19:36:01.731283] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T19:36:01.857681] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-31T19:36:02.596693] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-31T19:36:02.657668] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-31T19:36:02.721095] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-31T19:36:03.457715] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-31T19:36:03.827995] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-31T19:36:04.257708] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-31T19:36:04.569417] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-31T19:36:05.065780] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-31T19:36:05.070876] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-31T19:36:05.857728] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-31T19:36:06.278206] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-31T19:36:06.657676] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-31T19:36:07.074354] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-31T19:36:07.457735] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-31T19:36:08.162522] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-31T19:36:08.174355] [INFO ] [REMOTE ] KRG: Full fetch complete (71507 records). [2025-10-31T19:36:08.174568] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-31T19:36:08.262945] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-31T19:36:08.576066] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-31T19:36:08.576147] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-31T19:36:08.577219] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-31T19:36:08.577285] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-31T19:36:08.578685] [DEBUG] [LOCAL ] KRG: Trimmed 71507 records to 49947 (keeping 200 days of data) [2025-10-31T19:36:08.883935] [DEBUG] [LOCAL ] KRG: Primary data saved (49947 records). [2025-10-31T19:36:08.884062] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-31T19:36:08.884140] [INFO ] [MAIN ] Update Progress: 1219/2365 symbols completed. KRG took 27.8s. Estimated remaining: 2h 26m 44s. Rate: 7.8 symbols/min [2025-10-31T19:36:09.066332] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-31T19:36:09.072005] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:36:09.123885] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-31T19:36:09.172161] [DEBUG] [LOCAL ] KT: Loaded 45343 existing records from primary storage. [2025-10-31T19:36:09.172512] [INFO ] [MAIN ] KT: Loaded 45343 existing records. [2025-10-31T19:36:09.366752] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:36:09.367004] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-31T19:36:09.367102] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-31T19:36:09.375568] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-31T19:36:09.387384] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-31T19:36:09.461607] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-31T19:36:09.760113] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:36:09.857620] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-31T19:36:10.073433] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T19:36:10.657713] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-31T19:36:10.795503] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-31T19:36:11.457725] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-31T19:36:12.116488] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-31T19:36:12.257700] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-31T19:36:12.443410] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-31T19:36:13.057678] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-31T19:36:13.281481] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T19:36:13.857684] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-31T19:36:14.358720] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T19:36:14.657681] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-31T19:36:14.747868] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-31T19:36:15.457730] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-31T19:36:16.257675] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-31T19:36:16.398717] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-31T19:36:16.411905] [INFO ] [REMOTE ] KSS: Full fetch complete (77728 records). [2025-10-31T19:36:16.412100] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-31T19:36:16.839334] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-31T19:36:16.839450] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-31T19:36:16.840546] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-31T19:36:16.840727] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-31T19:36:16.874329] [DEBUG] [LOCAL ] KSS: Trimmed 77728 records to 54344 (keeping 200 days of data) [2025-10-31T19:36:16.875832] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-31T19:36:17.058549] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-31T19:36:17.223434] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T19:36:17.250098] [DEBUG] [LOCAL ] KSS: Primary data saved (54344 records). [2025-10-31T19:36:17.250249] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-31T19:36:17.250331] [INFO ] [MAIN ] Update Progress: 1220/2365 symbols completed. KSS took 31.4s. Estimated remaining: 2h 26m 37s. Rate: 7.8 symbols/min [2025-10-31T19:36:17.438246] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:36:17.476461] [DEBUG] [LOCAL ] KTB: Loaded 39923 existing records from primary storage. [2025-10-31T19:36:17.476820] [INFO ] [MAIN ] KTB: Loaded 39923 existing records. [2025-10-31T19:36:17.670051] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:36:17.670258] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-31T19:36:17.670310] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-31T19:36:17.670520] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-31T19:36:17.670577] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-31T19:36:17.869154] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-31T19:36:18.065323] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:36:18.090104] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-31T19:36:18.097817] [INFO ] [REMOTE ] KRO: Full fetch complete (35611 records). [2025-10-31T19:36:18.098122] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-31T19:36:18.507461] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-31T19:36:18.507605] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-31T19:36:18.508430] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-31T19:36:18.508494] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-31T19:36:18.509565] [DEBUG] [LOCAL ] KRO: Trimmed 35611 records to 26860 (keeping 200 days of data) [2025-10-31T19:36:18.662242] [DEBUG] [LOCAL ] KRO: Primary data saved (26860 records). [2025-10-31T19:36:18.662347] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-31T19:36:18.662608] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-31T19:36:18.663049] [INFO ] [MAIN ] Update Progress: 1221/2365 symbols completed. KRO took 34.8s. Estimated remaining: 2h 26m 23s. Rate: 7.8 symbols/min [2025-10-31T19:36:18.846076] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:36:18.861197] [DEBUG] [LOCAL ] KTF: Loaded 11700 existing records from primary storage. [2025-10-31T19:36:18.861493] [INFO ] [MAIN ] KTF: Loaded 11700 existing records. [2025-10-31T19:36:19.079281] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:36:19.079595] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-31T19:36:19.079811] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-31T19:36:19.080234] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-31T19:36:19.080399] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-31T19:36:19.231455] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T19:36:19.274103] [INFO ] [REMOTE ] KRP: Full fetch complete (54373 records). [2025-10-31T19:36:19.286087] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-31T19:36:19.466774] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-31T19:36:19.858661] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:36:19.948816] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-31T19:36:19.949029] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-31T19:36:19.949921] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-31T19:36:19.949996] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-31T19:36:19.951174] [DEBUG] [LOCAL ] KRP: Trimmed 54373 records to 35905 (keeping 200 days of data) [2025-10-31T19:36:20.137139] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-31T19:36:20.189411] [DEBUG] [LOCAL ] KRP: Primary data saved (35905 records). [2025-10-31T19:36:20.189554] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-31T19:36:20.189636] [INFO ] [MAIN ] Update Progress: 1222/2365 symbols completed. KRP took 35.2s. Estimated remaining: 2h 26m 10s. Rate: 7.8 symbols/min [2025-10-31T19:36:20.262886] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-31T19:36:20.360860] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:36:20.413898] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-31T19:36:20.414236] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-10-31T19:36:20.590837] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:36:20.591261] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-31T19:36:20.591364] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-31T19:36:20.591782] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-31T19:36:20.591841] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-31T19:36:20.874235] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T19:36:21.030855] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:36:21.043049] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T19:36:21.057602] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-31T19:36:21.546273] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-31T19:36:21.857703] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-31T19:36:22.657685] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-31T19:36:23.011511] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-31T19:36:23.459835] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-31T19:36:23.462942] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-31T19:36:24.257683] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-31T19:36:24.557764] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T19:36:24.895948] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T19:36:25.057743] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-31T19:36:25.539703] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-31T19:36:25.857703] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-31T19:36:26.435862] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-31T19:36:26.657728] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-31T19:36:27.457669] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-31T19:36:27.945369] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-31T19:36:28.257678] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-31T19:36:28.554785] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-31T19:36:29.057670] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-31T19:36:29.634044] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-31T19:36:29.670004] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T19:36:29.857684] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-31T19:36:30.657637] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-31T19:36:31.297539] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-31T19:36:31.457722] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-31T19:36:31.758580] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T19:36:32.257683] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-31T19:36:32.729805] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T19:36:33.057681] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-31T19:36:33.357864] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-31T19:36:33.857629] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-31T19:36:34.353781] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T19:36:34.657689] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-31T19:36:34.966976] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T19:36:35.251740] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T19:36:35.457695] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-31T19:36:36.257694] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-31T19:36:36.575395] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T19:36:37.057664] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-31T19:36:37.494237] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-31T19:36:37.857683] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-31T19:36:38.271783] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-31T19:36:38.657632] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-31T19:36:38.824477] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-31T19:36:39.457683] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-31T19:36:39.955522] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T19:36:39.965505] [INFO ] [REMOTE ] KT: Full fetch complete (66378 records). [2025-10-31T19:36:39.965619] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-31T19:36:40.079343] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-31T19:36:40.262770] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-31T19:36:40.366515] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-31T19:36:40.366585] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-31T19:36:40.367510] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-31T19:36:40.367571] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-31T19:36:40.368839] [DEBUG] [LOCAL ] KT: Trimmed 66378 records to 45648 (keeping 200 days of data) [2025-10-31T19:36:40.630867] [DEBUG] [LOCAL ] KT: Primary data saved (45648 records). [2025-10-31T19:36:40.631011] [INFO ] [MAIN ] KT: Full history saved. [2025-10-31T19:36:40.631130] [INFO ] [MAIN ] Update Progress: 1223/2365 symbols completed. KT took 31.7s. Estimated remaining: 2h 26m 14s. Rate: 7.8 symbols/min [2025-10-31T19:36:40.800943] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:36:40.847226] [DEBUG] [LOCAL ] KVYO: Loaded 51293 existing records from primary storage. [2025-10-31T19:36:40.847524] [INFO ] [MAIN ] KVYO: Loaded 51293 existing records. [2025-10-31T19:36:41.025554] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:36:41.025802] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-31T19:36:41.025855] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-31T19:36:41.026170] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-31T19:36:41.026209] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-31T19:36:41.067336] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-31T19:36:41.399098] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:36:41.857639] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-31T19:36:41.905091] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-31T19:36:41.964170] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-31T19:36:41.967442] [INFO ] [REMOTE ] KTF: Full fetch complete (17814 records). [2025-10-31T19:36:41.967515] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-31T19:36:42.337221] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-31T19:36:42.337300] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-31T19:36:42.337731] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-31T19:36:42.337793] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-31T19:36:42.338367] [DEBUG] [LOCAL ] KTF: Trimmed 17814 records to 11904 (keeping 200 days of data) [2025-10-31T19:36:42.408316] [DEBUG] [LOCAL ] KTF: Primary data saved (11904 records). [2025-10-31T19:36:42.408472] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-31T19:36:42.408561] [INFO ] [MAIN ] Update Progress: 1224/2365 symbols completed. KTF took 23.7s. Estimated remaining: 2h 26m 1s. Rate: 7.8 symbols/min [2025-10-31T19:36:42.581135] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:36:42.616520] [DEBUG] [LOCAL ] KW: Loaded 40224 existing records from primary storage. [2025-10-31T19:36:42.616828] [INFO ] [MAIN ] KW: Loaded 40224 existing records. [2025-10-31T19:36:42.667496] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-31T19:36:42.816639] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:36:42.817118] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-31T19:36:42.817203] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-31T19:36:42.817595] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-31T19:36:42.817711] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-31T19:36:42.997855] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-31T19:36:43.210364] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:36:43.457632] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-31T19:36:44.081920] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-31T19:36:44.257625] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-31T19:36:44.423244] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-31T19:36:45.057673] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-31T19:36:45.355262] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-31T19:36:45.857733] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-31T19:36:46.179539] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T19:36:46.657686] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-31T19:36:46.870017] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-31T19:36:47.457715] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-31T19:36:48.262952] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-31T19:36:48.276242] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-31T19:36:48.506245] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T19:36:49.057629] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-31T19:36:49.440035] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T19:36:49.857712] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-31T19:36:50.657667] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-31T19:36:50.990748] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-31T19:36:51.457628] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-31T19:36:51.592718] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-31T19:36:52.257726] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-31T19:36:52.693488] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T19:36:53.057665] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-31T19:36:53.204584] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-31T19:36:53.219699] [INFO ] [REMOTE ] KVUE: Full fetch complete (77846 records). [2025-10-31T19:36:53.219905] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-31T19:36:53.687143] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-31T19:36:53.687356] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-31T19:36:53.688769] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-31T19:36:53.688876] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-31T19:36:53.690601] [DEBUG] [LOCAL ] KVUE: Trimmed 77846 records to 54447 (keeping 200 days of data) [2025-10-31T19:36:53.838028] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-31T19:36:53.859005] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-31T19:36:54.124541] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-10-31T19:36:54.124704] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-31T19:36:54.125271] [INFO ] [MAIN ] Update Progress: 1225/2365 symbols completed. KVUE took 33.9s. Estimated remaining: 2h 25m 57s. Rate: 7.8 symbols/min [2025-10-31T19:36:54.292972] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:36:54.319525] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T19:36:54.339803] [DEBUG] [LOCAL ] KWR: Loaded 15427 existing records from primary storage. [2025-10-31T19:36:54.340020] [INFO ] [MAIN ] KWR: Loaded 15427 existing records. [2025-10-31T19:36:54.526067] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:36:54.526267] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-31T19:36:54.526313] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-31T19:36:54.526545] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-31T19:36:54.526601] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-31T19:36:54.662726] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-31T19:36:54.870885] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:36:55.138320] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-31T19:36:55.457678] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-31T19:36:55.890362] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-31T19:36:56.257662] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-31T19:36:56.550692] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-31T19:36:56.953119] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-31T19:36:57.057679] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-31T19:36:57.857678] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-31T19:36:58.143888] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T19:36:58.657680] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-31T19:36:58.965774] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T19:36:59.313843] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-31T19:36:59.457735] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-31T19:37:00.198706] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-31T19:37:00.257682] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-31T19:37:01.057634] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-31T19:37:01.561112] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T19:37:01.569514] [INFO ] [REMOTE ] KTB: Full fetch complete (58168 records). [2025-10-31T19:37:01.569757] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-31T19:37:01.860087] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-31T19:37:01.952948] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-31T19:37:01.953033] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-31T19:37:01.953917] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-31T19:37:01.953980] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-31T19:37:01.955239] [DEBUG] [LOCAL ] KTB: Trimmed 58168 records to 40203 (keeping 200 days of data) [2025-10-31T19:37:02.198071] [DEBUG] [LOCAL ] KTB: Primary data saved (40203 records). [2025-10-31T19:37:02.198213] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-31T19:37:02.198403] [INFO ] [MAIN ] Update Progress: 1226/2365 symbols completed. KTB took 44.9s. Estimated remaining: 2h 25m 50s. Rate: 7.8 symbols/min [2025-10-31T19:37:02.371354] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:37:02.402830] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-31T19:37:02.436357] [DEBUG] [LOCAL ] KYN: Loaded 29932 existing records from primary storage. [2025-10-31T19:37:02.436624] [INFO ] [MAIN ] KYN: Loaded 29932 existing records. [2025-10-31T19:37:02.615107] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:37:02.615556] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-31T19:37:02.615727] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-31T19:37:02.615990] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-31T19:37:02.616133] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-31T19:37:02.678707] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-31T19:37:02.761074] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-31T19:37:03.060521] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:37:03.457690] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-31T19:37:03.709253] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-31T19:37:04.257679] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-31T19:37:04.506488] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T19:37:05.057669] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-31T19:37:05.368338] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T19:37:05.857670] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-31T19:37:05.923288] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T19:37:06.657679] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-31T19:37:06.966979] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T19:37:06.978847] [INFO ] [REMOTE ] KW: Full fetch complete (57244 records). [2025-10-31T19:37:06.979097] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-31T19:37:07.404164] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-31T19:37:07.404351] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-31T19:37:07.405455] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-31T19:37:07.405548] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-31T19:37:07.423960] [DEBUG] [LOCAL ] KW: Trimmed 57244 records to 40547 (keeping 200 days of data) [2025-10-31T19:37:07.423850] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T19:37:07.477153] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-31T19:37:07.664222] [DEBUG] [LOCAL ] KW: Primary data saved (40547 records). [2025-10-31T19:37:07.664345] [INFO ] [MAIN ] KW: Full history saved. [2025-10-31T19:37:07.664418] [INFO ] [MAIN ] Update Progress: 1227/2365 symbols completed. KW took 25.3s. Estimated remaining: 2h 25m 40s. Rate: 7.8 symbols/min [2025-10-31T19:37:07.833053] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:37:07.868751] [DEBUG] [LOCAL ] L: Loaded 41084 existing records from primary storage. [2025-10-31T19:37:07.869009] [INFO ] [MAIN ] L: Loaded 41084 existing records. [2025-10-31T19:37:08.044720] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:37:08.044949] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-31T19:37:08.044995] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-31T19:37:08.045204] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-31T19:37:08.045244] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-31T19:37:08.264512] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-31T19:37:08.404908] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:37:08.512631] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-31T19:37:08.992568] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-31T19:37:09.057638] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-31T19:37:09.753070] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-31T19:37:09.857689] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-31T19:37:10.657718] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-31T19:37:11.051110] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T19:37:11.373741] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T19:37:11.457737] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-31T19:37:12.257684] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-31T19:37:12.296529] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T19:37:12.910839] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-31T19:37:13.057701] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-31T19:37:13.857690] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-31T19:37:14.111977] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T19:37:14.485439] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-31T19:37:14.657723] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-31T19:37:15.384769] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-31T19:37:15.387929] [INFO ] [REMOTE ] KWR: Full fetch complete (23021 records). [2025-10-31T19:37:15.388003] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-31T19:37:15.462823] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-31T19:37:15.749770] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-31T19:37:15.749878] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-31T19:37:15.750355] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-31T19:37:15.750394] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-31T19:37:15.750978] [DEBUG] [LOCAL ] KWR: Trimmed 23021 records to 15591 (keeping 200 days of data) [2025-10-31T19:37:15.844844] [DEBUG] [LOCAL ] KWR: Primary data saved (15591 records). [2025-10-31T19:37:15.844975] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-31T19:37:15.845050] [INFO ] [MAIN ] Update Progress: 1228/2365 symbols completed. KWR took 21.7s. Estimated remaining: 2h 25m 33s. Rate: 7.8 symbols/min [2025-10-31T19:37:16.022622] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:37:16.072154] [DEBUG] [LOCAL ] LAC: Loaded 52997 existing records from primary storage. [2025-10-31T19:37:16.072481] [INFO ] [MAIN ] LAC: Loaded 52997 existing records. [2025-10-31T19:37:16.256588] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:37:16.256840] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-31T19:37:16.256890] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-31T19:37:16.257084] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-31T19:37:16.257123] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-31T19:37:16.268416] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-31T19:37:16.619506] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:37:16.635600] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T19:37:17.057729] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-31T19:37:17.518526] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:37:17.857691] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-31T19:37:18.368796] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T19:37:18.657687] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-31T19:37:18.938804] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-31T19:37:19.457614] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-31T19:37:19.535598] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-31T19:37:20.257688] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-31T19:37:20.977295] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-31T19:37:21.057724] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-31T19:37:21.847452] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-31T19:37:21.858966] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-31T19:37:21.860955] [INFO ] [REMOTE ] KVYO: Full fetch complete (72555 records). [2025-10-31T19:37:21.861126] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-31T19:37:22.258389] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-31T19:37:22.258500] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-31T19:37:22.259585] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-31T19:37:22.259718] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-31T19:37:22.285628] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T19:37:22.295381] [DEBUG] [LOCAL ] KVYO: Trimmed 72555 records to 51661 (keeping 200 days of data) [2025-10-31T19:37:22.593175] [DEBUG] [LOCAL ] KVYO: Primary data saved (51661 records). [2025-10-31T19:37:22.593309] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-31T19:37:22.593388] [INFO ] [MAIN ] Update Progress: 1229/2365 symbols completed. KVYO took 42.0s. Estimated remaining: 2h 25m 24s. Rate: 7.8 symbols/min [2025-10-31T19:37:22.657931] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-31T19:37:22.766920] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:37:22.790404] [DEBUG] [LOCAL ] LAD: Loaded 23367 existing records from primary storage. [2025-10-31T19:37:22.810253] [INFO ] [MAIN ] LAD: Loaded 23367 existing records. [2025-10-31T19:37:22.882773] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T19:37:23.027265] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:37:23.027540] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-31T19:37:23.027604] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-31T19:37:23.027867] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-31T19:37:23.027931] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-31T19:37:23.458307] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:37:23.458430] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-31T19:37:24.109784] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-31T19:37:24.257676] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-31T19:37:24.596685] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-31T19:37:25.057678] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-31T19:37:25.635828] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T19:37:25.857681] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-31T19:37:26.178758] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T19:37:26.657694] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-31T19:37:27.457696] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-31T19:37:27.495904] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-31T19:37:27.611416] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T19:37:28.257677] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-31T19:37:28.625893] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-31T19:37:29.064220] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-31T19:37:29.070536] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-31T19:37:29.857684] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-31T19:37:30.361180] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-31T19:37:30.657667] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-31T19:37:31.314347] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-31T19:37:31.457686] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-31T19:37:31.762924] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:37:32.257691] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-31T19:37:32.819564] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-31T19:37:33.057665] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-31T19:37:33.379164] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-31T19:37:33.386478] [INFO ] [REMOTE ] KYN: Full fetch complete (44269 records). [2025-10-31T19:37:33.386598] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-31T19:37:33.752617] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-31T19:37:33.752718] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-31T19:37:33.753464] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-31T19:37:33.753524] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-31T19:37:33.754452] [DEBUG] [LOCAL ] KYN: Trimmed 44269 records to 30215 (keeping 200 days of data) [2025-10-31T19:37:33.858676] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-31T19:37:33.935767] [DEBUG] [LOCAL ] KYN: Primary data saved (30215 records). [2025-10-31T19:37:33.935898] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-31T19:37:33.935975] [INFO ] [MAIN ] Update Progress: 1230/2365 symbols completed. KYN took 31.7s. Estimated remaining: 2h 25m 20s. Rate: 7.8 symbols/min [2025-10-31T19:37:34.103602] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:37:34.139545] [DEBUG] [LOCAL ] LADR: Loaded 39354 existing records from primary storage. [2025-10-31T19:37:34.139859] [INFO ] [MAIN ] LADR: Loaded 39354 existing records. [2025-10-31T19:37:34.318768] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:37:34.318989] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-31T19:37:34.319051] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-31T19:37:34.319260] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-31T19:37:34.319316] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-31T19:37:34.661080] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-31T19:37:34.722710] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:37:34.718974] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-31T19:37:34.732885] [INFO ] [REMOTE ] L: Full fetch complete (59265 records). [2025-10-31T19:37:34.732963] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-31T19:37:35.106246] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-31T19:37:35.106352] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-31T19:37:35.107234] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-31T19:37:35.107295] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-31T19:37:35.108429] [DEBUG] [LOCAL ] L: Trimmed 59265 records to 41402 (keeping 200 days of data) [2025-10-31T19:37:35.353035] [DEBUG] [LOCAL ] L: Primary data saved (41402 records). [2025-10-31T19:37:35.353165] [INFO ] [MAIN ] L: Full history saved. [2025-10-31T19:37:35.353270] [INFO ] [MAIN ] Update Progress: 1231/2365 symbols completed. L took 27.7s. Estimated remaining: 2h 25m 6s. Rate: 7.8 symbols/min [2025-10-31T19:37:35.465746] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-31T19:37:35.526781] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:37:35.566140] [DEBUG] [LOCAL ] LANV: Loaded 2777 existing records from primary storage. [2025-10-31T19:37:35.565912] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-31T19:37:35.566679] [INFO ] [MAIN ] LANV: Loaded 2777 existing records. [2025-10-31T19:37:35.691197] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-31T19:37:35.771597] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:37:35.771785] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-31T19:37:35.771832] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-31T19:37:35.771974] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-31T19:37:35.772029] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-31T19:37:36.122101] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:37:36.257625] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-31T19:37:36.441994] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T19:37:36.651549] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-31T19:37:37.057744] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-31T19:37:37.857681] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-31T19:37:37.995746] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T19:37:38.115089] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-31T19:37:38.657741] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-31T19:37:39.457616] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-31T19:37:39.591033] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T19:37:40.257622] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-31T19:37:40.418749] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-31T19:37:40.686950] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-31T19:37:41.057670] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-31T19:37:41.857756] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-31T19:37:42.322860] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T19:37:42.657671] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-31T19:37:42.714861] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-31T19:37:43.457638] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-31T19:37:43.604523] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-31T19:37:44.257679] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-31T19:37:44.967743] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-31T19:37:45.057696] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-31T19:37:45.294509] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-31T19:37:45.377827] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-31T19:37:45.857677] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-31T19:37:46.657715] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-31T19:37:47.044048] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T19:37:47.457683] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-31T19:37:47.750662] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-31T19:37:48.257703] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-31T19:37:48.557086] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-31T19:37:48.569385] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-31T19:37:49.057679] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-31T19:37:49.358935] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-31T19:37:49.857712] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-31T19:37:50.221669] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-31T19:37:50.657675] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-31T19:37:51.438896] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-31T19:37:51.457617] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-31T19:37:52.240635] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-31T19:37:52.257600] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-31T19:37:53.057637] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-31T19:37:53.118698] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T19:37:53.857686] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-31T19:37:54.657720] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-31T19:37:54.900363] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-31T19:37:55.383625] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-31T19:37:55.402854] [INFO ] [REMOTE ] LAC: Full fetch complete (76170 records). [2025-10-31T19:37:55.403047] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-31T19:37:55.466314] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-31T19:37:55.686247] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T19:37:55.910711] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-31T19:37:55.915154] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-31T19:37:55.914997] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-31T19:37:55.918016] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-31T19:37:55.918085] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-31T19:37:55.919335] [DEBUG] [LOCAL ] LAC: Trimmed 76170 records to 53387 (keeping 200 days of data) [2025-10-31T19:37:56.220042] [DEBUG] [LOCAL ] LAC: Primary data saved (53387 records). [2025-10-31T19:37:56.220420] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-31T19:37:56.221249] [INFO ] [MAIN ] Update Progress: 1232/2365 symbols completed. LAC took 40.4s. Estimated remaining: 2h 25m 11s. Rate: 7.8 symbols/min [2025-10-31T19:37:56.262828] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-31T19:37:56.396221] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:37:56.396445] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-31T19:37:56.396488] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-31T19:37:56.396635] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-31T19:37:56.396712] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-31T19:37:56.396764] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-31T19:37:56.396821] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-31T19:37:56.750236] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:37:56.750820] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-31T19:37:56.752096] [INFO ] [REMOTE ] LANV: Full fetch complete (4116 records). [2025-10-31T19:37:56.752162] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-31T19:37:57.066715] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-31T19:37:57.108102] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-31T19:37:57.108178] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-31T19:37:57.108334] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-31T19:37:57.108377] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-31T19:37:57.108785] [DEBUG] [LOCAL ] LANV: Trimmed 4116 records to 2786 (keeping 200 days of data) [2025-10-31T19:37:57.124562] [DEBUG] [LOCAL ] LANV: Primary data saved (2786 records). [2025-10-31T19:37:57.124630] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-31T19:37:57.124747] [INFO ] [MAIN ] Update Progress: 1233/2365 symbols completed. LANV took 21.8s. Estimated remaining: 2h 24m 57s. Rate: 7.8 symbols/min [2025-10-31T19:37:57.291573] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:37:57.307396] [DEBUG] [LOCAL ] LAW: Loaded 15183 existing records from primary storage. [2025-10-31T19:37:57.307619] [INFO ] [MAIN ] LAW: Loaded 15183 existing records. [2025-10-31T19:37:57.480748] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:37:57.480984] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-31T19:37:57.481035] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-31T19:37:57.481335] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-31T19:37:57.481391] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-31T19:37:57.833292] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:37:57.857607] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-31T19:37:58.283878] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-31T19:37:58.450897] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-31T19:37:58.657696] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-31T19:37:59.457688] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-31T19:37:59.917532] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T19:37:59.941252] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-31T19:37:59.945070] [INFO ] [REMOTE ] LADR: Full fetch complete (55691 records). [2025-10-31T19:37:59.946273] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-31T19:38:00.262877] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-31T19:38:00.415478] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-31T19:38:00.415565] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-31T19:38:00.416569] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-31T19:38:00.416634] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-31T19:38:00.418214] [DEBUG] [LOCAL ] LADR: Trimmed 55691 records to 39671 (keeping 200 days of data) [2025-10-31T19:38:00.687943] [DEBUG] [LOCAL ] LADR: Primary data saved (39671 records). [2025-10-31T19:38:00.688093] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-31T19:38:00.688181] [INFO ] [MAIN ] Update Progress: 1234/2365 symbols completed. LADR took 26.8s. Estimated remaining: 2h 24m 45s. Rate: 7.8 symbols/min [2025-10-31T19:38:00.901163] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:38:00.942723] [DEBUG] [LOCAL ] LAZ: Loaded 44573 existing records from primary storage. [2025-10-31T19:38:00.943034] [INFO ] [MAIN ] LAZ: Loaded 44573 existing records. [2025-10-31T19:38:01.062737] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-31T19:38:01.134175] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:38:01.134522] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-31T19:38:01.134597] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-31T19:38:01.139962] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-31T19:38:01.145067] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-31T19:38:01.178090] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T19:38:01.540261] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:38:01.857685] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-31T19:38:02.339236] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T19:38:02.597063] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T19:38:02.657634] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-31T19:38:03.457691] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-31T19:38:03.730954] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T19:38:03.737144] [INFO ] [REMOTE ] LAD: Full fetch complete (35832 records). [2025-10-31T19:38:03.737281] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-31T19:38:04.128262] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-31T19:38:04.128333] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-31T19:38:04.129015] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-31T19:38:04.129075] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-31T19:38:04.129821] [DEBUG] [LOCAL ] LAD: Trimmed 35832 records to 23543 (keeping 200 days of data) [2025-10-31T19:38:04.260576] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-31T19:38:04.271137] [DEBUG] [LOCAL ] LAD: Primary data saved (23543 records). [2025-10-31T19:38:04.272638] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-31T19:38:04.272774] [INFO ] [MAIN ] Update Progress: 1235/2365 symbols completed. LAD took 41.7s. Estimated remaining: 2h 24m 34s. Rate: 7.8 symbols/min [2025-10-31T19:38:04.442197] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:38:04.475977] [DEBUG] [LOCAL ] LB: Loaded 36614 existing records from primary storage. [2025-10-31T19:38:04.476247] [INFO ] [MAIN ] LB: Loaded 36614 existing records. [2025-10-31T19:38:04.681021] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:38:04.681264] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-31T19:38:04.681343] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-31T19:38:04.682126] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-31T19:38:04.682189] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-31T19:38:04.683290] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T19:38:05.033207] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:38:05.057608] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-31T19:38:05.570449] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-31T19:38:05.857694] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-31T19:38:06.242941] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T19:38:06.407296] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-31T19:38:06.657637] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-31T19:38:07.205021] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-31T19:38:07.457667] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-31T19:38:08.257685] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-31T19:38:08.635773] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T19:38:09.057732] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-31T19:38:09.382517] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-31T19:38:09.857690] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-31T19:38:10.111620] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T19:38:10.657674] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-31T19:38:10.995505] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-31T19:38:11.252568] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T19:38:11.457663] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-31T19:38:12.257720] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-31T19:38:12.651164] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T19:38:13.057729] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-31T19:38:13.405051] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T19:38:13.857746] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-31T19:38:14.190298] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-31T19:38:14.442090] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-31T19:38:14.657708] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-31T19:38:15.457724] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-31T19:38:15.814447] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T19:38:16.111463] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-31T19:38:16.257684] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-31T19:38:16.860306] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-31T19:38:17.057665] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-31T19:38:17.857673] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-31T19:38:18.170053] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T19:38:18.657636] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-31T19:38:18.981438] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-31T19:38:19.259828] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-31T19:38:19.457669] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-31T19:38:20.257731] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-31T19:38:20.577018] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T19:38:21.057683] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-31T19:38:21.228328] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-31T19:38:21.857665] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-31T19:38:22.207047] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-31T19:38:22.657635] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-31T19:38:22.769220] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-31T19:38:22.773926] [INFO ] [REMOTE ] LAW: Full fetch complete (21082 records). [2025-10-31T19:38:22.774021] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-31T19:38:23.131722] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-31T19:38:23.131810] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-31T19:38:23.132277] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-31T19:38:23.132320] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-31T19:38:23.133012] [DEBUG] [LOCAL ] LAW: Trimmed 21082 records to 15255 (keeping 200 days of data) [2025-10-31T19:38:23.215752] [DEBUG] [LOCAL ] LAW: Primary data saved (15255 records). [2025-10-31T19:38:23.215887] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-31T19:38:23.215973] [INFO ] [MAIN ] Update Progress: 1236/2365 symbols completed. LAW took 26.1s. Estimated remaining: 2h 24m 37s. Rate: 7.8 symbols/min [2025-10-31T19:38:23.383587] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:38:23.435561] [DEBUG] [LOCAL ] LBRT: Loaded 53395 existing records from primary storage. [2025-10-31T19:38:23.435943] [INFO ] [MAIN ] LBRT: Loaded 53395 existing records. [2025-10-31T19:38:23.466942] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-31T19:38:23.625532] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:38:23.625968] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-31T19:38:23.626042] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-31T19:38:23.626555] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-31T19:38:23.626615] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-31T19:38:23.937419] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-31T19:38:24.051256] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:38:24.257688] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-31T19:38:24.590269] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-31T19:38:25.057739] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-31T19:38:25.342233] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T19:38:25.857638] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-31T19:38:26.115221] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-31T19:38:26.657711] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-31T19:38:26.915902] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-31T19:38:27.457682] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-31T19:38:27.869462] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T19:38:28.257689] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-31T19:38:28.644804] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T19:38:29.057695] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-31T19:38:29.396683] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T19:38:29.857676] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-31T19:38:30.317094] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T19:38:30.326908] [INFO ] [REMOTE ] LAZ: Full fetch complete (65265 records). [2025-10-31T19:38:30.327016] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-31T19:38:30.661891] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-31T19:38:30.711851] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-31T19:38:30.711928] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-31T19:38:30.712832] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-31T19:38:30.712893] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-31T19:38:30.714130] [DEBUG] [LOCAL ] LAZ: Trimmed 65265 records to 44934 (keeping 200 days of data) [2025-10-31T19:38:31.002012] [DEBUG] [LOCAL ] LAZ: Primary data saved (44934 records). [2025-10-31T19:38:31.002171] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-31T19:38:31.002309] [INFO ] [MAIN ] Update Progress: 1237/2365 symbols completed. LAZ took 30.3s. Estimated remaining: 2h 24m 29s. Rate: 7.8 symbols/min [2025-10-31T19:38:31.085456] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T19:38:31.457713] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-31T19:38:32.021030] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-31T19:38:32.257631] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-31T19:38:32.462960] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T19:38:33.057732] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-31T19:38:33.857662] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-31T19:38:34.037709] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-31T19:38:34.049888] [INFO ] [REMOTE ] LAR: Full fetch complete (65077 records). [2025-10-31T19:38:34.050039] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-31T19:38:34.251942] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-31T19:38:34.252687] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:38:34.252812] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:38:34.252894] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-31T19:38:34.253091] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-31T19:38:34.253158] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-31T19:38:34.253245] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-31T19:38:34.253336] [INFO ] [MAIN ] Update Progress: 1238/2365 symbols completed. LAR took 38.0s. Estimated remaining: 2h 24m 17s. Rate: 7.8 symbols/min [2025-10-31T19:38:34.283630] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T19:38:34.657737] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-31T19:38:34.801984] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-31T19:38:34.809947] [INFO ] [REMOTE ] LB: Full fetch complete (55090 records). [2025-10-31T19:38:34.810043] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-31T19:38:35.200365] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-31T19:38:35.200439] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-31T19:38:35.201384] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-31T19:38:35.201446] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-31T19:38:35.202507] [DEBUG] [LOCAL ] LB: Trimmed 55090 records to 36786 (keeping 200 days of data) [2025-10-31T19:38:35.419488] [DEBUG] [LOCAL ] LB: Primary data saved (36786 records). [2025-10-31T19:38:35.419633] [INFO ] [MAIN ] LB: Full history saved. [2025-10-31T19:38:35.419757] [INFO ] [MAIN ] Update Progress: 1239/2365 symbols completed. LB took 31.1s. Estimated remaining: 2h 24m 4s. Rate: 7.8 symbols/min [2025-10-31T19:38:36.132216] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T19:38:36.143320] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-31T19:38:37.570454] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T19:38:37.581207] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-31T19:38:38.842686] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:38:38.853327] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-31T19:38:40.356539] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T19:38:40.368057] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-31T19:38:41.652160] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T19:38:41.664674] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-31T19:38:43.062899] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-31T19:38:43.081284] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-31T19:38:44.686397] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-31T19:38:44.698899] [INFO ] [REMOTE ] LBRT: Full fetch complete (76941 records). [2025-10-31T19:38:44.699075] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-31T19:38:45.129458] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-31T19:38:45.129532] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-31T19:38:45.130570] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-31T19:38:45.130632] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-31T19:38:45.132013] [DEBUG] [LOCAL ] LBRT: Trimmed 76941 records to 53785 (keeping 200 days of data) [2025-10-31T19:38:45.448515] [DEBUG] [LOCAL ] LBRT: Primary data saved (53785 records). [2025-10-31T19:38:45.448664] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-31T19:38:45.448761] [INFO ] [MAIN ] Update Progress: 1240/2365 symbols completed. LBRT took 22.2s. Estimated remaining: 2h 23m 58s. Rate: 7.8 symbols/min [2025-10-31T19:38:46.089404] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:38:46.159325] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:38:46.152163] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:38:46.217868] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:38:46.312566] [DEBUG] [LOCAL ] LCII: Loaded 26489 existing records from primary storage. [2025-10-31T19:38:46.313080] [INFO ] [MAIN ] LCII: Loaded 26489 existing records. [2025-10-31T19:38:46.319359] [DEBUG] [LOCAL ] LC: Loaded 48613 existing records from primary storage. [2025-10-31T19:38:46.320099] [DEBUG] [LOCAL ] LDOS: Loaded 44399 existing records from primary storage. [2025-10-31T19:38:46.359560] [INFO ] [MAIN ] LC: Loaded 48613 existing records. [2025-10-31T19:38:46.380177] [INFO ] [MAIN ] LDOS: Loaded 44399 existing records. [2025-10-31T19:38:46.486372] [DEBUG] [LOCAL ] LDI: Loaded 45768 existing records from primary storage. [2025-10-31T19:38:46.610992] [INFO ] [MAIN ] LDI: Loaded 45768 existing records. [2025-10-31T19:38:46.885991] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:38:46.973600] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-31T19:38:47.039731] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-31T19:38:47.043768] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:38:47.073848] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-31T19:38:47.073970] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-31T19:38:47.059962] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:38:47.084841] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-31T19:38:47.087761] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-31T19:38:47.085031] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-31T19:38:47.092142] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-31T19:38:47.087897] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-31T19:38:47.156233] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-31T19:38:47.182331] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:38:47.216546] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-31T19:38:47.164611] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-31T19:38:47.255277] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-31T19:38:47.255196] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-31T19:38:47.260924] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-31T19:38:47.288900] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-31T19:38:48.326357] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:38:48.361801] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:38:48.362174] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-31T19:38:48.393002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-31T19:38:48.523945] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:38:48.534602] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-31T19:38:48.626439] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:38:48.626754] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-31T19:38:49.303669] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-31T19:38:49.308471] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-31T19:38:49.548541] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-31T19:38:49.555524] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-31T19:38:49.735051] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T19:38:49.745372] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-31T19:38:49.781932] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-31T19:38:49.791424] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-31T19:38:50.027157] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-31T19:38:50.032266] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-31T19:38:50.490059] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T19:38:50.497624] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-31T19:38:50.788043] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-31T19:38:50.794844] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-31T19:38:51.034540] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-31T19:38:51.044851] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-31T19:38:51.075783] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-31T19:38:51.088632] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-31T19:38:51.599313] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-31T19:38:51.609279] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-31T19:38:51.892311] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T19:38:51.900896] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-31T19:38:52.239394] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T19:38:52.257607] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-31T19:38:52.393242] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-31T19:38:52.690158] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-31T19:38:52.791407] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-31T19:38:53.057637] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-31T19:38:53.540137] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-31T19:38:53.857695] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-31T19:38:54.077102] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-31T19:38:54.657681] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-31T19:38:54.696438] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T19:38:55.457676] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-31T19:38:55.942997] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T19:38:56.257667] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-31T19:38:56.630468] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-31T19:38:57.057697] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-31T19:38:57.507796] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-31T19:38:57.857682] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-31T19:38:58.487787] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-31T19:38:58.657607] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-31T19:38:59.270836] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T19:38:59.457637] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-31T19:38:59.959240] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T19:39:00.257692] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-31T19:39:00.545563] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-31T19:39:01.057685] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-31T19:39:01.520728] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-31T19:39:01.857679] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-31T19:39:02.260502] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T19:39:02.657706] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-31T19:39:03.464192] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-31T19:39:03.483209] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-31T19:39:03.911935] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-31T19:39:04.223587] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-31T19:39:04.257684] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-31T19:39:05.057667] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-31T19:39:05.312087] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-31T19:39:05.857678] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-31T19:39:06.657735] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-31T19:39:06.897701] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-31T19:39:06.909634] [INFO ] [REMOTE ] LDI: Full fetch complete (62955 records). [2025-10-31T19:39:06.909785] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-31T19:39:07.303163] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-31T19:39:07.317021] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-31T19:39:07.326080] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-31T19:39:07.326170] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-31T19:39:07.328139] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-31T19:39:07.338232] [DEBUG] [LOCAL ] LDI: Trimmed 62955 records to 46150 (keeping 200 days of data) [2025-10-31T19:39:07.451226] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-31T19:39:07.458232] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-31T19:39:07.610310] [DEBUG] [LOCAL ] LDI: Primary data saved (46150 records). [2025-10-31T19:39:07.610437] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-31T19:39:07.610512] [INFO ] [MAIN ] Update Progress: 1241/2365 symbols completed. LDI took 22.2s. Estimated remaining: 2h 24m 4s. Rate: 7.8 symbols/min [2025-10-31T19:39:07.785605] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:07.798584] [DEBUG] [LOCAL ] LDP: Loaded 12172 existing records from primary storage. [2025-10-31T19:39:07.798858] [INFO ] [MAIN ] LDP: Loaded 12172 existing records. [2025-10-31T19:39:07.977820] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:07.978046] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-31T19:39:07.978092] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-31T19:39:07.978270] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-31T19:39:07.978326] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-31T19:39:08.262880] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-31T19:39:08.325197] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:08.799720] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-31T19:39:09.057680] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-31T19:39:09.268592] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T19:39:09.274146] [INFO ] [REMOTE ] LCII: Full fetch complete (39324 records). [2025-10-31T19:39:09.274246] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-31T19:39:09.649627] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-31T19:39:09.649730] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-31T19:39:09.650430] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-31T19:39:09.650468] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-31T19:39:09.651277] [DEBUG] [LOCAL ] LCII: Trimmed 39324 records to 26818 (keeping 200 days of data) [2025-10-31T19:39:09.817758] [DEBUG] [LOCAL ] LCII: Primary data saved (26818 records). [2025-10-31T19:39:09.817910] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-31T19:39:09.818002] [INFO ] [MAIN ] Update Progress: 1242/2365 symbols completed. LCII took 24.4s. Estimated remaining: 2h 23m 51s. Rate: 7.8 symbols/min [2025-10-31T19:39:09.862840] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-31T19:39:09.925035] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T19:39:10.006447] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:10.043449] [DEBUG] [LOCAL ] LEA: Loaded 41050 existing records from primary storage. [2025-10-31T19:39:10.043749] [INFO ] [MAIN ] LEA: Loaded 41050 existing records. [2025-10-31T19:39:10.225628] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:10.225897] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-31T19:39:10.225945] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-31T19:39:10.226141] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-31T19:39:10.226198] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-31T19:39:10.595104] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:10.657615] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-31T19:39:11.056635] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T19:39:11.457617] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-31T19:39:11.672027] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T19:39:12.257712] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-31T19:39:12.851705] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T19:39:12.863393] [INFO ] [REMOTE ] LC: Full fetch complete (70696 records). [2025-10-31T19:39:12.863552] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-31T19:39:13.068435] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-31T19:39:13.253106] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-31T19:39:13.253282] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-31T19:39:13.254322] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-31T19:39:13.254499] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-31T19:39:13.256012] [DEBUG] [LOCAL ] LC: Trimmed 70696 records to 48977 (keeping 200 days of data) [2025-10-31T19:39:13.450963] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T19:39:13.567358] [DEBUG] [LOCAL ] LC: Primary data saved (48977 records). [2025-10-31T19:39:13.567487] [INFO ] [MAIN ] LC: Full history saved. [2025-10-31T19:39:13.567565] [INFO ] [MAIN ] Update Progress: 1243/2365 symbols completed. LC took 28.1s. Estimated remaining: 2h 23m 40s. Rate: 7.8 symbols/min [2025-10-31T19:39:13.732792] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:13.776072] [DEBUG] [LOCAL ] LEG: Loaded 50223 existing records from primary storage. [2025-10-31T19:39:13.776417] [INFO ] [MAIN ] LEG: Loaded 50223 existing records. [2025-10-31T19:39:13.866058] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-31T19:39:13.953956] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:13.954156] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-31T19:39:13.954205] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-31T19:39:13.954556] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-31T19:39:13.954596] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-31T19:39:14.321149] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:14.348241] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-31T19:39:14.368913] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T19:39:14.657721] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-31T19:39:15.457719] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-31T19:39:15.920616] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T19:39:15.930323] [INFO ] [REMOTE ] LDOS: Full fetch complete (66383 records). [2025-10-31T19:39:15.930471] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-31T19:39:16.191059] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-31T19:39:16.262810] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-31T19:39:16.349821] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-31T19:39:16.349897] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-31T19:39:16.350798] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-31T19:39:16.350860] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-31T19:39:16.352128] [DEBUG] [LOCAL ] LDOS: Trimmed 66383 records to 44695 (keeping 200 days of data) [2025-10-31T19:39:16.626930] [DEBUG] [LOCAL ] LDOS: Primary data saved (44695 records). [2025-10-31T19:39:16.627047] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-31T19:39:16.627120] [INFO ] [MAIN ] Update Progress: 1244/2365 symbols completed. LDOS took 31.2s. Estimated remaining: 2h 23m 28s. Rate: 7.8 symbols/min [2025-10-31T19:39:16.795991] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:16.847337] [DEBUG] [LOCAL ] LEN: Loaded 53578 existing records from primary storage. [2025-10-31T19:39:16.847633] [INFO ] [MAIN ] LEN: Loaded 53578 existing records. [2025-10-31T19:39:17.028128] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:17.028288] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-31T19:39:17.028335] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-31T19:39:17.028750] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-31T19:39:17.028808] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-31T19:39:17.062747] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-31T19:39:17.394735] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:17.469893] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-31T19:39:17.857688] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-31T19:39:18.436556] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T19:39:18.657701] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-31T19:39:19.229620] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-31T19:39:19.457671] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-31T19:39:19.769296] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-31T19:39:20.093619] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T19:39:20.257681] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-31T19:39:21.057690] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-31T19:39:21.480023] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T19:39:21.543521] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T19:39:21.857725] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-31T19:39:22.657712] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-31T19:39:23.152921] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T19:39:23.190382] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-31T19:39:23.457667] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-31T19:39:24.257679] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-31T19:39:24.794700] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-31T19:39:25.057671] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-31T19:39:25.481276] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T19:39:25.857728] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-31T19:39:26.244495] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T19:39:26.657673] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-31T19:39:27.265585] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T19:39:27.286361] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-31T19:39:27.457670] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-31T19:39:27.979938] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-31T19:39:28.257607] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-31T19:39:28.833971] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-31T19:39:29.057698] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-31T19:39:29.708586] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-31T19:39:29.711429] [INFO ] [REMOTE ] LDP: Full fetch complete (18509 records). [2025-10-31T19:39:29.711501] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-31T19:39:29.866245] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-31T19:39:30.067415] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-31T19:39:30.067484] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-31T19:39:30.067904] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-31T19:39:30.067968] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-31T19:39:30.068453] [DEBUG] [LOCAL ] LDP: Trimmed 18509 records to 12245 (keeping 200 days of data) [2025-10-31T19:39:30.139103] [DEBUG] [LOCAL ] LDP: Primary data saved (12245 records). [2025-10-31T19:39:30.139214] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-31T19:39:30.139286] [INFO ] [MAIN ] Update Progress: 1245/2365 symbols completed. LDP took 22.5s. Estimated remaining: 2h 23m 25s. Rate: 7.8 symbols/min [2025-10-31T19:39:30.302079] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:30.317926] [DEBUG] [LOCAL ] LEO: Loaded 16598 existing records from primary storage. [2025-10-31T19:39:30.318136] [INFO ] [MAIN ] LEO: Loaded 16598 existing records. [2025-10-31T19:39:30.488902] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:30.489062] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-31T19:39:30.489105] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-31T19:39:30.489278] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-31T19:39:30.489332] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-31T19:39:30.667522] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-31T19:39:30.837802] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:30.998304] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T19:39:31.457605] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-31T19:39:32.134400] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T19:39:32.257692] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-31T19:39:32.463769] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T19:39:33.057678] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-31T19:39:33.517981] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T19:39:33.857729] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-31T19:39:34.149254] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-31T19:39:34.657691] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-31T19:39:35.241173] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-31T19:39:35.457721] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-31T19:39:35.972080] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T19:39:36.257688] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-31T19:39:36.908525] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-31T19:39:37.057682] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-31T19:39:37.430551] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-31T19:39:37.857721] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-31T19:39:38.366817] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T19:39:38.604213] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T19:39:38.657708] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-31T19:39:39.457711] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-31T19:39:40.097703] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-31T19:39:40.257632] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-31T19:39:40.726128] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T19:39:41.057684] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-31T19:39:41.819373] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-31T19:39:41.857687] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-31T19:39:41.926382] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-31T19:39:42.645291] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-31T19:39:42.657620] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-31T19:39:43.240787] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-31T19:39:43.457702] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-31T19:39:44.148741] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-31T19:39:44.257628] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-31T19:39:45.057677] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-31T19:39:45.491566] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-31T19:39:45.857685] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-31T19:39:46.191774] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-31T19:39:46.484446] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T19:39:46.496867] [INFO ] [REMOTE ] LEN: Full fetch complete (77221 records). [2025-10-31T19:39:46.497028] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-31T19:39:46.664220] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-31T19:39:46.905958] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-31T19:39:46.906050] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-31T19:39:46.907133] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-31T19:39:46.907211] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-31T19:39:46.908802] [DEBUG] [LOCAL ] LEN: Trimmed 77221 records to 53968 (keeping 200 days of data) [2025-10-31T19:39:47.239533] [DEBUG] [LOCAL ] LEN: Primary data saved (53968 records). [2025-10-31T19:39:47.239685] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-31T19:39:47.239781] [INFO ] [MAIN ] Update Progress: 1246/2365 symbols completed. LEN took 30.6s. Estimated remaining: 2h 23m 26s. Rate: 7.8 symbols/min [2025-10-31T19:39:47.423139] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:47.469570] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-31T19:39:47.472719] [DEBUG] [LOCAL ] LEVI: Loaded 52178 existing records from primary storage. [2025-10-31T19:39:47.473101] [INFO ] [MAIN ] LEVI: Loaded 52178 existing records. [2025-10-31T19:39:47.658146] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:47.658365] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-31T19:39:47.658413] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-31T19:39:47.658739] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-31T19:39:47.658795] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-31T19:39:48.029029] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:48.054917] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-31T19:39:48.063901] [INFO ] [REMOTE ] LEA: Full fetch complete (60380 records). [2025-10-31T19:39:48.064020] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-31T19:39:48.250551] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-31T19:39:48.262610] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-31T19:39:48.464812] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-31T19:39:48.464956] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-31T19:39:48.465848] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-31T19:39:48.465909] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-31T19:39:48.467104] [DEBUG] [LOCAL ] LEA: Trimmed 60380 records to 41378 (keeping 200 days of data) [2025-10-31T19:39:48.716616] [DEBUG] [LOCAL ] LEA: Primary data saved (41378 records). [2025-10-31T19:39:48.716765] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-31T19:39:48.717481] [INFO ] [MAIN ] Update Progress: 1247/2365 symbols completed. LEA took 38.9s. Estimated remaining: 2h 23m 13s. Rate: 7.8 symbols/min [2025-10-31T19:39:48.883290] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:48.901969] [DEBUG] [LOCAL ] LFT: Loaded 18167 existing records from primary storage. [2025-10-31T19:39:48.902192] [INFO ] [MAIN ] LFT: Loaded 18167 existing records. [2025-10-31T19:39:49.058584] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-31T19:39:49.077063] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:49.078274] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-31T19:39:49.078393] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-31T19:39:49.078759] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-31T19:39:49.078837] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-31T19:39:49.470971] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:49.524701] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T19:39:49.720893] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-31T19:39:49.857682] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-31T19:39:50.473494] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-31T19:39:50.657626] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-31T19:39:51.123848] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-31T19:39:51.457684] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-31T19:39:52.016685] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-31T19:39:52.257639] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-31T19:39:53.057683] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-31T19:39:53.072743] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-31T19:39:53.076883] [INFO ] [REMOTE ] LEO: Full fetch complete (26578 records). [2025-10-31T19:39:53.076974] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-31T19:39:53.451557] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-31T19:39:53.451637] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-31T19:39:53.452259] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-31T19:39:53.452304] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-31T19:39:53.453138] [DEBUG] [LOCAL ] LEO: Trimmed 26578 records to 16724 (keeping 200 days of data) [2025-10-31T19:39:53.578468] [DEBUG] [LOCAL ] LEO: Primary data saved (16724 records). [2025-10-31T19:39:53.578690] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-31T19:39:53.578815] [INFO ] [MAIN ] Update Progress: 1248/2365 symbols completed. LEO took 23.4s. Estimated remaining: 2h 23m 3s. Rate: 7.8 symbols/min [2025-10-31T19:39:53.766575] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:53.778503] [DEBUG] [LOCAL ] LGI: Loaded 9725 existing records from primary storage. [2025-10-31T19:39:53.778752] [INFO ] [MAIN ] LGI: Loaded 9725 existing records. [2025-10-31T19:39:53.867219] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-31T19:39:53.963565] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:53.963799] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-31T19:39:53.963847] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-31T19:39:53.964039] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-31T19:39:53.964094] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-31T19:39:54.336237] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:54.467068] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-31T19:39:54.478388] [INFO ] [REMOTE ] LEG: Full fetch complete (72801 records). [2025-10-31T19:39:54.478557] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-31T19:39:54.672889] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-31T19:39:54.912867] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-31T19:39:54.912951] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-31T19:39:54.914076] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-31T19:39:54.914142] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-31T19:39:54.915516] [DEBUG] [LOCAL ] LEG: Trimmed 72801 records to 50590 (keeping 200 days of data) [2025-10-31T19:39:55.260689] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:39:55.264133] [DEBUG] [LOCAL ] LEG: Primary data saved (50590 records). [2025-10-31T19:39:55.274149] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-31T19:39:55.274477] [INFO ] [MAIN ] Update Progress: 1249/2365 symbols completed. LEG took 41.7s. Estimated remaining: 2h 22m 50s. Rate: 7.8 symbols/min [2025-10-31T19:39:55.462874] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-31T19:39:55.494214] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:39:55.502902] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-31T19:39:55.543581] [DEBUG] [LOCAL ] LH: Loaded 37159 existing records from primary storage. [2025-10-31T19:39:55.543939] [INFO ] [MAIN ] LH: Loaded 37159 existing records. [2025-10-31T19:39:55.717703] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:39:55.718058] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-31T19:39:55.718118] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-31T19:39:55.718755] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-31T19:39:55.718819] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-31T19:39:56.073568] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:39:56.116836] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-31T19:39:56.257689] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-31T19:39:57.057691] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-31T19:39:57.424866] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-31T19:39:57.655224] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-31T19:39:57.857695] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-31T19:39:58.657709] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-31T19:39:58.879316] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-31T19:39:59.457663] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-31T19:40:00.033199] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T19:40:00.257708] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-31T19:40:00.588929] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-31T19:40:01.057689] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-31T19:40:01.758416] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-31T19:40:01.825158] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-31T19:40:01.857604] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-31T19:40:02.657727] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-31T19:40:03.089879] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T19:40:03.227814] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T19:40:03.457678] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-31T19:40:04.257715] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-31T19:40:04.844930] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-31T19:40:05.058038] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-31T19:40:05.060070] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-31T19:40:05.857667] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-31T19:40:06.283789] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T19:40:06.657639] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-31T19:40:06.702771] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-31T19:40:07.457746] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-31T19:40:07.772505] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T19:40:08.257676] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-31T19:40:08.678964] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T19:40:09.057716] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-31T19:40:09.316819] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-31T19:40:09.857742] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-31T19:40:10.646712] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T19:40:10.657932] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-31T19:40:10.673250] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-31T19:40:11.457670] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-31T19:40:11.923203] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T19:40:12.257722] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-31T19:40:12.682474] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-31T19:40:13.037467] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-31T19:40:13.057628] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-31T19:40:13.739960] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T19:40:13.857744] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-31T19:40:14.606955] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-31T19:40:14.657718] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-31T19:40:15.457662] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-31T19:40:15.654051] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-31T19:40:16.257675] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-31T19:40:16.341618] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-31T19:40:16.345497] [INFO ] [REMOTE ] LFT: Full fetch complete (23792 records). [2025-10-31T19:40:16.345569] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-31T19:40:16.718282] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-31T19:40:16.718367] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-31T19:40:16.718902] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-31T19:40:16.718962] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-31T19:40:16.719573] [DEBUG] [LOCAL ] LFT: Trimmed 23792 records to 18308 (keeping 200 days of data) [2025-10-31T19:40:16.821787] [DEBUG] [LOCAL ] LFT: Primary data saved (18308 records). [2025-10-31T19:40:16.821918] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-31T19:40:16.821995] [INFO ] [MAIN ] Update Progress: 1250/2365 symbols completed. LFT took 28.1s. Estimated remaining: 2h 22m 54s. Rate: 7.8 symbols/min [2025-10-31T19:40:16.988532] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:40:17.033993] [DEBUG] [LOCAL ] LHX: Loaded 48559 existing records from primary storage. [2025-10-31T19:40:17.034284] [INFO ] [MAIN ] LHX: Loaded 48559 existing records. [2025-10-31T19:40:17.063439] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-31T19:40:17.216064] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:40:17.216303] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-31T19:40:17.216492] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-31T19:40:17.216848] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-31T19:40:17.217011] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-31T19:40:17.326506] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T19:40:17.609663] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:40:17.645856] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-31T19:40:17.857683] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-31T19:40:18.657682] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-31T19:40:19.119054] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-31T19:40:19.238751] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-31T19:40:19.457666] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-31T19:40:19.949462] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-31T19:40:20.257676] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-31T19:40:21.057682] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-31T19:40:21.424485] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-31T19:40:21.432730] [INFO ] [REMOTE ] LH: Full fetch complete (55044 records). [2025-10-31T19:40:21.432847] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-31T19:40:21.824779] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-31T19:40:21.824874] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-31T19:40:21.825866] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-31T19:40:21.825933] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-31T19:40:21.827270] [DEBUG] [LOCAL ] LH: Trimmed 55044 records to 37449 (keeping 200 days of data) [2025-10-31T19:40:21.883852] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-31T19:40:22.077878] [DEBUG] [LOCAL ] LH: Primary data saved (37449 records). [2025-10-31T19:40:22.078040] [INFO ] [MAIN ] LH: Full history saved. [2025-10-31T19:40:22.078127] [INFO ] [MAIN ] Update Progress: 1251/2365 symbols completed. LH took 26.8s. Estimated remaining: 2h 22m 44s. Rate: 7.8 symbols/min [2025-10-31T19:40:22.341149] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:40:22.382517] [DEBUG] [LOCAL ] LII: Loaded 27868 existing records from primary storage. [2025-10-31T19:40:22.382947] [INFO ] [MAIN ] LII: Loaded 27868 existing records. [2025-10-31T19:40:22.670043] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-31T19:40:22.670217] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-31T19:40:22.722145] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T19:40:22.726179] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:40:22.733103] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-31T19:40:22.733225] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-31T19:40:22.734214] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-31T19:40:22.734288] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-31T19:40:23.202845] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:40:23.457706] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-31T19:40:24.107541] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-31T19:40:24.257772] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-31T19:40:24.515319] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T19:40:25.057734] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-31T19:40:25.595126] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-31T19:40:25.857633] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-31T19:40:26.048764] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-31T19:40:26.062913] [INFO ] [REMOTE ] LEVI: Full fetch complete (75079 records). [2025-10-31T19:40:26.063087] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-31T19:40:26.506269] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-31T19:40:26.506384] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-31T19:40:26.507533] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-31T19:40:26.507602] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-31T19:40:26.509195] [DEBUG] [LOCAL ] LEVI: Trimmed 75079 records to 52557 (keeping 200 days of data) [2025-10-31T19:40:26.689830] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-31T19:40:26.847050] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T19:40:26.874918] [DEBUG] [LOCAL ] LEVI: Primary data saved (52557 records). [2025-10-31T19:40:26.875041] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-31T19:40:26.875115] [INFO ] [MAIN ] Update Progress: 1252/2365 symbols completed. LEVI took 39.6s. Estimated remaining: 2h 22m 34s. Rate: 7.8 symbols/min [2025-10-31T19:40:27.040098] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:40:27.084719] [DEBUG] [LOCAL ] LION: Loaded 47841 existing records from primary storage. [2025-10-31T19:40:27.085096] [INFO ] [MAIN ] LION: Loaded 47841 existing records. [2025-10-31T19:40:27.256676] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:40:27.256936] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-31T19:40:27.256997] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-31T19:40:27.257289] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-31T19:40:27.257343] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-31T19:40:27.462863] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-31T19:40:27.541424] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T19:40:27.570384] [INFO ] [REMOTE ] LGI: Full fetch complete (14316 records). [2025-10-31T19:40:27.574462] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-31T19:40:27.779511] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:40:28.029755] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-31T19:40:28.029838] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-31T19:40:28.030263] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-31T19:40:28.030304] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-31T19:40:28.030823] [DEBUG] [LOCAL ] LGI: Trimmed 14316 records to 9771 (keeping 200 days of data) [2025-10-31T19:40:28.089707] [DEBUG] [LOCAL ] LGI: Primary data saved (9771 records). [2025-10-31T19:40:28.089844] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-31T19:40:28.089943] [INFO ] [MAIN ] Update Progress: 1253/2365 symbols completed. LGI took 34.5s. Estimated remaining: 2h 22m 21s. Rate: 7.8 symbols/min [2025-10-31T19:40:28.257264] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:40:28.257498] [DEBUG] [LOCAL ] LITB: No existing data file found in primary storage. [2025-10-31T19:40:28.257548] [WARN ] [MAIN ] LITB: No existing data found, performing full refresh instead. [2025-10-31T19:40:28.257698] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-31T19:40:28.257785] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-31T19:40:28.257979] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-31T19:40:28.258935] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-10-31T19:40:28.259081] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-31T19:40:28.612521] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:40:28.786370] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-31T19:40:29.057623] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-31T19:40:29.202972] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-31T19:40:29.857739] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-31T19:40:30.399315] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-31T19:40:30.402456] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-31T19:40:30.657667] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-31T19:40:30.948945] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-31T19:40:31.457926] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-31T19:40:31.923007] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-31T19:40:32.257692] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-31T19:40:33.007471] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-31T19:40:33.057610] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-31T19:40:33.763538] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-31T19:40:33.857617] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-31T19:40:34.657684] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-31T19:40:34.870739] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-31T19:40:35.458352] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-31T19:40:35.460599] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-31T19:40:36.257698] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-31T19:40:36.516267] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-31T19:40:36.812298] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-31T19:40:37.057689] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-31T19:40:37.366930] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-31T19:40:37.857675] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-31T19:40:38.657634] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-31T19:40:38.798554] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T19:40:39.457681] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-31T19:40:39.960712] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T19:40:40.257695] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-31T19:40:40.321458] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-31T19:40:40.663797] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-31T19:40:41.057673] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-31T19:40:41.344733] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-31T19:40:41.857677] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-31T19:40:42.657701] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-31T19:40:43.301561] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T19:40:43.457609] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-31T19:40:43.614078] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T19:40:44.257688] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-31T19:40:44.728579] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T19:40:45.057683] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-31T19:40:45.420038] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-31T19:40:45.816875] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T19:40:45.857703] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-31T19:40:46.657704] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-31T19:40:47.073611] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-31T19:40:47.457675] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-31T19:40:47.736197] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-31T19:40:48.101052] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-31T19:40:48.257700] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-31T19:40:49.057670] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-31T19:40:49.500546] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T19:40:49.857668] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-31T19:40:50.301989] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T19:40:50.568323] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-31T19:40:50.657614] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-31T19:40:51.457679] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-31T19:40:51.799394] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T19:40:51.919687] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-31T19:40:52.257675] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-31T19:40:53.057670] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-31T19:40:53.560945] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-31T19:40:53.562614] [INFO ] [REMOTE ] LITB: Full fetch complete (5854 records). [2025-10-31T19:40:53.562709] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-31T19:40:53.861157] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-31T19:40:53.960362] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-31T19:40:53.962215] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-31T19:40:53.962132] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-31T19:40:53.962637] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-31T19:40:53.973594] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-31T19:40:53.975306] [DEBUG] [LOCAL ] LITB: Trimmed 5854 records to 3735 (keeping 200 days of data) [2025-10-31T19:40:53.975047] [INFO ] [REMOTE ] LION: Full fetch complete (59159 records). [2025-10-31T19:40:53.975816] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-31T19:40:54.071076] [DEBUG] [LOCAL ] LITB: Primary data saved (3735 records). [2025-10-31T19:40:54.081490] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-31T19:40:54.081617] [INFO ] [MAIN ] Update Progress: 1254/2365 symbols completed. LITB took 26.0s. Estimated remaining: 2h 22m 29s. Rate: 7.8 symbols/min [2025-10-31T19:40:54.442880] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:40:54.661109] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-31T19:40:54.664612] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-31T19:40:54.666033] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-31T19:40:54.667093] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-31T19:40:54.682698] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-31T19:40:54.684333] [DEBUG] [LOCAL ] LION: Trimmed 59159 records to 48167 (keeping 200 days of data) [2025-10-31T19:40:54.877485] [DEBUG] [LOCAL ] LLY: Loaded 53551 existing records from primary storage. [2025-10-31T19:40:54.909255] [INFO ] [MAIN ] LLY: Loaded 53551 existing records. [2025-10-31T19:40:55.190252] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:40:55.191471] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-31T19:40:55.192519] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-31T19:40:55.194418] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-31T19:40:55.194589] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-31T19:40:55.495102] [DEBUG] [LOCAL ] LION: Primary data saved (48167 records). [2025-10-31T19:40:55.495583] [INFO ] [MAIN ] LION: Full history saved. [2025-10-31T19:40:55.519827] [INFO ] [MAIN ] Update Progress: 1255/2365 symbols completed. LION took 28.6s. Estimated remaining: 2h 22m 16s. Rate: 7.8 symbols/min [2025-10-31T19:40:55.652478] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-31T19:40:55.723853] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:40:55.767577] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-31T19:40:55.846260] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:40:55.869861] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-31T19:40:55.877585] [INFO ] [REMOTE ] LII: Full fetch complete (41995 records). [2025-10-31T19:40:55.877761] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-31T19:40:56.184314] [DEBUG] [LOCAL ] LMND: Loaded 52495 existing records from primary storage. [2025-10-31T19:40:56.206054] [INFO ] [MAIN ] LMND: Loaded 52495 existing records. [2025-10-31T19:40:56.264853] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-31T19:40:56.440096] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-31T19:40:56.440314] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-31T19:40:56.441451] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-31T19:40:56.441569] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-31T19:40:56.489816] [DEBUG] [LOCAL ] LII: Trimmed 41995 records to 28052 (keeping 200 days of data) [2025-10-31T19:40:56.581024] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:40:56.591060] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-31T19:40:56.620053] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-31T19:40:56.625100] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-31T19:40:56.625917] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-31T19:40:57.025749] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:40:57.065472] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-31T19:40:57.097204] [DEBUG] [LOCAL ] LII: Primary data saved (28052 records). [2025-10-31T19:40:57.097500] [INFO ] [MAIN ] LII: Full history saved. [2025-10-31T19:40:57.097578] [INFO ] [MAIN ] Update Progress: 1256/2365 symbols completed. LII took 35.0s. Estimated remaining: 2h 22m 3s. Rate: 7.8 symbols/min [2025-10-31T19:40:57.277597] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:40:57.326211] [DEBUG] [LOCAL ] LMT: Loaded 49792 existing records from primary storage. [2025-10-31T19:40:57.326504] [INFO ] [MAIN ] LMT: Loaded 49792 existing records. [2025-10-31T19:40:57.509234] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:40:57.509464] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-31T19:40:57.509526] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-31T19:40:57.509945] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-31T19:40:57.510005] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-31T19:40:57.897994] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:40:57.898372] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-31T19:40:57.930370] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-31T19:40:57.941143] [INFO ] [REMOTE ] LHX: Full fetch complete (70670 records). [2025-10-31T19:40:57.941276] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-31T19:40:58.352673] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-31T19:40:58.352818] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-31T19:40:58.353945] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-31T19:40:58.354082] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-31T19:40:58.355792] [DEBUG] [LOCAL ] LHX: Trimmed 70670 records to 48936 (keeping 200 days of data) [2025-10-31T19:40:58.488862] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-31T19:40:58.650194] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-31T19:40:58.661403] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-31T19:40:58.741992] [DEBUG] [LOCAL ] LHX: Primary data saved (48936 records). [2025-10-31T19:40:58.742121] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-31T19:40:58.742886] [INFO ] [MAIN ] Update Progress: 1257/2365 symbols completed. LHX took 41.9s. Estimated remaining: 2h 21m 50s. Rate: 7.8 symbols/min [2025-10-31T19:40:58.909582] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:40:58.958430] [DEBUG] [LOCAL ] LNC: Loaded 51647 existing records from primary storage. [2025-10-31T19:40:58.958756] [INFO ] [MAIN ] LNC: Loaded 51647 existing records. [2025-10-31T19:40:59.142319] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:40:59.142579] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-31T19:40:59.142638] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-31T19:40:59.142947] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-31T19:40:59.143003] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-31T19:40:59.459244] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-31T19:40:59.498633] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:40:59.743606] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-31T19:41:00.257620] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-31T19:41:00.398592] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-31T19:41:00.983035] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-31T19:41:01.057626] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-31T19:41:01.779036] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-31T19:41:01.857626] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-31T19:41:02.657699] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-31T19:41:02.696874] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-31T19:41:03.221361] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-31T19:41:03.457671] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-31T19:41:04.257628] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-31T19:41:04.502207] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-31T19:41:04.845742] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-31T19:41:05.057709] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-31T19:41:05.857617] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-31T19:41:05.908467] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-31T19:41:06.657623] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-31T19:41:06.688175] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-31T19:41:07.457702] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-31T19:41:07.820289] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-31T19:41:07.868908] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-31T19:41:08.257692] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-31T19:41:09.057639] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-31T19:41:09.196452] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-31T19:41:09.857680] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-31T19:41:10.245239] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T19:41:10.309961] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-31T19:41:10.657700] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-31T19:41:11.457732] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-31T19:41:11.683888] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-31T19:41:12.025800] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-31T19:41:12.257742] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-31T19:41:13.057708] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-31T19:41:13.610275] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-31T19:41:13.784072] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-31T19:41:13.857706] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-31T19:41:14.657632] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-31T19:41:14.787482] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-31T19:41:15.457639] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-31T19:41:15.489890] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-31T19:41:16.257734] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-31T19:41:16.692044] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-31T19:41:16.882162] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-31T19:41:17.057698] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-31T19:41:17.857627] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-31T19:41:18.109024] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-31T19:41:18.389090] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-31T19:41:18.657687] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-31T19:41:19.457724] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-31T19:41:20.219483] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-31T19:41:20.263675] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-31T19:41:20.270239] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-31T19:41:20.568121] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-31T19:41:21.057683] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-31T19:41:21.857617] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-31T19:41:22.099790] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-31T19:41:22.657715] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-31T19:41:23.052278] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T19:41:23.131593] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-31T19:41:23.144059] [INFO ] [REMOTE ] LMND: Full fetch complete (75497 records). [2025-10-31T19:41:23.144231] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-31T19:41:23.462880] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-31T19:41:23.546221] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-31T19:41:23.546308] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-31T19:41:23.547333] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-31T19:41:23.547398] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-31T19:41:23.548868] [DEBUG] [LOCAL ] LMND: Trimmed 75497 records to 52883 (keeping 200 days of data) [2025-10-31T19:41:23.855090] [DEBUG] [LOCAL ] LMND: Primary data saved (52883 records). [2025-10-31T19:41:23.855221] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-31T19:41:23.855298] [INFO ] [MAIN ] Update Progress: 1258/2365 symbols completed. LMND took 28.3s. Estimated remaining: 2h 21m 58s. Rate: 7.8 symbols/min [2025-10-31T19:41:24.020288] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:41:24.027664] [DEBUG] [LOCAL ] LND: Loaded 4893 existing records from primary storage. [2025-10-31T19:41:24.027959] [INFO ] [MAIN ] LND: Loaded 4893 existing records. [2025-10-31T19:41:24.235474] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:41:24.235807] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-31T19:41:24.235886] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-31T19:41:24.236090] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-31T19:41:24.236150] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-31T19:41:24.272335] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-31T19:41:24.606246] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:41:24.651894] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-31T19:41:25.057627] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-31T19:41:25.204606] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-31T19:41:25.561943] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T19:41:25.857713] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-31T19:41:25.910196] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T19:41:25.922405] [INFO ] [REMOTE ] LLY: Full fetch complete (77183 records). [2025-10-31T19:41:25.922533] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-31T19:41:26.320204] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-31T19:41:26.320357] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-31T19:41:26.321472] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-31T19:41:26.321535] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-31T19:41:26.327298] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T19:41:26.329749] [DEBUG] [LOCAL ] LLY: Trimmed 77183 records to 53940 (keeping 200 days of data) [2025-10-31T19:41:26.657760] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-31T19:41:26.674135] [DEBUG] [LOCAL ] LLY: Primary data saved (53940 records). [2025-10-31T19:41:26.674243] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-31T19:41:26.674319] [INFO ] [MAIN ] Update Progress: 1259/2365 symbols completed. LLY took 32.6s. Estimated remaining: 2h 21m 46s. Rate: 7.8 symbols/min [2025-10-31T19:41:26.846508] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:41:26.902093] [DEBUG] [LOCAL ] LNG: Loaded 51335 existing records from primary storage. [2025-10-31T19:41:26.902393] [INFO ] [MAIN ] LNG: Loaded 51335 existing records. [2025-10-31T19:41:27.102945] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:41:27.103173] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-31T19:41:27.103220] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-31T19:41:27.103469] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-31T19:41:27.103508] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-31T19:41:27.208480] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-31T19:41:27.462626] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-31T19:41:27.462566] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:41:27.959300] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-31T19:41:28.257715] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-31T19:41:29.057686] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-31T19:41:29.739735] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T19:41:29.751236] [INFO ] [REMOTE ] LNC: Full fetch complete (74519 records). [2025-10-31T19:41:29.751364] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-31T19:41:29.862866] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-31T19:41:30.144938] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-31T19:41:30.145012] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-31T19:41:30.146016] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-31T19:41:30.146078] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-31T19:41:30.147533] [DEBUG] [LOCAL ] LNC: Trimmed 74519 records to 52028 (keeping 200 days of data) [2025-10-31T19:41:30.454122] [DEBUG] [LOCAL ] LNC: Primary data saved (52028 records). [2025-10-31T19:41:30.454248] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-31T19:41:30.455101] [INFO ] [MAIN ] Update Progress: 1260/2365 symbols completed. LNC took 31.7s. Estimated remaining: 2h 21m 35s. Rate: 7.8 symbols/min [2025-10-31T19:41:30.630570] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:41:30.659859] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-31T19:41:30.665325] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-31T19:41:30.680842] [DEBUG] [LOCAL ] LNN: Loaded 11725 existing records from primary storage. [2025-10-31T19:41:30.681042] [INFO ] [MAIN ] LNN: Loaded 11725 existing records. [2025-10-31T19:41:30.860867] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:41:30.861105] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-31T19:41:30.861150] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-31T19:41:30.861320] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-31T19:41:30.861374] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-31T19:41:31.197163] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-31T19:41:31.222476] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:41:31.457888] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-31T19:41:31.460771] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-31T19:41:32.049431] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-31T19:41:32.257714] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-31T19:41:32.680635] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-31T19:41:33.057667] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-31T19:41:33.629226] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T19:41:33.857764] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-31T19:41:34.304786] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-31T19:41:34.657690] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-31T19:41:35.105964] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-31T19:41:35.457687] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-31T19:41:36.257695] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-31T19:41:36.696625] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-31T19:41:37.057635] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-31T19:41:37.289806] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-31T19:41:37.301082] [INFO ] [REMOTE ] LMT: Full fetch complete (72476 records). [2025-10-31T19:41:37.301213] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-31T19:41:37.690431] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-31T19:41:37.690506] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-31T19:41:37.691455] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-31T19:41:37.691517] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-31T19:41:37.692853] [DEBUG] [LOCAL ] LMT: Trimmed 72476 records to 50114 (keeping 200 days of data) [2025-10-31T19:41:37.870570] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-31T19:41:38.001911] [DEBUG] [LOCAL ] LMT: Primary data saved (50114 records). [2025-10-31T19:41:38.002055] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-31T19:41:38.002175] [INFO ] [MAIN ] Update Progress: 1261/2365 symbols completed. LMT took 40.9s. Estimated remaining: 2h 21m 27s. Rate: 7.8 symbols/min [2025-10-31T19:41:38.170785] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:41:38.207282] [DEBUG] [LOCAL ] LOAR: Loaded 41780 existing records from primary storage. [2025-10-31T19:41:38.207554] [INFO ] [MAIN ] LOAR: Loaded 41780 existing records. [2025-10-31T19:41:38.399021] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:41:38.399459] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-31T19:41:38.399596] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-31T19:41:38.400326] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-31T19:41:38.400385] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-31T19:41:38.664834] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-31T19:41:38.758013] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-31T19:41:38.810798] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:41:38.820960] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T19:41:39.133339] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-31T19:41:39.457667] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-31T19:41:40.257690] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-31T19:41:40.681349] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-31T19:41:40.862728] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T19:41:41.057696] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-31T19:41:41.542397] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-31T19:41:41.857695] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-31T19:41:42.657681] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-31T19:41:42.719092] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-31T19:41:43.191911] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-31T19:41:43.193709] [INFO ] [REMOTE ] LND: Full fetch complete (7797 records). [2025-10-31T19:41:43.193775] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-31T19:41:43.462866] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-31T19:41:43.564369] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-31T19:41:43.564455] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-31T19:41:43.564697] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-31T19:41:43.564758] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-31T19:41:43.565219] [DEBUG] [LOCAL ] LND: Trimmed 7797 records to 4942 (keeping 200 days of data) [2025-10-31T19:41:43.594252] [DEBUG] [LOCAL ] LND: Primary data saved (4942 records). [2025-10-31T19:41:43.594387] [INFO ] [MAIN ] LND: Full history saved. [2025-10-31T19:41:43.594503] [INFO ] [MAIN ] Update Progress: 1262/2365 symbols completed. LND took 19.7s. Estimated remaining: 2h 21m 17s. Rate: 7.8 symbols/min [2025-10-31T19:41:43.769695] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:41:43.795531] [DEBUG] [LOCAL ] LOB: Loaded 26353 existing records from primary storage. [2025-10-31T19:41:43.795806] [INFO ] [MAIN ] LOB: Loaded 26353 existing records. [2025-10-31T19:41:43.980898] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:41:43.981609] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-31T19:41:43.981690] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-31T19:41:43.981992] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-31T19:41:43.982047] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-31T19:41:44.263922] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-31T19:41:44.289468] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-31T19:41:44.373047] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:41:45.065529] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-31T19:41:45.071080] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-31T19:41:45.842471] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T19:41:45.857604] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-31T19:41:46.458868] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-31T19:41:46.657703] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-31T19:41:47.383887] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-31T19:41:47.457707] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-31T19:41:48.257686] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-31T19:41:48.377772] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-31T19:41:49.057625] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-31T19:41:49.226449] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-31T19:41:49.857672] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-31T19:41:50.406869] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-31T19:41:50.510207] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-31T19:41:50.657675] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-31T19:41:51.457627] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-31T19:41:51.622142] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-31T19:41:52.257683] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-31T19:41:52.549930] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T19:41:52.896519] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-31T19:41:53.057637] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-31T19:41:53.808162] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-31T19:41:53.857613] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-31T19:41:54.607625] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T19:41:54.657633] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-31T19:41:55.457639] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-31T19:41:55.503564] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-31T19:41:56.257676] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-31T19:41:56.758586] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T19:41:57.057613] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-31T19:41:57.528317] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-31T19:41:57.857624] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-31T19:41:57.896068] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T19:41:58.634791] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T19:41:58.638827] [INFO ] [REMOTE ] LNN: Full fetch complete (16496 records). [2025-10-31T19:41:58.638924] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-31T19:41:58.667595] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-31T19:41:58.996606] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-31T19:41:58.996707] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-31T19:41:58.997075] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-31T19:41:58.997113] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-31T19:41:58.997738] [DEBUG] [LOCAL ] LNN: Trimmed 16496 records to 11849 (keeping 200 days of data) [2025-10-31T19:41:59.070091] [DEBUG] [LOCAL ] LNN: Primary data saved (11849 records). [2025-10-31T19:41:59.070215] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-31T19:41:59.070290] [INFO ] [MAIN ] Update Progress: 1263/2365 symbols completed. LNN took 28.6s. Estimated remaining: 2h 21m 16s. Rate: 7.8 symbols/min [2025-10-31T19:41:59.233172] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:41:59.238300] [DEBUG] [LOCAL ] LOCL: Loaded 3251 existing records from primary storage. [2025-10-31T19:41:59.238449] [INFO ] [MAIN ] LOCL: Loaded 3251 existing records. [2025-10-31T19:41:59.409579] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:41:59.409795] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-31T19:41:59.409841] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-31T19:41:59.409970] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-31T19:41:59.410008] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-31T19:41:59.462829] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-31T19:41:59.758566] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:41:59.952774] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-31T19:42:00.257619] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-31T19:42:00.369777] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-31T19:42:00.548874] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-31T19:42:01.057760] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-31T19:42:01.304590] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-31T19:42:01.857675] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-31T19:42:02.657676] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-31T19:42:03.099204] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-31T19:42:03.457684] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-31T19:42:03.726827] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-31T19:42:03.734434] [INFO ] [REMOTE ] LOB: Full fetch complete (38784 records). [2025-10-31T19:42:03.734672] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-31T19:42:04.123832] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-31T19:42:04.123929] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-31T19:42:04.124753] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-31T19:42:04.124817] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-31T19:42:04.125609] [DEBUG] [LOCAL ] LOB: Trimmed 38784 records to 26486 (keeping 200 days of data) [2025-10-31T19:42:04.260461] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-31T19:42:04.279950] [DEBUG] [LOCAL ] LOB: Primary data saved (26486 records). [2025-10-31T19:42:04.280076] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-31T19:42:04.280154] [INFO ] [MAIN ] Update Progress: 1264/2365 symbols completed. LOB took 20.7s. Estimated remaining: 2h 21m 7s. Rate: 7.8 symbols/min [2025-10-31T19:42:04.456155] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:42:04.488246] [DEBUG] [LOCAL ] LOMA: Loaded 33486 existing records from primary storage. [2025-10-31T19:42:04.488588] [INFO ] [MAIN ] LOMA: Loaded 33486 existing records. [2025-10-31T19:42:04.733459] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T19:42:04.740625] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:42:04.750012] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-31T19:42:04.750103] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-31T19:42:04.750481] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-31T19:42:04.750551] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-31T19:42:05.064708] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-31T19:42:05.183402] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:42:05.385188] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-31T19:42:05.573953] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T19:42:05.857708] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-31T19:42:06.657694] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-31T19:42:07.443030] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-31T19:42:07.457600] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-31T19:42:07.677914] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T19:42:08.257678] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-31T19:42:09.006246] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-31T19:42:09.057637] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-31T19:42:09.150065] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-31T19:42:09.857700] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-31T19:42:10.283473] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-31T19:42:10.291893] [INFO ] [REMOTE ] LOAR: Full fetch complete (55961 records). [2025-10-31T19:42:10.292010] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-31T19:42:10.659881] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-31T19:42:10.680094] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-31T19:42:10.680213] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-31T19:42:10.681174] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-31T19:42:10.681236] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-31T19:42:10.683068] [DEBUG] [LOCAL ] LOAR: Trimmed 55961 records to 41928 (keeping 200 days of data) [2025-10-31T19:42:10.805454] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-31T19:42:10.951784] [DEBUG] [LOCAL ] LOAR: Primary data saved (41928 records). [2025-10-31T19:42:10.951908] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-31T19:42:10.951986] [INFO ] [MAIN ] Update Progress: 1265/2365 symbols completed. LOAR took 32.9s. Estimated remaining: 2h 20m 58s. Rate: 7.8 symbols/min [2025-10-31T19:42:11.121473] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:42:11.170419] [DEBUG] [LOCAL ] LOW: Loaded 53294 existing records from primary storage. [2025-10-31T19:42:11.170768] [INFO ] [MAIN ] LOW: Loaded 53294 existing records. [2025-10-31T19:42:11.322221] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-31T19:42:11.367518] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:42:11.367742] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-31T19:42:11.367817] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-31T19:42:11.368930] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-31T19:42:11.368990] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-31T19:42:11.462833] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-31T19:42:11.727945] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:42:11.788722] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-31T19:42:12.257629] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-31T19:42:13.057685] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-31T19:42:13.677276] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-31T19:42:13.828124] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-31T19:42:13.857616] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-31T19:42:14.189315] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-31T19:42:14.657676] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-31T19:42:15.008788] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-31T19:42:15.457670] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-31T19:42:16.257620] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-31T19:42:16.354749] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-31T19:42:16.590527] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-31T19:42:17.057701] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-31T19:42:17.857693] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-31T19:42:18.002334] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-31T19:42:18.657678] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-31T19:42:19.240429] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-31T19:42:19.462747] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-31T19:42:19.472773] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-31T19:42:20.257704] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-31T19:42:20.665530] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-31T19:42:20.880505] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-31T19:42:21.057700] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-31T19:42:21.857691] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-31T19:42:22.513097] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-31T19:42:22.557371] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-31T19:42:22.569103] [INFO ] [REMOTE ] LNG: Full fetch complete (74627 records). [2025-10-31T19:42:22.569252] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-31T19:42:22.662747] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-31T19:42:22.998745] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-31T19:42:22.999046] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-31T19:42:23.000057] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-31T19:42:23.000118] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-31T19:42:23.001422] [DEBUG] [LOCAL ] LNG: Trimmed 74627 records to 51702 (keeping 200 days of data) [2025-10-31T19:42:23.321102] [DEBUG] [LOCAL ] LNG: Primary data saved (51702 records). [2025-10-31T19:42:23.321245] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-31T19:42:23.321333] [INFO ] [MAIN ] Update Progress: 1266/2365 symbols completed. LNG took 56.6s. Estimated remaining: 2h 20m 54s. Rate: 7.8 symbols/min [2025-10-31T19:42:23.459574] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-31T19:42:23.494430] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:42:23.533897] [DEBUG] [LOCAL ] LPG: Loaded 38876 existing records from primary storage. [2025-10-31T19:42:23.534189] [INFO ] [MAIN ] LPG: Loaded 38876 existing records. [2025-10-31T19:42:23.721342] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:42:23.737693] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-31T19:42:23.737908] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-31T19:42:23.739413] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T19:42:23.745585] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-31T19:42:23.746171] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-31T19:42:24.128933] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:42:24.257620] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-31T19:42:24.958763] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T19:42:25.057631] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-31T19:42:25.198280] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-31T19:42:25.857683] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-31T19:42:26.209604] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-31T19:42:26.657693] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-31T19:42:27.160779] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-31T19:42:27.162415] [INFO ] [REMOTE ] LOCL: Full fetch complete (4582 records). [2025-10-31T19:42:27.162511] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-31T19:42:27.462259] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-31T19:42:27.547975] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-31T19:42:27.548082] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-31T19:42:27.548351] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-31T19:42:27.548453] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-31T19:42:27.549030] [DEBUG] [LOCAL ] LOCL: Trimmed 4582 records to 3274 (keeping 200 days of data) [2025-10-31T19:42:27.568359] [DEBUG] [LOCAL ] LOCL: Primary data saved (3274 records). [2025-10-31T19:42:27.568622] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-31T19:42:27.568758] [INFO ] [MAIN ] Update Progress: 1267/2365 symbols completed. LOCL took 28.5s. Estimated remaining: 2h 20m 44s. Rate: 7.8 symbols/min [2025-10-31T19:42:27.741821] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:42:27.781063] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-31T19:42:27.814916] [DEBUG] [LOCAL ] LPL: Loaded 29628 existing records from primary storage. [2025-10-31T19:42:27.815196] [INFO ] [MAIN ] LPL: Loaded 29628 existing records. [2025-10-31T19:42:27.987861] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:42:27.988100] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-31T19:42:27.988146] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-31T19:42:27.988352] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-31T19:42:27.988408] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-31T19:42:28.261788] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-31T19:42:28.343232] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:42:28.469210] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-31T19:42:29.057709] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-31T19:42:29.285506] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T19:42:29.857761] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-31T19:42:30.565390] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-31T19:42:30.657675] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-31T19:42:31.118713] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T19:42:31.457668] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-31T19:42:32.128214] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-31T19:42:32.145960] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-31T19:42:32.257669] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-31T19:42:32.967323] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T19:42:33.057706] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-31T19:42:33.857716] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-31T19:42:34.458353] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-31T19:42:34.518796] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-31T19:42:34.657714] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-31T19:42:35.457671] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-31T19:42:35.851129] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-31T19:42:35.860174] [INFO ] [REMOTE ] LOMA: Full fetch complete (48339 records). [2025-10-31T19:42:35.860286] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-31T19:42:36.228539] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-31T19:42:36.228663] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-31T19:42:36.229607] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-31T19:42:36.229700] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-31T19:42:36.230723] [DEBUG] [LOCAL ] LOMA: Trimmed 48339 records to 33846 (keeping 200 days of data) [2025-10-31T19:42:36.276623] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-31T19:42:36.356936] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-31T19:42:36.461099] [DEBUG] [LOCAL ] LOMA: Primary data saved (33846 records). [2025-10-31T19:42:36.461230] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-31T19:42:36.461312] [INFO ] [MAIN ] Update Progress: 1268/2365 symbols completed. LOMA took 32.2s. Estimated remaining: 2h 20m 37s. Rate: 7.8 symbols/min [2025-10-31T19:42:36.668329] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:42:36.708578] [DEBUG] [LOCAL ] LPX: Loaded 40117 existing records from primary storage. [2025-10-31T19:42:36.708901] [INFO ] [MAIN ] LPX: Loaded 40117 existing records. [2025-10-31T19:42:36.889909] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:42:36.890119] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-31T19:42:36.890169] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-31T19:42:36.890340] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-31T19:42:36.890376] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-31T19:42:37.062809] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-31T19:42:37.250238] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:42:37.421562] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-31T19:42:37.765832] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-31T19:42:37.857609] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-31T19:42:38.657689] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-31T19:42:38.950305] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T19:42:39.457665] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-31T19:42:39.797671] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-31T19:42:40.257688] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-31T19:42:40.538419] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T19:42:41.057718] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-31T19:42:41.291261] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T19:42:41.857671] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-31T19:42:42.067541] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-31T19:42:42.657717] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-31T19:42:43.207901] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T19:42:43.457695] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-31T19:42:43.832853] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-31T19:42:44.170680] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-31T19:42:44.257670] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-31T19:42:45.057666] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-31T19:42:45.422987] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-31T19:42:45.775681] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-31T19:42:45.857631] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-31T19:42:46.657639] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-31T19:42:46.945509] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-31T19:42:47.457675] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-31T19:42:47.607259] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-31T19:42:48.062152] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T19:42:48.075396] [INFO ] [REMOTE ] LOW: Full fetch complete (76666 records). [2025-10-31T19:42:48.075539] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-31T19:42:48.266926] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-31T19:42:48.465159] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-31T19:42:48.465236] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-31T19:42:48.466398] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-31T19:42:48.466464] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-31T19:42:48.467920] [DEBUG] [LOCAL ] LOW: Trimmed 76666 records to 53672 (keeping 200 days of data) [2025-10-31T19:42:48.806868] [DEBUG] [LOCAL ] LOW: Primary data saved (53672 records). [2025-10-31T19:42:48.807007] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-31T19:42:48.807085] [INFO ] [MAIN ] Update Progress: 1269/2365 symbols completed. LOW took 37.9s. Estimated remaining: 2h 20m 33s. Rate: 7.8 symbols/min [2025-10-31T19:42:48.974622] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:42:49.012785] [DEBUG] [LOCAL ] LRN: Loaded 39534 existing records from primary storage. [2025-10-31T19:42:49.013095] [INFO ] [MAIN ] LRN: Loaded 39534 existing records. [2025-10-31T19:42:49.067156] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-31T19:42:49.188315] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:42:49.188507] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-31T19:42:49.188553] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-31T19:42:49.188805] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-31T19:42:49.188861] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-31T19:42:49.541776] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:42:49.564807] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T19:42:49.857671] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-31T19:42:50.175203] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-31T19:42:50.657677] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-31T19:42:51.117947] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T19:42:51.125899] [INFO ] [REMOTE ] LPG: Full fetch complete (58352 records). [2025-10-31T19:42:51.126015] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-31T19:42:51.462772] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-31T19:42:51.515381] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-31T19:42:51.515500] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-31T19:42:51.516551] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-31T19:42:51.516621] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-31T19:42:51.517970] [DEBUG] [LOCAL ] LPG: Trimmed 58352 records to 39088 (keeping 200 days of data) [2025-10-31T19:42:51.757981] [DEBUG] [LOCAL ] LPG: Primary data saved (39088 records). [2025-10-31T19:42:51.758247] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-31T19:42:51.758373] [INFO ] [MAIN ] Update Progress: 1270/2365 symbols completed. LPG took 28.4s. Estimated remaining: 2h 20m 22s. Rate: 7.8 symbols/min [2025-10-31T19:42:51.910570] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-31T19:42:51.978816] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:42:52.018021] [DEBUG] [LOCAL ] LSPD: Loaded 42296 existing records from primary storage. [2025-10-31T19:42:52.018310] [INFO ] [MAIN ] LSPD: Loaded 42296 existing records. [2025-10-31T19:42:52.189599] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:42:52.189851] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-31T19:42:52.189897] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-31T19:42:52.190172] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-31T19:42:52.190227] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-31T19:42:52.265278] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-31T19:42:52.546914] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:42:52.653808] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T19:42:53.057683] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-31T19:42:53.664982] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-31T19:42:53.674821] [INFO ] [REMOTE ] LPL: Full fetch complete (38682 records). [2025-10-31T19:42:53.674961] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-31T19:42:53.868418] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-31T19:42:54.081573] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-31T19:42:54.081780] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-31T19:42:54.082754] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-31T19:42:54.082837] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-31T19:42:54.110635] [DEBUG] [LOCAL ] LPL: Trimmed 38682 records to 29901 (keeping 200 days of data) [2025-10-31T19:42:54.110488] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-31T19:42:54.287782] [DEBUG] [LOCAL ] LPL: Primary data saved (29901 records). [2025-10-31T19:42:54.287947] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-31T19:42:54.288032] [INFO ] [MAIN ] Update Progress: 1271/2365 symbols completed. LPL took 26.7s. Estimated remaining: 2h 20m 9s. Rate: 7.8 symbols/min [2025-10-31T19:42:54.454352] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:42:54.485987] [DEBUG] [LOCAL ] LTC: Loaded 30705 existing records from primary storage. [2025-10-31T19:42:54.486268] [INFO ] [MAIN ] LTC: Loaded 30705 existing records. [2025-10-31T19:42:54.661244] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-31T19:42:54.664956] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:42:54.666259] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-31T19:42:54.666336] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-31T19:42:54.666916] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-31T19:42:54.666977] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-31T19:42:55.055046] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:42:55.084254] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-31T19:42:55.457728] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-31T19:42:55.680434] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-31T19:42:56.257715] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-31T19:42:56.583295] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-31T19:42:57.041629] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T19:42:57.057624] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-31T19:42:57.857690] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-31T19:42:58.244292] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T19:42:58.657617] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-31T19:42:58.860612] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T19:42:59.457717] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-31T19:42:59.593956] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T19:43:00.257726] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-31T19:43:00.582634] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-31T19:43:01.057698] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-31T19:43:01.578710] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-31T19:43:01.857713] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-31T19:43:02.287368] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T19:43:02.657635] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-31T19:43:02.755575] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-31T19:43:03.457744] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-31T19:43:03.813832] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T19:43:04.257711] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-31T19:43:04.599443] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-31T19:43:05.057724] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-31T19:43:05.557249] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-31T19:43:05.857634] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-31T19:43:06.212953] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-31T19:43:06.657621] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-31T19:43:06.922467] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T19:43:07.457682] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-31T19:43:07.766421] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:43:08.257616] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-31T19:43:08.411472] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-31T19:43:09.057737] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-31T19:43:09.515499] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-31T19:43:09.524515] [INFO ] [REMOTE ] LPX: Full fetch complete (58367 records). [2025-10-31T19:43:09.524673] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-31T19:43:09.862746] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-31T19:43:09.905724] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-31T19:43:09.905799] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-31T19:43:09.906687] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-31T19:43:09.906766] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-31T19:43:09.907949] [DEBUG] [LOCAL ] LPX: Trimmed 58367 records to 40389 (keeping 200 days of data) [2025-10-31T19:43:10.170336] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-31T19:43:10.190160] [DEBUG] [LOCAL ] LPX: Primary data saved (40389 records). [2025-10-31T19:43:10.190306] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-31T19:43:10.190400] [INFO ] [MAIN ] Update Progress: 1272/2365 symbols completed. LPX took 33.7s. Estimated remaining: 2h 20m 9s. Rate: 7.8 symbols/min [2025-10-31T19:43:10.356989] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:43:10.403370] [DEBUG] [LOCAL ] LTH: Loaded 51895 existing records from primary storage. [2025-10-31T19:43:10.403689] [INFO ] [MAIN ] LTH: Loaded 51895 existing records. [2025-10-31T19:43:10.579576] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:43:10.579853] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-31T19:43:10.579910] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-31T19:43:10.580488] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-31T19:43:10.580545] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-31T19:43:10.662738] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-31T19:43:10.963540] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:43:10.988834] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T19:43:11.457638] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-31T19:43:11.821621] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T19:43:12.257701] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-31T19:43:12.670329] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-31T19:43:13.057721] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-31T19:43:13.170981] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T19:43:13.857700] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-31T19:43:14.236929] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-31T19:43:14.657953] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-31T19:43:14.818851] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T19:43:15.457683] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-31T19:43:15.937721] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T19:43:16.257622] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-31T19:43:16.421244] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-31T19:43:17.057729] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-31T19:43:17.643961] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-31T19:43:17.857717] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-31T19:43:18.087407] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-31T19:43:18.657635] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-31T19:43:19.040467] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-31T19:43:19.457682] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-31T19:43:19.820930] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-31T19:43:19.830611] [INFO ] [REMOTE ] LRN: Full fetch complete (58235 records). [2025-10-31T19:43:19.830921] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-31T19:43:20.238711] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-31T19:43:20.238804] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-31T19:43:20.239843] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-31T19:43:20.239906] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-31T19:43:20.241234] [DEBUG] [LOCAL ] LRN: Trimmed 58235 records to 39921 (keeping 200 days of data) [2025-10-31T19:43:20.290423] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-31T19:43:20.487583] [DEBUG] [LOCAL ] LRN: Primary data saved (39921 records). [2025-10-31T19:43:20.487896] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-31T19:43:20.488008] [INFO ] [MAIN ] Update Progress: 1273/2365 symbols completed. LRN took 31.7s. Estimated remaining: 2h 20m 3s. Rate: 7.8 symbols/min [2025-10-31T19:43:20.613209] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-31T19:43:20.691753] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:43:20.729264] [DEBUG] [LOCAL ] LTM: Loaded 39915 existing records from primary storage. [2025-10-31T19:43:20.729554] [INFO ] [MAIN ] LTM: Loaded 39915 existing records. [2025-10-31T19:43:20.911243] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:43:20.911453] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-31T19:43:20.911500] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-31T19:43:20.912203] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-31T19:43:20.912260] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-31T19:43:21.062933] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-31T19:43:21.279471] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:43:21.356623] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-31T19:43:21.857673] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-31T19:43:22.409849] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-31T19:43:22.657635] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-31T19:43:23.229116] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-31T19:43:23.239110] [INFO ] [REMOTE ] LSPD: Full fetch complete (62679 records). [2025-10-31T19:43:23.239234] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-31T19:43:23.467868] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-31T19:43:23.646439] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-31T19:43:23.646514] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-31T19:43:23.647420] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-31T19:43:23.647491] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-31T19:43:23.648869] [DEBUG] [LOCAL ] LSPD: Trimmed 62679 records to 42577 (keeping 200 days of data) [2025-10-31T19:43:23.891010] [DEBUG] [LOCAL ] LSPD: Primary data saved (42577 records). [2025-10-31T19:43:23.891215] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-31T19:43:23.891347] [INFO ] [MAIN ] Update Progress: 1274/2365 symbols completed. LSPD took 32.1s. Estimated remaining: 2h 19m 52s. Rate: 7.8 symbols/min [2025-10-31T19:43:24.077008] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:43:24.113730] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-31T19:43:24.160759] [DEBUG] [LOCAL ] LU: Loaded 49608 existing records from primary storage. [2025-10-31T19:43:24.161120] [INFO ] [MAIN ] LU: Loaded 49608 existing records. [2025-10-31T19:43:24.259918] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-31T19:43:24.352323] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:43:24.352572] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-31T19:43:24.352661] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-31T19:43:24.353552] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-31T19:43:24.353609] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-31T19:43:24.552409] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-31T19:43:24.744967] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:43:25.057661] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-31T19:43:25.712179] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-31T19:43:25.857627] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-31T19:43:25.921607] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-31T19:43:26.643618] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-31T19:43:26.657619] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-31T19:43:27.457703] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-31T19:43:27.696200] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-31T19:43:28.257716] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-31T19:43:28.650018] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-31T19:43:29.057684] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-31T19:43:29.482901] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T19:43:29.857672] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-31T19:43:30.009304] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-31T19:43:30.017033] [INFO ] [REMOTE ] LTC: Full fetch complete (43959 records). [2025-10-31T19:43:30.017193] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-31T19:43:30.402035] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-31T19:43:30.402112] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-31T19:43:30.402962] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-31T19:43:30.403025] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-31T19:43:30.403909] [DEBUG] [LOCAL ] LTC: Trimmed 43959 records to 30925 (keeping 200 days of data) [2025-10-31T19:43:30.591918] [DEBUG] [LOCAL ] LTC: Primary data saved (30925 records). [2025-10-31T19:43:30.592066] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-31T19:43:30.592972] [INFO ] [MAIN ] Update Progress: 1275/2365 symbols completed. LTC took 36.3s. Estimated remaining: 2h 19m 43s. Rate: 7.8 symbols/min [2025-10-31T19:43:30.667955] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-31T19:43:30.771177] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:43:30.790919] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-31T19:43:30.816929] [DEBUG] [LOCAL ] LUCK: Loaded 23276 existing records from primary storage. [2025-10-31T19:43:30.817182] [INFO ] [MAIN ] LUCK: Loaded 23276 existing records. [2025-10-31T19:43:31.002490] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:43:31.002802] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-31T19:43:31.002853] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-31T19:43:31.003322] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-31T19:43:31.003382] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-31T19:43:31.377255] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:43:31.457637] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-31T19:43:31.833037] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T19:43:32.257687] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-31T19:43:32.405034] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-31T19:43:33.057626] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-31T19:43:33.195570] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-31T19:43:33.857622] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-31T19:43:34.180852] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-31T19:43:34.657635] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-31T19:43:35.140211] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-31T19:43:35.151800] [INFO ] [REMOTE ] LTH: Full fetch complete (74770 records). [2025-10-31T19:43:35.151928] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-31T19:43:35.467204] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-31T19:43:35.547787] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-31T19:43:35.548013] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-31T19:43:35.549317] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-31T19:43:35.549434] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-31T19:43:35.569209] [DEBUG] [LOCAL ] LTH: Trimmed 74770 records to 52270 (keeping 200 days of data) [2025-10-31T19:43:35.573434] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-31T19:43:35.874705] [DEBUG] [LOCAL ] LTH: Primary data saved (52270 records). [2025-10-31T19:43:35.874833] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-31T19:43:35.874908] [INFO ] [MAIN ] Update Progress: 1276/2365 symbols completed. LTH took 25.7s. Estimated remaining: 2h 19m 34s. Rate: 7.8 symbols/min [2025-10-31T19:43:36.042489] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:43:36.089326] [DEBUG] [LOCAL ] LUMN: Loaded 54040 existing records from primary storage. [2025-10-31T19:43:36.089622] [INFO ] [MAIN ] LUMN: Loaded 54040 existing records. [2025-10-31T19:43:36.265587] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-31T19:43:36.268816] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:43:36.270010] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-31T19:43:36.270061] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-31T19:43:36.271007] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-31T19:43:36.271063] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-31T19:43:36.614700] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-31T19:43:36.654635] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:43:37.057726] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-31T19:43:37.192530] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T19:43:37.857688] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-31T19:43:38.387336] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-31T19:43:38.657690] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-31T19:43:38.907577] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T19:43:39.457695] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-31T19:43:39.782029] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T19:43:40.257711] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-31T19:43:40.435399] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-31T19:43:41.057685] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-31T19:43:41.466555] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T19:43:41.857696] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-31T19:43:41.931281] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-31T19:43:42.657639] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-31T19:43:43.195618] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-31T19:43:43.458781] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-31T19:43:43.458924] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-31T19:43:44.257740] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-31T19:43:44.873519] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-31T19:43:45.057687] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-31T19:43:45.167352] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T19:43:45.857618] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-31T19:43:46.263931] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T19:43:46.657621] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-31T19:43:46.696049] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-31T19:43:47.457680] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-31T19:43:47.677605] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-31T19:43:48.257672] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-31T19:43:48.863539] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-31T19:43:49.057634] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-31T19:43:49.508672] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-31T19:43:49.857640] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-31T19:43:50.372279] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-31T19:43:50.657672] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-31T19:43:50.989419] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-31T19:43:51.457666] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-31T19:43:52.083921] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-31T19:43:52.095229] [INFO ] [REMOTE ] LU: Full fetch complete (71259 records). [2025-10-31T19:43:52.095347] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-31T19:43:52.263699] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-31T19:43:52.476053] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-31T19:43:52.476129] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-31T19:43:52.477128] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-31T19:43:52.477191] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-31T19:43:52.478478] [DEBUG] [LOCAL ] LU: Trimmed 71259 records to 49982 (keeping 200 days of data) [2025-10-31T19:43:52.753886] [DEBUG] [LOCAL ] LU: Primary data saved (49982 records). [2025-10-31T19:43:52.754009] [INFO ] [MAIN ] LU: Full history saved. [2025-10-31T19:43:52.754087] [INFO ] [MAIN ] Update Progress: 1277/2365 symbols completed. LU took 28.9s. Estimated remaining: 2h 19m 34s. Rate: 7.8 symbols/min [2025-10-31T19:43:52.863588] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-31T19:43:53.057691] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-31T19:43:53.567997] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-31T19:43:53.857669] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-31T19:43:54.330014] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T19:43:54.397196] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-31T19:43:54.657636] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-31T19:43:55.430189] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-31T19:43:55.457622] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-31T19:43:56.257730] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-31T19:43:56.347704] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-31T19:43:56.353781] [INFO ] [REMOTE ] LUCK: Full fetch complete (38472 records). [2025-10-31T19:43:56.353911] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-31T19:43:56.786928] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-31T19:43:56.787018] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-31T19:43:56.787861] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-31T19:43:56.787926] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-31T19:43:56.788940] [DEBUG] [LOCAL ] LUCK: Trimmed 38472 records to 23468 (keeping 200 days of data) [2025-10-31T19:43:56.934246] [DEBUG] [LOCAL ] LUCK: Primary data saved (23468 records). [2025-10-31T19:43:56.934388] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-31T19:43:56.934497] [INFO ] [MAIN ] Update Progress: 1278/2365 symbols completed. LUCK took 26.3s. Estimated remaining: 2h 19m 23s. Rate: 7.8 symbols/min [2025-10-31T19:43:57.057766] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-31T19:43:57.650498] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-31T19:43:57.857703] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-31T19:43:58.425117] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-31T19:43:58.436195] [INFO ] [REMOTE ] LTM: Full fetch complete (52236 records). [2025-10-31T19:43:58.436351] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-31T19:43:58.818074] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-31T19:43:58.818157] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-31T19:43:58.819000] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-31T19:43:58.819066] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-31T19:43:58.820219] [DEBUG] [LOCAL ] LTM: Trimmed 52236 records to 40165 (keeping 200 days of data) [2025-10-31T19:43:59.053978] [DEBUG] [LOCAL ] LTM: Primary data saved (40165 records). [2025-10-31T19:43:59.054180] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-31T19:43:59.054264] [INFO ] [MAIN ] Update Progress: 1279/2365 symbols completed. LTM took 38.6s. Estimated remaining: 2h 19m 11s. Rate: 7.8 symbols/min [2025-10-31T19:43:59.357681] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-31T19:43:59.371711] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-31T19:44:01.228098] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-31T19:44:01.240319] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-31T19:44:03.363703] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-31T19:44:03.377773] [INFO ] [REMOTE ] LUMN: Full fetch complete (77792 records). [2025-10-31T19:44:03.378037] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-31T19:44:03.788727] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-31T19:44:03.788805] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-31T19:44:03.789812] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-31T19:44:03.789873] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-31T19:44:03.791228] [DEBUG] [LOCAL ] LUMN: Trimmed 77792 records to 54430 (keeping 200 days of data) [2025-10-31T19:44:04.094511] [DEBUG] [LOCAL ] LUMN: Primary data saved (54430 records). [2025-10-31T19:44:04.094664] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-31T19:44:04.094770] [INFO ] [MAIN ] Update Progress: 1280/2365 symbols completed. LUMN took 28.2s. Estimated remaining: 2h 19m 1s. Rate: 7.8 symbols/min [2025-10-31T19:44:04.623106] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:04.685329] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:04.757977] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-31T19:44:04.772175] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:04.789789] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-31T19:44:04.828942] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:04.827196] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-31T19:44:04.829583] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-31T19:44:04.830162] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-31T19:44:04.830250] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-31T19:44:04.895128] [DEBUG] [LOCAL ] LVWR: Loaded 18757 existing records from primary storage. [2025-10-31T19:44:04.921604] [INFO ] [MAIN ] LVWR: Loaded 18757 existing records. [2025-10-31T19:44:05.309803] [DEBUG] [LOCAL ] LVS: Loaded 53959 existing records from primary storage. [2025-10-31T19:44:05.382957] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-10-31T19:44:05.440188] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:05.436434] [INFO ] [MAIN ] LUV: Loaded 54079 existing records. [2025-10-31T19:44:05.459702] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-31T19:44:05.472270] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-31T19:44:05.459461] [INFO ] [MAIN ] LVS: Loaded 53959 existing records. [2025-10-31T19:44:05.534567] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-31T19:44:05.564683] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-31T19:44:05.835977] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:05.883023] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-31T19:44:06.021719] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:06.051770] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:06.080785] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-31T19:44:06.080706] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-31T19:44:06.100379] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-31T19:44:06.134720] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-31T19:44:06.153504] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-31T19:44:06.169021] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-31T19:44:06.177633] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-31T19:44:06.196902] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-31T19:44:06.207398] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-31T19:44:06.196994] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:44:06.272112] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-31T19:44:06.261600] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-31T19:44:06.280348] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:44:06.401516] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-31T19:44:06.452054] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-31T19:44:06.486413] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-31T19:44:06.495604] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:06.523102] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-31T19:44:06.544446] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-31T19:44:06.544116] [INFO ] [MAIN ] Update Progress: 1281/2365 symbols completed. LUXE took 2.4s. Estimated remaining: 2h 18m 49s. Rate: 7.8 symbols/min [2025-10-31T19:44:07.209371] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:07.210618] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-31T19:44:07.210354] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:07.206563] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:07.215960] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-31T19:44:07.217475] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-31T19:44:07.219787] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-31T19:44:07.265580] [DEBUG] [LOCAL ] LW: Loaded 51474 existing records from primary storage. [2025-10-31T19:44:07.265922] [INFO ] [MAIN ] LW: Loaded 51474 existing records. [2025-10-31T19:44:07.442809] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:07.443915] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-31T19:44:07.443970] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-31T19:44:07.444721] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-31T19:44:07.444779] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-31T19:44:07.721597] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T19:44:07.734014] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-31T19:44:07.801755] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:07.802033] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-31T19:44:08.153150] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-31T19:44:08.154788] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-31T19:44:08.565553] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-31T19:44:08.582882] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-31T19:44:08.583713] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-31T19:44:08.586036] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-31T19:44:08.679287] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-31T19:44:08.691472] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-31T19:44:09.085941] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-31T19:44:09.101408] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-31T19:44:09.188505] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-31T19:44:09.857759] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-31T19:44:10.041876] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-31T19:44:10.080349] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-31T19:44:10.428772] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-31T19:44:10.657631] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-31T19:44:11.241874] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T19:44:11.457735] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-31T19:44:12.257684] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-31T19:44:12.370981] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-31T19:44:12.834131] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-31T19:44:13.024978] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T19:44:13.057619] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-31T19:44:13.662225] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-31T19:44:13.857758] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-31T19:44:14.657748] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-31T19:44:15.117033] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-31T19:44:15.457669] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-31T19:44:16.131523] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T19:44:16.257718] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-31T19:44:16.747272] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T19:44:17.057699] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-31T19:44:17.595345] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-31T19:44:17.622209] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-31T19:44:17.857688] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-31T19:44:18.657703] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-31T19:44:19.203765] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-31T19:44:19.457671] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-31T19:44:20.083083] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-31T19:44:20.086133] [INFO ] [REMOTE ] LVWR: Full fetch complete (20889 records). [2025-10-31T19:44:20.086211] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-31T19:44:20.265739] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-31T19:44:20.463717] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-31T19:44:20.463907] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-31T19:44:20.464475] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-31T19:44:20.464553] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-31T19:44:20.465586] [DEBUG] [LOCAL ] LVWR: Trimmed 20889 records to 18802 (keeping 200 days of data) [2025-10-31T19:44:20.579875] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-31T19:44:20.617506] [DEBUG] [LOCAL ] LVWR: Primary data saved (18802 records). [2025-10-31T19:44:20.617637] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-31T19:44:20.617754] [INFO ] [MAIN ] Update Progress: 1282/2365 symbols completed. LVWR took 16.5s. Estimated remaining: 2h 18m 46s. Rate: 7.8 symbols/min [2025-10-31T19:44:20.783906] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:20.800839] [DEBUG] [LOCAL ] LXFR: Loaded 16259 existing records from primary storage. [2025-10-31T19:44:20.801089] [INFO ] [MAIN ] LXFR: Loaded 16259 existing records. [2025-10-31T19:44:20.973045] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:20.973276] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-31T19:44:20.973341] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-31T19:44:20.973624] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-31T19:44:20.973740] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-31T19:44:21.062849] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-31T19:44:21.325766] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:21.826238] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-31T19:44:21.857638] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-31T19:44:22.437820] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-31T19:44:22.657686] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-31T19:44:23.173219] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T19:44:23.457759] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-31T19:44:23.837025] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T19:44:24.257740] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-31T19:44:24.899543] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-31T19:44:25.057741] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-31T19:44:25.595402] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-31T19:44:25.784050] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T19:44:25.857634] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-31T19:44:26.537177] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T19:44:26.550893] [INFO ] [REMOTE ] LVS: Full fetch complete (77729 records). [2025-10-31T19:44:26.551077] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-31T19:44:26.660106] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-31T19:44:26.963964] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-31T19:44:26.964061] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-31T19:44:26.965119] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-31T19:44:26.965183] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-31T19:44:26.966626] [DEBUG] [LOCAL ] LVS: Trimmed 77729 records to 54349 (keeping 200 days of data) [2025-10-31T19:44:27.292038] [DEBUG] [LOCAL ] LVS: Primary data saved (54349 records). [2025-10-31T19:44:27.292183] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-31T19:44:27.292266] [INFO ] [MAIN ] Update Progress: 1283/2365 symbols completed. LVS took 23.2s. Estimated remaining: 2h 18m 38s. Rate: 7.8 symbols/min [2025-10-31T19:44:27.460582] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-31T19:44:27.462099] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:27.517727] [DEBUG] [LOCAL ] LXP: Loaded 51005 existing records from primary storage. [2025-10-31T19:44:27.518180] [INFO ] [MAIN ] LXP: Loaded 51005 existing records. [2025-10-31T19:44:27.708315] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:27.708635] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-31T19:44:27.708723] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-31T19:44:27.709082] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-31T19:44:27.709130] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-31T19:44:28.110008] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:28.143380] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-31T19:44:28.174425] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-31T19:44:28.257675] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-31T19:44:29.057738] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-31T19:44:29.724456] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-31T19:44:29.811671] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-31T19:44:29.857781] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-31T19:44:30.657697] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-31T19:44:31.048140] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T19:44:31.457702] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-31T19:44:32.085628] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-31T19:44:32.257706] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-31T19:44:32.529390] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-31T19:44:33.057673] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-31T19:44:33.525676] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-31T19:44:33.857678] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-31T19:44:34.255751] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T19:44:34.657709] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-31T19:44:35.139555] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-31T19:44:35.386534] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-31T19:44:35.457668] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-31T19:44:36.086349] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-31T19:44:36.257704] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-31T19:44:37.057671] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-31T19:44:37.484366] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T19:44:37.857739] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-31T19:44:38.366782] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T19:44:38.657672] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-31T19:44:39.062141] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-31T19:44:39.457738] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-31T19:44:40.171710] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-31T19:44:40.257616] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-31T19:44:40.633732] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T19:44:40.828019] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-31T19:44:40.840390] [INFO ] [REMOTE ] LUV: Full fetch complete (77867 records). [2025-10-31T19:44:40.840555] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-31T19:44:41.067888] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-31T19:44:41.241595] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-31T19:44:41.241725] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-31T19:44:41.242802] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-31T19:44:41.242863] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-31T19:44:41.244413] [DEBUG] [LOCAL ] LUV: Trimmed 77867 records to 54469 (keeping 200 days of data) [2025-10-31T19:44:41.578379] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-10-31T19:44:41.578518] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-31T19:44:41.578597] [INFO ] [MAIN ] Update Progress: 1284/2365 symbols completed. LUV took 37.5s. Estimated remaining: 2h 18m 36s. Rate: 7.8 symbols/min [2025-10-31T19:44:41.754781] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:41.783670] [DEBUG] [LOCAL ] LXU: Loaded 31353 existing records from primary storage. [2025-10-31T19:44:41.783950] [INFO ] [MAIN ] LXU: Loaded 31353 existing records. [2025-10-31T19:44:41.862762] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-31T19:44:41.962934] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:41.963161] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-31T19:44:41.963208] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-31T19:44:41.963492] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-31T19:44:41.963548] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-31T19:44:42.311736] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:42.602744] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-31T19:44:42.614788] [INFO ] [REMOTE ] LW: Full fetch complete (74723 records). [2025-10-31T19:44:42.614934] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-31T19:44:42.668737] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-31T19:44:43.022562] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-31T19:44:43.022719] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-31T19:44:43.023791] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-31T19:44:43.023898] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-31T19:44:43.025275] [DEBUG] [LOCAL ] LW: Trimmed 74723 records to 51859 (keeping 200 days of data) [2025-10-31T19:44:43.279218] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-31T19:44:43.396256] [DEBUG] [LOCAL ] LW: Primary data saved (51859 records). [2025-10-31T19:44:43.401044] [INFO ] [MAIN ] LW: Full history saved. [2025-10-31T19:44:43.402211] [INFO ] [MAIN ] Update Progress: 1285/2365 symbols completed. LW took 36.7s. Estimated remaining: 2h 18m 23s. Rate: 7.8 symbols/min [2025-10-31T19:44:43.401384] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-31T19:44:43.462806] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-31T19:44:43.579908] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:43.630031] [DEBUG] [LOCAL ] LYB: Loaded 54010 existing records from primary storage. [2025-10-31T19:44:43.630328] [INFO ] [MAIN ] LYB: Loaded 54010 existing records. [2025-10-31T19:44:43.811192] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:43.811410] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-31T19:44:43.811461] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-31T19:44:43.811673] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-31T19:44:43.811730] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-31T19:44:44.160269] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:44.257610] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-31T19:44:44.373985] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T19:44:45.057677] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-31T19:44:45.554607] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-31T19:44:45.857670] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-31T19:44:46.295225] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T19:44:46.537307] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-31T19:44:46.657626] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-31T19:44:47.457636] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-31T19:44:47.585297] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-31T19:44:48.103929] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-31T19:44:48.257628] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-31T19:44:48.935901] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-31T19:44:49.057621] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-31T19:44:49.857672] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-31T19:44:50.107427] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T19:44:50.657636] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-31T19:44:51.040936] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T19:44:51.178985] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-31T19:44:51.457716] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-31T19:44:52.257623] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-31T19:44:52.456090] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-31T19:44:53.057698] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-31T19:44:53.411892] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-31T19:44:53.857683] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-31T19:44:54.419695] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-31T19:44:54.431344] [INFO ] [REMOTE ] LXP: Full fetch complete (72830 records). [2025-10-31T19:44:54.431497] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-31T19:44:54.666767] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-31T19:44:54.818445] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-31T19:44:54.818540] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-31T19:44:54.819524] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-31T19:44:54.819590] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-31T19:44:54.821022] [DEBUG] [LOCAL ] LXP: Trimmed 72830 records to 51367 (keeping 200 days of data) [2025-10-31T19:44:55.127761] [DEBUG] [LOCAL ] LXP: Primary data saved (51367 records). [2025-10-31T19:44:55.131304] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-31T19:44:55.131458] [INFO ] [MAIN ] Update Progress: 1286/2365 symbols completed. LXP took 27.8s. Estimated remaining: 2h 18m 19s. Rate: 7.8 symbols/min [2025-10-31T19:44:55.302998] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:55.334093] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-31T19:44:55.385757] [DEBUG] [LOCAL ] LYG: Loaded 53014 existing records from primary storage. [2025-10-31T19:44:55.386041] [INFO ] [MAIN ] LYG: Loaded 53014 existing records. [2025-10-31T19:44:55.460979] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-31T19:44:55.572931] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:55.573377] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-31T19:44:55.573519] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-31T19:44:55.579134] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-31T19:44:55.583193] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-31T19:44:55.616419] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-31T19:44:55.652912] [INFO ] [REMOTE ] LXFR: Full fetch complete (24645 records). [2025-10-31T19:44:55.664583] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-31T19:44:56.272298] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-31T19:44:56.285586] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:56.356211] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-31T19:44:56.356288] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-31T19:44:56.356838] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-31T19:44:56.356899] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-31T19:44:56.357476] [DEBUG] [LOCAL ] LXFR: Trimmed 24645 records to 16360 (keeping 200 days of data) [2025-10-31T19:44:56.458344] [DEBUG] [LOCAL ] LXFR: Primary data saved (16360 records). [2025-10-31T19:44:56.458679] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-31T19:44:56.458831] [INFO ] [MAIN ] Update Progress: 1287/2365 symbols completed. LXFR took 35.8s. Estimated remaining: 2h 18m 6s. Rate: 7.8 symbols/min [2025-10-31T19:44:56.611539] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-31T19:44:56.662092] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:44:56.710803] [DEBUG] [LOCAL ] LYV: Loaded 51244 existing records from primary storage. [2025-10-31T19:44:56.711152] [INFO ] [MAIN ] LYV: Loaded 51244 existing records. [2025-10-31T19:44:56.884237] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:44:56.884439] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-31T19:44:56.884486] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-31T19:44:56.884945] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-31T19:44:56.885002] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-31T19:44:57.062897] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-31T19:44:57.236036] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:44:57.769355] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-31T19:44:57.857714] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-31T19:44:58.203468] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-31T19:44:58.657637] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-31T19:44:59.175232] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T19:44:59.457695] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-31T19:45:00.188558] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T19:45:00.257678] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-31T19:45:00.703058] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:45:01.057678] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-31T19:45:01.209244] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-31T19:45:01.857686] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-31T19:45:02.582629] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-31T19:45:02.657677] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-31T19:45:02.770955] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-31T19:45:03.457705] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-31T19:45:03.945870] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-31T19:45:04.257698] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-31T19:45:05.057733] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-31T19:45:05.279132] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-31T19:45:05.678430] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-31T19:45:05.857681] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-31T19:45:06.600881] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-31T19:45:06.657615] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-31T19:45:07.119137] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T19:45:07.457704] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-31T19:45:08.160240] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-31T19:45:08.257614] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-31T19:45:08.812299] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-31T19:45:09.057683] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-31T19:45:09.783419] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-31T19:45:09.857717] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-31T19:45:10.323850] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-31T19:45:10.657721] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-31T19:45:11.224374] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-31T19:45:11.457682] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-31T19:45:11.921183] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T19:45:12.167374] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-31T19:45:12.179717] [INFO ] [REMOTE ] LYB: Full fetch complete (77650 records). [2025-10-31T19:45:12.179859] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-31T19:45:12.262813] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-31T19:45:12.570089] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-31T19:45:12.570205] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-31T19:45:12.571289] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-31T19:45:12.571351] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-31T19:45:12.572808] [DEBUG] [LOCAL ] LYB: Trimmed 77650 records to 54400 (keeping 200 days of data) [2025-10-31T19:45:12.892177] [DEBUG] [LOCAL ] LYB: Primary data saved (54400 records). [2025-10-31T19:45:12.892306] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-31T19:45:12.893108] [INFO ] [MAIN ] Update Progress: 1288/2365 symbols completed. LYB took 29.5s. Estimated remaining: 2h 18m 5s. Rate: 7.8 symbols/min [2025-10-31T19:45:13.057426] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:45:13.057928] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-31T19:45:13.093594] [DEBUG] [LOCAL ] LZB: Loaded 34854 existing records from primary storage. [2025-10-31T19:45:13.093933] [INFO ] [MAIN ] LZB: Loaded 34854 existing records. [2025-10-31T19:45:13.265866] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:45:13.266069] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-31T19:45:13.266121] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-31T19:45:13.266297] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-31T19:45:13.266335] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-31T19:45:13.650855] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:45:13.688780] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-31T19:45:13.857711] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-31T19:45:14.320229] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:45:14.510066] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-31T19:45:14.657678] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-31T19:45:15.457664] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-31T19:45:15.588802] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-31T19:45:16.257722] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-31T19:45:16.745512] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-31T19:45:17.057725] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-31T19:45:17.144005] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-31T19:45:17.857689] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-31T19:45:18.355909] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:45:18.657680] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-31T19:45:18.939552] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-31T19:45:18.946790] [INFO ] [REMOTE ] LXU: Full fetch complete (45109 records). [2025-10-31T19:45:18.946927] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-31T19:45:19.351555] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-31T19:45:19.351637] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-31T19:45:19.352545] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-31T19:45:19.352609] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-31T19:45:19.353619] [DEBUG] [LOCAL ] LXU: Trimmed 45109 records to 31600 (keeping 200 days of data) [2025-10-31T19:45:19.457799] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-31T19:45:19.543334] [DEBUG] [LOCAL ] LXU: Primary data saved (31600 records). [2025-10-31T19:45:19.543531] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-31T19:45:19.543636] [INFO ] [MAIN ] Update Progress: 1289/2365 symbols completed. LXU took 38.0s. Estimated remaining: 2h 17m 57s. Rate: 7.8 symbols/min [2025-10-31T19:45:19.725069] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:45:19.740023] [DEBUG] [LOCAL ] LZM: Loaded 15020 existing records from primary storage. [2025-10-31T19:45:19.740331] [INFO ] [MAIN ] LZM: Loaded 15020 existing records. [2025-10-31T19:45:19.919686] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:45:19.920013] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-31T19:45:19.920081] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-31T19:45:19.920376] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-31T19:45:19.920433] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-31T19:45:20.269697] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-31T19:45:20.278129] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-31T19:45:20.329546] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:45:20.770486] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T19:45:21.057706] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-31T19:45:21.280284] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-31T19:45:21.532150] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T19:45:21.857709] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-31T19:45:22.657625] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-31T19:45:22.903750] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-31T19:45:23.457668] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-31T19:45:23.917802] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-31T19:45:23.934561] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-31T19:45:24.257700] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-31T19:45:25.057616] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-31T19:45:25.152822] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-31T19:45:25.857696] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-31T19:45:26.625227] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T19:45:26.638341] [INFO ] [REMOTE ] LYG: Full fetch complete (76273 records). [2025-10-31T19:45:26.638529] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-31T19:45:26.663430] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-31T19:45:27.071786] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-31T19:45:27.071930] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-31T19:45:27.074364] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-31T19:45:27.073499] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-31T19:45:27.077088] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-31T19:45:27.083404] [DEBUG] [LOCAL ] LYG: Trimmed 76273 records to 53383 (keeping 200 days of data) [2025-10-31T19:45:27.378702] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-31T19:45:27.401846] [DEBUG] [LOCAL ] LYG: Primary data saved (53383 records). [2025-10-31T19:45:27.402033] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-31T19:45:27.402148] [INFO ] [MAIN ] Update Progress: 1290/2365 symbols completed. LYG took 32.3s. Estimated remaining: 2h 17m 49s. Rate: 7.8 symbols/min [2025-10-31T19:45:27.462860] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-31T19:45:27.576660] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:45:27.627052] [DEBUG] [LOCAL ] M: Loaded 53931 existing records from primary storage. [2025-10-31T19:45:27.627360] [INFO ] [MAIN ] M: Loaded 53931 existing records. [2025-10-31T19:45:27.799624] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:45:27.799840] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-31T19:45:27.799885] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-31T19:45:27.800162] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-31T19:45:27.800216] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-31T19:45:28.202079] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:45:28.257673] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-31T19:45:28.518855] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-31T19:45:29.057733] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-31T19:45:29.671506] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-31T19:45:29.857697] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-31T19:45:29.886291] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-31T19:45:30.657683] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-31T19:45:31.159155] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T19:45:31.301086] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-31T19:45:31.457668] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-31T19:45:31.988806] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T19:45:32.257674] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-31T19:45:32.842702] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-31T19:45:33.057699] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-31T19:45:33.750720] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T19:45:33.762843] [INFO ] [REMOTE ] LYV: Full fetch complete (74207 records). [2025-10-31T19:45:33.763055] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-31T19:45:33.862871] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-31T19:45:34.159746] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-31T19:45:34.159836] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-31T19:45:34.160863] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-31T19:45:34.160928] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-31T19:45:34.162380] [DEBUG] [LOCAL ] LYV: Trimmed 74207 records to 51627 (keeping 200 days of data) [2025-10-31T19:45:34.465033] [DEBUG] [LOCAL ] LYV: Primary data saved (51627 records). [2025-10-31T19:45:34.465160] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-31T19:45:34.465237] [INFO ] [MAIN ] Update Progress: 1291/2365 symbols completed. LYV took 38.0s. Estimated remaining: 2h 17m 41s. Rate: 7.8 symbols/min [2025-10-31T19:45:34.632891] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:45:34.661149] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-31T19:45:34.682824] [DEBUG] [LOCAL ] MA: Loaded 52795 existing records from primary storage. [2025-10-31T19:45:34.683142] [INFO ] [MAIN ] MA: Loaded 52795 existing records. [2025-10-31T19:45:34.859602] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:45:34.859848] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-31T19:45:34.859895] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-31T19:45:34.860252] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-31T19:45:34.860291] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-31T19:45:35.219453] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:45:35.430473] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-31T19:45:35.457608] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-31T19:45:35.578556] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-31T19:45:36.257676] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-31T19:45:36.964570] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-31T19:45:37.057621] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-31T19:45:37.402584] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-31T19:45:37.410394] [INFO ] [REMOTE ] LZB: Full fetch complete (51014 records). [2025-10-31T19:45:37.410563] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-31T19:45:37.809012] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-31T19:45:37.809085] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-31T19:45:37.809895] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-31T19:45:37.809956] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-31T19:45:37.810921] [DEBUG] [LOCAL ] LZB: Trimmed 51014 records to 35066 (keeping 200 days of data) [2025-10-31T19:45:37.863160] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-31T19:45:38.021527] [DEBUG] [LOCAL ] LZB: Primary data saved (35066 records). [2025-10-31T19:45:38.021677] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-31T19:45:38.022338] [INFO ] [MAIN ] Update Progress: 1292/2365 symbols completed. LZB took 25.1s. Estimated remaining: 2h 17m 30s. Rate: 7.8 symbols/min [2025-10-31T19:45:38.188837] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:45:38.232204] [DEBUG] [LOCAL ] MAA: Loaded 43253 existing records from primary storage. [2025-10-31T19:45:38.232476] [INFO ] [MAIN ] MAA: Loaded 43253 existing records. [2025-10-31T19:45:38.413832] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:45:38.414098] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-31T19:45:38.414165] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-31T19:45:38.414496] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-31T19:45:38.414597] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-31T19:45:38.665302] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-31T19:45:38.766186] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-31T19:45:38.834328] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:45:39.322720] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-31T19:45:39.324027] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-31T19:45:39.457682] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-31T19:45:40.004851] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-31T19:45:40.257704] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-31T19:45:41.057687] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-31T19:45:41.627704] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-31T19:45:41.760742] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-31T19:45:41.857711] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-31T19:45:42.657724] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-31T19:45:43.185748] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-31T19:45:43.457683] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-31T19:45:43.732213] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T19:45:44.257681] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-31T19:45:44.989463] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-31T19:45:45.057669] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-31T19:45:45.336350] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-31T19:45:45.810683] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T19:45:45.815955] [INFO ] [REMOTE ] LZM: Full fetch complete (20478 records). [2025-10-31T19:45:45.816032] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-31T19:45:45.862797] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-31T19:45:46.201518] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-31T19:45:46.201612] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-31T19:45:46.202058] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-31T19:45:46.202109] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-31T19:45:46.202664] [DEBUG] [LOCAL ] LZM: Trimmed 20478 records to 15163 (keeping 200 days of data) [2025-10-31T19:45:46.283856] [DEBUG] [LOCAL ] LZM: Primary data saved (15163 records). [2025-10-31T19:45:46.283988] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-31T19:45:46.284064] [INFO ] [MAIN ] Update Progress: 1293/2365 symbols completed. LZM took 26.7s. Estimated remaining: 2h 17m 23s. Rate: 7.8 symbols/min [2025-10-31T19:45:46.450611] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:45:46.450809] [DEBUG] [LOCAL ] MAC: No existing data file found in primary storage. [2025-10-31T19:45:46.450851] [WARN ] [MAIN ] MAC: No existing data found, performing full refresh instead. [2025-10-31T19:45:46.450963] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-31T19:45:46.451025] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-31T19:45:46.451070] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-31T19:45:46.451103] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-31T19:45:46.664302] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-31T19:45:46.824364] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:45:47.457700] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-31T19:45:47.628257] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-31T19:45:48.067670] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-31T19:45:48.257634] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-31T19:45:48.635889] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-31T19:45:49.057726] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-31T19:45:49.827717] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-31T19:45:49.857613] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-31T19:45:50.150735] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-31T19:45:50.657686] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-31T19:45:51.347706] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-31T19:45:51.457708] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-31T19:45:51.845173] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T19:45:52.257740] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-31T19:45:53.057728] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-31T19:45:53.114003] [DEBUG] [REMOTE ] M: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-31T19:45:53.114406] [WARN ] [REMOTE ] M: No data returned for month 2025-09 [2025-10-31T19:45:53.114549] [FATAL] [REMOTE ] M: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:45:53.114822] [FATAL] [MAIN ] M: Failed to fetch primary data. [2025-10-31T19:45:53.115085] [WARN ] [MAIN ] M: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:45:53.115336] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-31T19:45:53.115458] [DEBUG] [LOCAL ] M: No primary data file found to delete. [2025-10-31T19:45:53.115638] [INFO ] [LOCAL ] M: Starting deletion of derivative data. [2025-10-31T19:45:53.115992] [DEBUG] [LOCAL ] M: Deleted derivative data file. [2025-10-31T19:45:53.116096] [INFO ] [MAIN ] Update Progress: 1294/2365 symbols completed. M took 25.7s. Estimated remaining: 2h 17m 14s. Rate: 7.8 symbols/min [2025-10-31T19:45:53.246097] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-31T19:45:53.359418] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:45:53.401370] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-31T19:45:53.421578] [DEBUG] [LOCAL ] MAGN: Loaded 36042 existing records from primary storage. [2025-10-31T19:45:53.421871] [INFO ] [MAIN ] MAGN: Loaded 36042 existing records. [2025-10-31T19:45:53.594361] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:45:53.594553] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-31T19:45:53.594598] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-31T19:45:53.594858] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-31T19:45:53.594913] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-31T19:45:53.865802] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-31T19:45:53.951238] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:45:54.657691] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-31T19:45:55.142152] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T19:45:55.457627] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-31T19:45:55.595281] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-31T19:45:56.257730] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-31T19:45:57.057624] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-31T19:45:57.099389] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-31T19:45:57.225537] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-31T19:45:57.857720] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-31T19:45:58.326705] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-31T19:45:58.663819] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-31T19:45:58.680467] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-31T19:45:59.457679] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-31T19:46:00.157897] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-31T19:46:00.257716] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-31T19:46:00.987904] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-31T19:46:01.057732] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-31T19:46:01.869943] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-31T19:46:01.876665] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-31T19:46:02.072930] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T19:46:02.657688] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-31T19:46:03.052987] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T19:46:03.457625] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-31T19:46:03.651252] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-31T19:46:04.257697] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-31T19:46:04.716555] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-31T19:46:04.836379] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T19:46:04.848159] [INFO ] [REMOTE ] MA: Full fetch complete (76370 records). [2025-10-31T19:46:04.848282] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-31T19:46:05.062871] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-31T19:46:05.235840] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-31T19:46:05.235914] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-31T19:46:05.236946] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-31T19:46:05.237008] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-31T19:46:05.241677] [DEBUG] [LOCAL ] MA: Trimmed 76370 records to 53185 (keeping 200 days of data) [2025-10-31T19:46:05.567298] [DEBUG] [LOCAL ] MA: Primary data saved (53185 records). [2025-10-31T19:46:05.567415] [INFO ] [MAIN ] MA: Full history saved. [2025-10-31T19:46:05.567489] [INFO ] [MAIN ] Update Progress: 1295/2365 symbols completed. MA took 31.1s. Estimated remaining: 2h 17m 11s. Rate: 7.8 symbols/min [2025-10-31T19:46:05.733190] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:46:05.770464] [DEBUG] [LOCAL ] MAIN: Loaded 41928 existing records from primary storage. [2025-10-31T19:46:05.770755] [INFO ] [MAIN ] MAIN: Loaded 41928 existing records. [2025-10-31T19:46:05.868039] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-31T19:46:05.948180] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:46:05.948364] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-31T19:46:05.948411] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-31T19:46:05.948788] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-31T19:46:05.948847] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-31T19:46:06.310824] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:46:06.387671] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T19:46:06.657687] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-31T19:46:07.062089] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-31T19:46:07.457700] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-31T19:46:07.775985] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-31T19:46:08.257639] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-31T19:46:08.466823] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-31T19:46:09.057705] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-31T19:46:09.489529] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-31T19:46:09.857708] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-31T19:46:10.292519] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-31T19:46:10.657712] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-31T19:46:11.077723] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-31T19:46:11.457669] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-31T19:46:11.963744] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T19:46:12.257683] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-31T19:46:12.712481] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T19:46:13.057683] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-31T19:46:13.862815] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-31T19:46:13.879470] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-31T19:46:13.891601] [INFO ] [REMOTE ] MAC: Full fetch complete (71534 records). [2025-10-31T19:46:13.891787] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-31T19:46:14.303948] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-31T19:46:14.304068] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-31T19:46:14.305183] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-31T19:46:14.305265] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-31T19:46:14.306759] [DEBUG] [LOCAL ] MAC: Trimmed 71534 records to 50102 (keeping 200 days of data) [2025-10-31T19:46:14.540944] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-31T19:46:14.643827] [DEBUG] [LOCAL ] MAC: Primary data saved (50102 records). [2025-10-31T19:46:14.643957] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-31T19:46:14.644028] [INFO ] [MAIN ] Update Progress: 1296/2365 symbols completed. MAC took 28.4s. Estimated remaining: 2h 17m 4s. Rate: 7.8 symbols/min [2025-10-31T19:46:14.664936] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-31T19:46:14.825716] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:46:14.848379] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-31T19:46:14.894212] [DEBUG] [LOCAL ] MAN: Loaded 44698 existing records from primary storage. [2025-10-31T19:46:14.894498] [INFO ] [MAIN ] MAN: Loaded 44698 existing records. [2025-10-31T19:46:15.068047] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:46:15.068266] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-31T19:46:15.068313] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-31T19:46:15.068615] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-31T19:46:15.068710] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-31T19:46:15.419683] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:46:15.457608] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-31T19:46:16.012116] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T19:46:16.257676] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-31T19:46:16.584553] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-31T19:46:17.057626] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-31T19:46:17.462991] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-31T19:46:17.857730] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-31T19:46:18.236289] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T19:46:18.657723] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-31T19:46:18.915960] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T19:46:19.457723] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-31T19:46:19.751519] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-31T19:46:20.257667] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-31T19:46:20.510083] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-31T19:46:21.057692] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-31T19:46:21.264317] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-31T19:46:21.857704] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-31T19:46:22.299530] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-31T19:46:22.657697] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-31T19:46:23.430014] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-31T19:46:23.440177] [INFO ] [REMOTE ] MAA: Full fetch complete (62288 records). [2025-10-31T19:46:23.440300] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-31T19:46:23.462829] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-31T19:46:23.819155] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-31T19:46:23.819233] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-31T19:46:23.820144] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-31T19:46:23.820292] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-31T19:46:23.821576] [DEBUG] [LOCAL ] MAA: Trimmed 62288 records to 43612 (keeping 200 days of data) [2025-10-31T19:46:24.064736] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-31T19:46:24.130803] [DEBUG] [LOCAL ] MAA: Primary data saved (43612 records). [2025-10-31T19:46:24.130933] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-31T19:46:24.131696] [INFO ] [MAIN ] Update Progress: 1297/2365 symbols completed. MAA took 46.1s. Estimated remaining: 2h 16m 58s. Rate: 7.8 symbols/min [2025-10-31T19:46:24.271943] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-31T19:46:24.305740] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:46:24.334275] [DEBUG] [LOCAL ] MANU: Loaded 26899 existing records from primary storage. [2025-10-31T19:46:24.334528] [INFO ] [MAIN ] MANU: Loaded 26899 existing records. [2025-10-31T19:46:24.510400] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:46:24.510794] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-31T19:46:24.510866] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-31T19:46:24.511321] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-31T19:46:24.511378] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-31T19:46:24.638611] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-31T19:46:24.898623] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:46:25.057669] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-31T19:46:25.478679] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T19:46:25.831150] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-31T19:46:25.857627] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-31T19:46:26.657740] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-31T19:46:27.040040] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-31T19:46:27.457665] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-31T19:46:27.898596] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-31T19:46:28.257667] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-31T19:46:28.656794] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T19:46:29.057637] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-31T19:46:29.478212] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-31T19:46:29.487258] [INFO ] [REMOTE ] MAGN: Full fetch complete (51996 records). [2025-10-31T19:46:29.487371] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-31T19:46:29.861739] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-31T19:46:29.862225] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-31T19:46:29.862910] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-31T19:46:29.863862] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-31T19:46:29.864037] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-31T19:46:29.865203] [DEBUG] [LOCAL ] MAGN: Trimmed 51996 records to 36265 (keeping 200 days of data) [2025-10-31T19:46:30.067904] [DEBUG] [LOCAL ] MAGN: Primary data saved (36265 records). [2025-10-31T19:46:30.068029] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-31T19:46:30.068107] [INFO ] [MAIN ] Update Progress: 1298/2365 symbols completed. MAGN took 37.0s. Estimated remaining: 2h 16m 49s. Rate: 7.8 symbols/min [2025-10-31T19:46:30.243326] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:46:30.289512] [DEBUG] [LOCAL ] MAS: Loaded 52549 existing records from primary storage. [2025-10-31T19:46:30.289916] [INFO ] [MAIN ] MAS: Loaded 52549 existing records. [2025-10-31T19:46:30.424179] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-31T19:46:30.497146] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:46:30.497340] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-31T19:46:30.497406] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-31T19:46:30.497697] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-31T19:46:30.497764] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-31T19:46:30.674964] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-31T19:46:30.864081] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:46:31.150150] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T19:46:31.457623] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-31T19:46:31.566326] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-31T19:46:32.257714] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-31T19:46:32.596329] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-31T19:46:33.057628] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-31T19:46:33.144725] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T19:46:33.857683] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-31T19:46:34.614039] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-31T19:46:34.625408] [INFO ] [REMOTE ] MAIN: Full fetch complete (60393 records). [2025-10-31T19:46:34.625571] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-31T19:46:34.662773] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-31T19:46:35.085446] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-31T19:46:35.085536] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-31T19:46:35.086580] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-31T19:46:35.086671] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-31T19:46:35.087982] [DEBUG] [LOCAL ] MAIN: Trimmed 60393 records to 42253 (keeping 200 days of data) [2025-10-31T19:46:35.337504] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-31T19:46:35.352938] [INFO ] [REMOTE ] MAN: Full fetch complete (63219 records). [2025-10-31T19:46:35.360285] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-31T19:46:35.468396] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-31T19:46:35.636291] [DEBUG] [LOCAL ] MAIN: Primary data saved (42253 records). [2025-10-31T19:46:35.649448] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-31T19:46:35.674566] [INFO ] [MAIN ] Update Progress: 1299/2365 symbols completed. MAIN took 30.1s. Estimated remaining: 2h 16m 39s. Rate: 7.8 symbols/min [2025-10-31T19:46:35.996499] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-31T19:46:35.996685] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-31T19:46:35.996233] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-31T19:46:36.008488] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-31T19:46:36.014639] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-31T19:46:36.070532] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:46:36.071423] [DEBUG] [LOCAL ] MAN: Trimmed 63219 records to 45040 (keeping 200 days of data) [2025-10-31T19:46:36.282438] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-31T19:46:36.360175] [DEBUG] [LOCAL ] MATV: Loaded 34468 existing records from primary storage. [2025-10-31T19:46:36.369250] [DEBUG] [LOCAL ] MAN: Primary data saved (45040 records). [2025-10-31T19:46:36.369549] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-31T19:46:36.369712] [INFO ] [MAIN ] Update Progress: 1300/2365 symbols completed. MAN took 21.7s. Estimated remaining: 2h 16m 26s. Rate: 7.8 symbols/min [2025-10-31T19:46:36.381596] [INFO ] [MAIN ] MATV: Loaded 34468 existing records. [2025-10-31T19:46:36.676846] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:46:36.737794] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:46:36.738281] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-31T19:46:36.738345] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-31T19:46:36.738707] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-31T19:46:36.738900] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-31T19:46:37.015265] [DEBUG] [LOCAL ] MATX: Loaded 31505 existing records from primary storage. [2025-10-31T19:46:37.042156] [INFO ] [MAIN ] MATX: Loaded 31505 existing records. [2025-10-31T19:46:37.188903] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-31T19:46:37.265402] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-31T19:46:37.230397] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:46:37.360998] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-31T19:46:37.365355] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:46:37.370582] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-31T19:46:37.370928] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-31T19:46:37.371305] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-31T19:46:37.371344] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-31T19:46:37.712931] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:46:37.857673] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-31T19:46:38.513565] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-31T19:46:38.541126] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T19:46:38.657628] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-31T19:46:39.457633] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-31T19:46:39.592863] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-31T19:46:40.236107] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-31T19:46:40.257604] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-31T19:46:41.057623] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-31T19:46:41.135991] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T19:46:41.857673] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-31T19:46:42.369681] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T19:46:42.657606] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-31T19:46:42.711700] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-31T19:46:43.457664] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-31T19:46:43.763373] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-31T19:46:44.257623] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-31T19:46:44.551342] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-31T19:46:45.057668] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-31T19:46:45.421897] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-31T19:46:45.857667] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-31T19:46:46.117179] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T19:46:46.657677] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-31T19:46:46.836222] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-31T19:46:47.457623] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-31T19:46:47.511449] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-31T19:46:48.257666] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-31T19:46:48.374757] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-31T19:46:49.057622] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-31T19:46:49.215027] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-31T19:46:49.813357] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-31T19:46:49.857612] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-31T19:46:50.657698] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-31T19:46:50.762797] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-31T19:46:51.457720] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-31T19:46:51.960359] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-31T19:46:52.257698] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-31T19:46:52.408386] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-31T19:46:53.057696] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-31T19:46:53.257226] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-31T19:46:53.857701] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-31T19:46:54.073255] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T19:46:54.657686] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-31T19:46:55.334067] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-31T19:46:55.457674] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-31T19:46:55.740799] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-31T19:46:56.257725] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-31T19:46:56.770270] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-31T19:46:57.057694] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-31T19:46:57.231005] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-31T19:46:57.857665] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-31T19:46:58.207138] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T19:46:58.657617] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-31T19:46:58.836103] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-31T19:46:58.843119] [INFO ] [REMOTE ] MATX: Full fetch complete (44158 records). [2025-10-31T19:46:58.843263] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-31T19:46:59.219343] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-31T19:46:59.219423] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-31T19:46:59.220195] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-31T19:46:59.220256] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-31T19:46:59.221211] [DEBUG] [LOCAL ] MATX: Trimmed 44158 records to 31655 (keeping 200 days of data) [2025-10-31T19:46:59.410522] [DEBUG] [LOCAL ] MATX: Primary data saved (31655 records). [2025-10-31T19:46:59.410682] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-31T19:46:59.410774] [INFO ] [MAIN ] Update Progress: 1301/2365 symbols completed. MATX took 23.0s. Estimated remaining: 2h 16m 31s. Rate: 7.8 symbols/min [2025-10-31T19:46:59.465439] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-31T19:46:59.581675] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:46:59.610637] [DEBUG] [LOCAL ] MAX: Loaded 30802 existing records from primary storage. [2025-10-31T19:46:59.610918] [INFO ] [MAIN ] MAX: Loaded 30802 existing records. [2025-10-31T19:46:59.791000] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:46:59.791229] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-31T19:46:59.791287] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-31T19:46:59.791481] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-31T19:46:59.791517] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-31T19:47:00.154415] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:00.186826] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-31T19:47:00.257723] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-31T19:47:00.704924] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-31T19:47:00.712571] [INFO ] [REMOTE ] MANU: Full fetch complete (39443 records). [2025-10-31T19:47:00.712745] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-31T19:47:01.062744] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-31T19:47:01.128631] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-31T19:47:01.128784] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-31T19:47:01.129566] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-31T19:47:01.129609] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-31T19:47:01.130461] [DEBUG] [LOCAL ] MANU: Trimmed 39443 records to 27134 (keeping 200 days of data) [2025-10-31T19:47:01.318803] [DEBUG] [LOCAL ] MANU: Primary data saved (27134 records). [2025-10-31T19:47:01.318929] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-31T19:47:01.319009] [INFO ] [MAIN ] Update Progress: 1302/2365 symbols completed. MANU took 37.2s. Estimated remaining: 2h 16m 18s. Rate: 7.8 symbols/min [2025-10-31T19:47:01.520176] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:47:01.563927] [DEBUG] [LOCAL ] MBC: Loaded 44006 existing records from primary storage. [2025-10-31T19:47:01.564267] [INFO ] [MAIN ] MBC: Loaded 44006 existing records. [2025-10-31T19:47:01.788987] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:47:01.789358] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-31T19:47:01.789478] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-31T19:47:01.789954] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-31T19:47:01.790108] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-31T19:47:01.865686] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-31T19:47:02.059613] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-31T19:47:02.243477] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:02.245618] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T19:47:02.657684] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-31T19:47:02.864465] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-31T19:47:03.457630] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-31T19:47:03.667940] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-31T19:47:04.257697] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-31T19:47:04.333031] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-31T19:47:05.057724] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-31T19:47:05.365434] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-31T19:47:05.857699] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-31T19:47:06.363564] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-31T19:47:06.657620] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-31T19:47:06.799351] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-31T19:47:07.457677] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-31T19:47:07.804973] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-31T19:47:08.257705] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-31T19:47:08.471913] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-31T19:47:08.479769] [INFO ] [REMOTE ] MATV: Full fetch complete (51794 records). [2025-10-31T19:47:08.479937] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-31T19:47:08.892537] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-31T19:47:08.892688] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-31T19:47:08.893567] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-31T19:47:08.893741] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-31T19:47:08.895437] [DEBUG] [LOCAL ] MATV: Trimmed 51794 records to 34634 (keeping 200 days of data) [2025-10-31T19:47:09.040544] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-31T19:47:09.063227] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-31T19:47:09.087269] [INFO ] [REMOTE ] MAS: Full fetch complete (75458 records). [2025-10-31T19:47:09.096974] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-31T19:47:09.300431] [DEBUG] [LOCAL ] MATV: Primary data saved (34634 records). [2025-10-31T19:47:09.300631] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-31T19:47:09.306513] [INFO ] [MAIN ] Update Progress: 1303/2365 symbols completed. MATV took 33.6s. Estimated remaining: 2h 16m 11s. Rate: 7.8 symbols/min [2025-10-31T19:47:09.727731] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:47:09.813276] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-31T19:47:09.813360] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-31T19:47:09.814410] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-31T19:47:09.814499] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-31T19:47:09.816222] [DEBUG] [LOCAL ] MAS: Trimmed 75458 records to 52930 (keeping 200 days of data) [2025-10-31T19:47:09.875059] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-31T19:47:09.956867] [DEBUG] [LOCAL ] MBI: Loaded 23555 existing records from primary storage. [2025-10-31T19:47:09.957176] [INFO ] [MAIN ] MBI: Loaded 23555 existing records. [2025-10-31T19:47:10.260178] [DEBUG] [LOCAL ] MAS: Primary data saved (52930 records). [2025-10-31T19:47:10.270794] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-31T19:47:10.276092] [INFO ] [MAIN ] Update Progress: 1304/2365 symbols completed. MAS took 40.2s. Estimated remaining: 2h 15m 58s. Rate: 7.8 symbols/min [2025-10-31T19:47:10.420702] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:47:10.442621] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-31T19:47:10.456566] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-31T19:47:10.462676] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-31T19:47:10.473255] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-31T19:47:10.549402] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-31T19:47:10.624145] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:47:10.663719] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-31T19:47:10.971052] [DEBUG] [LOCAL ] MC: Loaded 43706 existing records from primary storage. [2025-10-31T19:47:10.976115] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:10.976957] [INFO ] [MAIN ] MC: Loaded 43706 existing records. [2025-10-31T19:47:11.168944] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:47:11.169271] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-31T19:47:11.169351] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-31T19:47:11.169867] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-31T19:47:11.169978] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-31T19:47:11.300573] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-31T19:47:11.463417] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-31T19:47:11.574758] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:11.638781] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-31T19:47:12.257734] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-31T19:47:12.619487] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-31T19:47:13.065497] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-31T19:47:13.068429] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-31T19:47:13.857742] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-31T19:47:14.092819] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T19:47:14.657638] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-31T19:47:14.689403] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-31T19:47:15.457697] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-31T19:47:15.717168] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T19:47:16.257634] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-31T19:47:16.286437] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-31T19:47:17.057679] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-31T19:47:17.297150] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-31T19:47:17.845863] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-31T19:47:17.857607] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-31T19:47:18.657676] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-31T19:47:18.931746] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-31T19:47:19.308539] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-31T19:47:19.457685] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-31T19:47:20.257621] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-31T19:47:20.559547] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-31T19:47:21.057624] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-31T19:47:21.174346] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-31T19:47:21.857684] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-31T19:47:22.211373] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-31T19:47:22.585365] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:47:22.657672] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-31T19:47:23.457617] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-31T19:47:23.641740] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-31T19:47:24.248696] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-31T19:47:24.257630] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-31T19:47:24.961744] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-31T19:47:25.057624] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-31T19:47:25.857712] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-31T19:47:26.283747] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-31T19:47:26.657723] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-31T19:47:26.957758] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-31T19:47:26.965776] [INFO ] [REMOTE ] MAX: Full fetch complete (45289 records). [2025-10-31T19:47:26.965933] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-31T19:47:27.357846] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-31T19:47:27.357931] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-31T19:47:27.358773] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-31T19:47:27.358833] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-31T19:47:27.359744] [DEBUG] [LOCAL ] MAX: Trimmed 45289 records to 31120 (keeping 200 days of data) [2025-10-31T19:47:27.457876] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-31T19:47:27.543922] [DEBUG] [LOCAL ] MAX: Primary data saved (31120 records). [2025-10-31T19:47:27.544059] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-31T19:47:27.544145] [INFO ] [MAIN ] Update Progress: 1305/2365 symbols completed. MAX took 28.1s. Estimated remaining: 2h 15m 58s. Rate: 7.8 symbols/min [2025-10-31T19:47:27.714068] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:47:27.726315] [DEBUG] [LOCAL ] MCB: Loaded 11469 existing records from primary storage. [2025-10-31T19:47:27.726518] [INFO ] [MAIN ] MCB: Loaded 11469 existing records. [2025-10-31T19:47:27.903044] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:47:27.903412] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-31T19:47:27.903481] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-31T19:47:27.903818] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-31T19:47:27.903931] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-31T19:47:28.099864] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-31T19:47:28.211934] [INFO ] [REMOTE ] MBC: Full fetch complete (63240 records). [2025-10-31T19:47:28.222303] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-31T19:47:28.264911] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-31T19:47:28.397135] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:28.693898] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-31T19:47:28.694076] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-31T19:47:28.695093] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-31T19:47:28.695179] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-31T19:47:28.696785] [DEBUG] [LOCAL ] MBC: Trimmed 63240 records to 44384 (keeping 200 days of data) [2025-10-31T19:47:28.930954] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-31T19:47:28.993344] [DEBUG] [LOCAL ] MBC: Primary data saved (44384 records). [2025-10-31T19:47:28.993460] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-31T19:47:28.994135] [INFO ] [MAIN ] Update Progress: 1306/2365 symbols completed. MBC took 27.7s. Estimated remaining: 2h 15m 45s. Rate: 7.8 symbols/min [2025-10-31T19:47:29.057614] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-31T19:47:29.166355] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:47:29.177766] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-31T19:47:29.177951] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-31T19:47:29.178872] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-31T19:47:29.179024] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-31T19:47:29.183775] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-31T19:47:29.184095] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-31T19:47:29.184145] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-31T19:47:29.537480] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:29.857675] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-31T19:47:30.164992] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-31T19:47:30.657711] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-31T19:47:31.409122] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-31T19:47:31.457633] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-31T19:47:31.539460] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-31T19:47:32.257737] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-31T19:47:32.986979] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-31T19:47:33.020628] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-31T19:47:33.057620] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-31T19:47:33.857706] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-31T19:47:33.937053] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-31T19:47:33.942297] [INFO ] [REMOTE ] MBI: Full fetch complete (35400 records). [2025-10-31T19:47:33.942380] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-31T19:47:34.308157] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-31T19:47:34.308241] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-31T19:47:34.309031] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-31T19:47:34.309092] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-31T19:47:34.309874] [DEBUG] [LOCAL ] MBI: Trimmed 35400 records to 23733 (keeping 200 days of data) [2025-10-31T19:47:34.433234] [DEBUG] [LOCAL ] MBI: Primary data saved (23733 records). [2025-10-31T19:47:34.433350] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-31T19:47:34.433423] [INFO ] [MAIN ] Update Progress: 1307/2365 symbols completed. MBI took 25.1s. Estimated remaining: 2h 15m 35s. Rate: 7.8 symbols/min [2025-10-31T19:47:34.598760] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:47:34.606467] [DEBUG] [LOCAL ] MCI: Loaded 6169 existing records from primary storage. [2025-10-31T19:47:34.606664] [INFO ] [MAIN ] MCI: Loaded 6169 existing records. [2025-10-31T19:47:34.662836] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-31T19:47:34.789794] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:47:34.790122] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-31T19:47:34.790186] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-31T19:47:34.790383] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-31T19:47:34.790437] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-31T19:47:34.987031] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-31T19:47:35.185728] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:35.371234] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-31T19:47:35.457668] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-31T19:47:35.936629] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-31T19:47:36.257664] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-31T19:47:36.783413] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-31T19:47:37.057705] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-31T19:47:37.857687] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-31T19:47:38.399148] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-31T19:47:38.657714] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-31T19:47:38.795496] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-31T19:47:39.457677] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-31T19:47:39.971916] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-31T19:47:40.021175] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-31T19:47:40.257731] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-31T19:47:41.057720] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-31T19:47:41.614002] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-31T19:47:41.857692] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-31T19:47:42.024246] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-31T19:47:42.348425] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T19:47:42.657698] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-31T19:47:43.046567] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-31T19:47:43.457678] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-31T19:47:44.257687] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-31T19:47:44.607855] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-31T19:47:44.628299] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-31T19:47:45.057693] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-31T19:47:45.857669] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-31T19:47:46.526310] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-31T19:47:46.657686] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-31T19:47:46.877354] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-31T19:47:47.203216] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-31T19:47:47.457631] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-31T19:47:48.257688] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-31T19:47:48.659807] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-31T19:47:48.669869] [INFO ] [REMOTE ] MC: Full fetch complete (63436 records). [2025-10-31T19:47:48.670020] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-31T19:47:49.063923] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-31T19:47:49.067809] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-31T19:47:49.067904] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-31T19:47:49.068960] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-31T19:47:49.069112] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-31T19:47:49.070485] [DEBUG] [LOCAL ] MC: Trimmed 63436 records to 44083 (keeping 200 days of data) [2025-10-31T19:47:49.335598] [DEBUG] [LOCAL ] MC: Primary data saved (44083 records). [2025-10-31T19:47:49.335765] [INFO ] [MAIN ] MC: Full history saved. [2025-10-31T19:47:49.335860] [INFO ] [MAIN ] Update Progress: 1308/2365 symbols completed. MC took 39.1s. Estimated remaining: 2h 15m 34s. Rate: 7.8 symbols/min [2025-10-31T19:47:49.504608] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:47:49.541008] [DEBUG] [LOCAL ] MCK: Loaded 37557 existing records from primary storage. [2025-10-31T19:47:49.541277] [INFO ] [MAIN ] MCK: Loaded 37557 existing records. [2025-10-31T19:47:49.649424] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-31T19:47:49.730553] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:47:49.730825] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-31T19:47:49.730894] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-31T19:47:49.731483] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-31T19:47:49.731542] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-31T19:47:49.857732] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-31T19:47:50.109564] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:50.140601] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-31T19:47:50.466312] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-31T19:47:50.657686] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-31T19:47:51.305512] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-31T19:47:51.457740] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-31T19:47:52.257683] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-31T19:47:52.518539] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T19:47:53.057690] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-31T19:47:53.469241] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-31T19:47:53.857624] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-31T19:47:53.979439] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-31T19:47:54.199857] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-31T19:47:54.657747] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-31T19:47:54.720144] [DEBUG] [REMOTE ] MCB: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-31T19:47:54.720621] [WARN ] [REMOTE ] MCB: No data returned for month 2025-09 [2025-10-31T19:47:54.721162] [FATAL] [REMOTE ] MCB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-31T19:47:54.721316] [FATAL] [MAIN ] MCB: Failed to fetch primary data. [2025-10-31T19:47:54.721388] [WARN ] [MAIN ] MCB: Deleting existing primary and derivative data due to fetch failure. [2025-10-31T19:47:54.721465] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-31T19:47:54.721543] [DEBUG] [LOCAL ] MCB: No primary data file found to delete. [2025-10-31T19:47:54.721582] [INFO ] [LOCAL ] MCB: Starting deletion of derivative data. [2025-10-31T19:47:54.721804] [DEBUG] [LOCAL ] MCB: Deleted derivative data file. [2025-10-31T19:47:54.721901] [INFO ] [MAIN ] Update Progress: 1309/2365 symbols completed. MCB took 27.2s. Estimated remaining: 2h 15m 24s. Rate: 7.8 symbols/min [2025-10-31T19:47:54.886729] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:47:54.895623] [DEBUG] [LOCAL ] MCN: Loaded 7835 existing records from primary storage. [2025-10-31T19:47:54.895888] [INFO ] [MAIN ] MCN: Loaded 7835 existing records. [2025-10-31T19:47:55.069105] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:47:55.069331] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-31T19:47:55.069377] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-31T19:47:55.069558] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-31T19:47:55.069595] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-31T19:47:55.417535] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:47:55.457666] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-31T19:47:56.199009] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-31T19:47:56.257700] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-31T19:47:56.755973] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-31T19:47:57.057714] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-31T19:47:57.442008] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-31T19:47:57.857713] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-31T19:47:58.657679] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-31T19:47:58.922420] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-31T19:47:59.100909] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-31T19:47:59.457676] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-31T19:47:59.951327] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-31T19:48:00.257674] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-31T19:48:00.905933] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-31T19:48:01.057694] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-31T19:48:01.595898] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-31T19:48:01.857672] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-31T19:48:02.657700] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-31T19:48:03.120590] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-31T19:48:03.457633] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-31T19:48:03.633780] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-31T19:48:03.958999] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T19:48:04.257677] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-31T19:48:05.057724] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-31T19:48:05.418598] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-31T19:48:05.460174] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-31T19:48:05.857679] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-31T19:48:06.657742] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-31T19:48:07.083100] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-31T19:48:07.143569] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T19:48:07.457690] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-31T19:48:08.257700] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-31T19:48:08.758346] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-31T19:48:08.760738] [INFO ] [REMOTE ] MCI: Full fetch complete (9793 records). [2025-10-31T19:48:08.760810] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-31T19:48:09.062856] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-31T19:48:09.203263] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-31T19:48:09.203364] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-31T19:48:09.203827] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-31T19:48:09.203912] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-31T19:48:09.204565] [DEBUG] [LOCAL ] MCI: Trimmed 9793 records to 6209 (keeping 200 days of data) [2025-10-31T19:48:09.284508] [DEBUG] [LOCAL ] MCI: Primary data saved (6209 records). [2025-10-31T19:48:09.286877] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-31T19:48:09.287022] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-31T19:48:09.301449] [INFO ] [MAIN ] Update Progress: 1310/2365 symbols completed. MCI took 34.9s. Estimated remaining: 2h 15m 22s. Rate: 7.8 symbols/min [2025-10-31T19:48:09.506597] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:48:09.546088] [DEBUG] [LOCAL ] MCO: Loaded 39506 existing records from primary storage. [2025-10-31T19:48:09.546358] [INFO ] [MAIN ] MCO: Loaded 39506 existing records. [2025-10-31T19:48:09.721893] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:48:09.727234] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-31T19:48:09.729102] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-31T19:48:09.729563] [INFO ] [REMOTE ] MCN: Full fetch complete (11543 records). [2025-10-31T19:48:09.729716] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-31T19:48:09.729619] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-31T19:48:09.760732] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-31T19:48:09.797420] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-31T19:48:09.864676] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-31T19:48:10.406376] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-31T19:48:10.417008] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-31T19:48:10.441816] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-31T19:48:10.446595] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:48:10.446730] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-31T19:48:10.447364] [DEBUG] [LOCAL ] MCN: Trimmed 11543 records to 7924 (keeping 200 days of data) [2025-10-31T19:48:10.491980] [DEBUG] [LOCAL ] MCN: Primary data saved (7924 records). [2025-10-31T19:48:10.492094] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-31T19:48:10.492169] [INFO ] [MAIN ] Update Progress: 1311/2365 symbols completed. MCN took 15.8s. Estimated remaining: 2h 15m 9s. Rate: 7.8 symbols/min [2025-10-31T19:48:10.654130] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:48:10.659451] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-31T19:48:10.664621] [DEBUG] [LOCAL ] MCR: Loaded 8914 existing records from primary storage. [2025-10-31T19:48:10.664821] [INFO ] [MAIN ] MCR: Loaded 8914 existing records. [2025-10-31T19:48:10.836752] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:48:10.836941] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-31T19:48:10.837003] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-31T19:48:10.837182] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-31T19:48:10.837219] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-31T19:48:11.191695] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:48:11.217619] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-31T19:48:11.457627] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-31T19:48:11.744241] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-31T19:48:12.257674] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-31T19:48:12.365093] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-31T19:48:12.942427] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-31T19:48:12.954524] [INFO ] [REMOTE ] MCD: Full fetch complete (77115 records). [2025-10-31T19:48:12.954740] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-31T19:48:13.062827] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-31T19:48:13.157986] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-31T19:48:13.158876] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-31T19:48:13.158951] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-31T19:48:13.159006] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-31T19:48:13.159069] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-31T19:48:13.159128] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-31T19:48:13.159168] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-31T19:48:13.159234] [INFO ] [MAIN ] Update Progress: 1312/2365 symbols completed. MCD took 44.2s. Estimated remaining: 2h 14m 57s. Rate: 7.8 symbols/min [2025-10-31T19:48:13.326906] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:48:13.348830] [DEBUG] [LOCAL ] MCS: Loaded 21278 existing records from primary storage. [2025-10-31T19:48:13.349074] [INFO ] [MAIN ] MCS: Loaded 21278 existing records. [2025-10-31T19:48:13.524193] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:48:13.524418] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-31T19:48:13.524463] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-31T19:48:13.524742] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-31T19:48:13.524796] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-31T19:48:13.864538] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-31T19:48:13.890446] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:48:14.298096] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T19:48:14.657625] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-31T19:48:14.932858] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-31T19:48:15.335792] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-31T19:48:15.457681] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-31T19:48:15.908832] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-31T19:48:16.257730] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-31T19:48:16.770779] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-31T19:48:17.057702] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-31T19:48:17.857608] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-31T19:48:18.252315] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-31T19:48:18.614467] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-31T19:48:18.657705] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-31T19:48:19.457697] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-31T19:48:19.486900] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-31T19:48:19.988058] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-31T19:48:20.257670] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-31T19:48:20.832362] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-31T19:48:21.057719] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-31T19:48:21.600390] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-31T19:48:21.857706] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-31T19:48:22.657680] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-31T19:48:23.104214] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-31T19:48:23.416981] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T19:48:23.457612] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-31T19:48:24.141343] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-31T19:48:24.257638] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-31T19:48:24.966431] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-31T19:48:25.057634] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-31T19:48:25.523744] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-31T19:48:25.857662] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-31T19:48:26.452153] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-31T19:48:26.657618] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-31T19:48:27.457636] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-31T19:48:27.630250] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-31T19:48:28.257696] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-31T19:48:28.509762] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-31T19:48:29.026872] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-31T19:48:29.057629] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-31T19:48:29.788983] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-31T19:48:29.857779] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-31T19:48:30.657703] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-31T19:48:30.890865] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-31T19:48:31.088233] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-31T19:48:31.457672] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-31T19:48:32.206371] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-31T19:48:32.209163] [INFO ] [REMOTE ] MCR: Full fetch complete (13055 records). [2025-10-31T19:48:32.209237] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-31T19:48:32.264750] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-31T19:48:32.570237] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-31T19:48:32.570322] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-31T19:48:32.570621] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-31T19:48:32.570691] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-31T19:48:32.571164] [DEBUG] [LOCAL ] MCR: Trimmed 13055 records to 8955 (keeping 200 days of data) [2025-10-31T19:48:32.621407] [DEBUG] [LOCAL ] MCR: Primary data saved (8955 records). [2025-10-31T19:48:32.621526] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-31T19:48:32.621600] [INFO ] [MAIN ] Update Progress: 1313/2365 symbols completed. MCR took 22.1s. Estimated remaining: 2h 14m 59s. Rate: 7.8 symbols/min [2025-10-31T19:48:32.788349] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:48:32.810846] [DEBUG] [LOCAL ] MCY: Loaded 22993 existing records from primary storage. [2025-10-31T19:48:32.811096] [INFO ] [MAIN ] MCY: Loaded 22993 existing records. [2025-10-31T19:48:32.993352] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:48:32.998888] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-31T19:48:33.006266] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-31T19:48:33.006897] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-31T19:48:33.006965] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-31T19:48:33.007396] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-31T19:48:33.062872] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-31T19:48:33.391638] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:48:33.857687] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-31T19:48:34.259558] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-31T19:48:34.657702] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-31T19:48:35.043582] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-31T19:48:35.457693] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-31T19:48:35.761180] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T19:48:36.257618] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-31T19:48:36.305249] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T19:48:36.310928] [INFO ] [REMOTE ] MCS: Full fetch complete (30918 records). [2025-10-31T19:48:36.311024] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-31T19:48:36.673247] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-31T19:48:36.673336] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-31T19:48:36.673965] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-31T19:48:36.674025] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-31T19:48:36.674756] [DEBUG] [LOCAL ] MCS: Trimmed 30918 records to 21495 (keeping 200 days of data) [2025-10-31T19:48:36.799421] [DEBUG] [LOCAL ] MCS: Primary data saved (21495 records). [2025-10-31T19:48:36.799564] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-31T19:48:36.799675] [INFO ] [MAIN ] Update Progress: 1314/2365 symbols completed. MCS took 23.6s. Estimated remaining: 2h 14m 48s. Rate: 7.8 symbols/min [2025-10-31T19:48:36.963973] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:48:36.999548] [DEBUG] [LOCAL ] MD: Loaded 38731 existing records from primary storage. [2025-10-31T19:48:36.999878] [INFO ] [MAIN ] MD: Loaded 38731 existing records. [2025-10-31T19:48:37.057675] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-31T19:48:37.179578] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:48:37.179784] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-31T19:48:37.179837] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-31T19:48:37.180156] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-31T19:48:37.180211] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-31T19:48:37.540220] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:48:37.560866] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-31T19:48:37.857720] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-31T19:48:38.163596] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:48:38.657754] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-31T19:48:39.000879] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-31T19:48:39.457676] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-31T19:48:40.096674] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-31T19:48:40.106828] [INFO ] [REMOTE ] MCO: Full fetch complete (58508 records). [2025-10-31T19:48:40.106939] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-31T19:48:40.258963] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-31T19:48:40.505176] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-31T19:48:40.512063] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-31T19:48:40.525168] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-31T19:48:40.525259] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-31T19:48:40.527032] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-31T19:48:40.535050] [DEBUG] [LOCAL ] MCO: Trimmed 58508 records to 39790 (keeping 200 days of data) [2025-10-31T19:48:40.789894] [DEBUG] [LOCAL ] MCO: Primary data saved (39790 records). [2025-10-31T19:48:40.790042] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-31T19:48:40.790169] [INFO ] [MAIN ] Update Progress: 1315/2365 symbols completed. MCO took 31.5s. Estimated remaining: 2h 14m 38s. Rate: 7.8 symbols/min [2025-10-31T19:48:40.969117] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:48:40.977466] [DEBUG] [LOCAL ] MDST: Loaded 6284 existing records from primary storage. [2025-10-31T19:48:40.977682] [INFO ] [MAIN ] MDST: Loaded 6284 existing records. [2025-10-31T19:48:41.066052] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-31T19:48:41.155258] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:48:41.155468] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-31T19:48:41.155516] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-31T19:48:41.155731] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-31T19:48:41.155788] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-31T19:48:41.511498] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:48:41.533128] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-31T19:48:41.857671] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-31T19:48:42.173432] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-31T19:48:42.329575] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T19:48:42.657718] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-31T19:48:43.457688] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-31T19:48:43.859124] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-31T19:48:43.867477] [INFO ] [REMOTE ] MCK: Full fetch complete (56238 records). [2025-10-31T19:48:43.867721] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-31T19:48:44.263750] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-31T19:48:44.266948] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-31T19:48:44.267064] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-31T19:48:44.268053] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-31T19:48:44.268140] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-31T19:48:44.270122] [DEBUG] [LOCAL ] MCK: Trimmed 56238 records to 37841 (keeping 200 days of data) [2025-10-31T19:48:44.506638] [DEBUG] [LOCAL ] MCK: Primary data saved (37841 records). [2025-10-31T19:48:44.506797] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-31T19:48:44.506877] [INFO ] [MAIN ] Update Progress: 1316/2365 symbols completed. MCK took 55.2s. Estimated remaining: 2h 14m 27s. Rate: 7.8 symbols/min [2025-10-31T19:48:44.680315] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:48:44.702394] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-31T19:48:44.754516] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-10-31T19:48:44.754863] [INFO ] [MAIN ] MDT: Loaded 54068 existing records. [2025-10-31T19:48:44.934683] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:48:44.934979] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-31T19:48:44.935056] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-31T19:48:44.935357] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-31T19:48:44.935429] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-31T19:48:45.065999] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-31T19:48:45.324568] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:48:45.456707] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-31T19:48:45.647050] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-31T19:48:45.857662] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-31T19:48:46.260131] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-31T19:48:46.657671] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-31T19:48:47.457703] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-31T19:48:47.716803] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-31T19:48:48.257715] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-31T19:48:48.852402] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-31T19:48:49.057702] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-31T19:48:49.147205] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-31T19:48:49.857694] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-31T19:48:49.965701] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-31T19:48:50.657726] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-31T19:48:50.952800] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-31T19:48:51.023486] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-31T19:48:51.457678] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-31T19:48:52.236199] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-31T19:48:52.257611] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-31T19:48:53.057631] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-31T19:48:53.075832] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-31T19:48:53.423735] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-31T19:48:53.857622] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-31T19:48:54.657664] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-31T19:48:55.068368] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-31T19:48:55.457621] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-31T19:48:55.497259] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-31T19:48:56.257725] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-31T19:48:56.362164] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T19:48:57.060308] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-31T19:48:57.061873] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T19:48:57.068881] [INFO ] [REMOTE ] MCY: Full fetch complete (39505 records). [2025-10-31T19:48:57.069059] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-31T19:48:57.456882] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-31T19:48:57.456966] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-31T19:48:57.457861] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-31T19:48:57.457925] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-31T19:48:57.458798] [DEBUG] [LOCAL ] MCY: Trimmed 39505 records to 23117 (keeping 200 days of data) [2025-10-31T19:48:57.604270] [DEBUG] [LOCAL ] MCY: Primary data saved (23117 records). [2025-10-31T19:48:57.604406] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-31T19:48:57.604488] [INFO ] [MAIN ] Update Progress: 1317/2365 symbols completed. MCY took 25.0s. Estimated remaining: 2h 14m 24s. Rate: 7.8 symbols/min [2025-10-31T19:48:57.857715] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-31T19:48:58.227924] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-31T19:48:58.457965] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-31T19:48:58.657673] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-31T19:48:59.054081] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-31T19:48:59.457728] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-31T19:49:00.257712] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-31T19:49:00.491419] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-31T19:49:01.057671] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-31T19:49:01.450029] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-31T19:49:01.687586] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-31T19:49:01.857679] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-31T19:49:02.657682] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-31T19:49:03.268922] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-31T19:49:03.457718] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-31T19:49:03.760398] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-31T19:49:04.257717] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-31T19:49:04.844019] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-31T19:49:05.057638] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-31T19:49:05.198025] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-31T19:49:05.396723] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-31T19:49:05.857673] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-31T19:49:06.657668] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-31T19:49:07.236814] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-31T19:49:07.279614] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-31T19:49:07.282031] [INFO ] [REMOTE ] MDST: Full fetch complete (8958 records). [2025-10-31T19:49:07.282099] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-31T19:49:07.469010] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-31T19:49:07.633743] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-31T19:49:07.633819] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-31T19:49:07.634031] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-31T19:49:07.634069] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-31T19:49:07.634454] [DEBUG] [LOCAL ] MDST: Trimmed 8958 records to 6336 (keeping 200 days of data) [2025-10-31T19:49:07.671628] [DEBUG] [LOCAL ] MDST: Primary data saved (6336 records). [2025-10-31T19:49:07.671740] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-31T19:49:07.671815] [INFO ] [MAIN ] Update Progress: 1318/2365 symbols completed. MDST took 26.9s. Estimated remaining: 2h 14m 18s. Rate: 7.8 symbols/min [2025-10-31T19:49:08.257751] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-31T19:49:08.960957] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-31T19:49:09.057684] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-31T19:49:09.511315] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-31T19:49:09.521499] [INFO ] [REMOTE ] MD: Full fetch complete (55438 records). [2025-10-31T19:49:09.521700] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-31T19:49:09.913558] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-31T19:49:09.913720] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-31T19:49:09.916044] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-31T19:49:09.916107] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-31T19:49:09.917536] [DEBUG] [LOCAL ] MD: Trimmed 55438 records to 39058 (keeping 200 days of data) [2025-10-31T19:49:10.142660] [DEBUG] [LOCAL ] MD: Primary data saved (39058 records). [2025-10-31T19:49:10.142799] [INFO ] [MAIN ] MD: Full history saved. [2025-10-31T19:49:10.143518] [INFO ] [MAIN ] Update Progress: 1319/2365 symbols completed. MD took 33.3s. Estimated remaining: 2h 14m 6s. Rate: 7.8 symbols/min [2025-10-31T19:49:10.578607] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-31T19:49:10.590067] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-31T19:49:11.944719] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-31T19:49:11.956128] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-31T19:49:12.560109] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-31T19:49:12.572175] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-31T19:49:12.572308] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-31T19:49:12.959038] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-31T19:49:12.959125] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-31T19:49:12.960339] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-31T19:49:12.960406] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-31T19:49:12.961859] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 54458 (keeping 200 days of data) [2025-10-31T19:49:13.289137] [DEBUG] [LOCAL ] MDT: Primary data saved (54458 records). [2025-10-31T19:49:13.289261] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-31T19:49:13.289336] [INFO ] [MAIN ] Update Progress: 1320/2365 symbols completed. MDT took 28.8s. Estimated remaining: 2h 13m 55s. Rate: 7.8 symbols/min [2025-10-31T19:49:14.011841] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:49:13.970598] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:49:14.007793] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:49:14.031623] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:49:14.046296] [DEBUG] [LOCAL ] MDV: Loaded 8313 existing records from primary storage. [2025-10-31T19:49:14.059902] [INFO ] [MAIN ] MDV: Loaded 8313 existing records. [2025-10-31T19:49:14.089694] [DEBUG] [LOCAL ] MEC: Loaded 17160 existing records from primary storage. [2025-10-31T19:49:14.114184] [INFO ] [MAIN ] MEC: Loaded 17160 existing records. [2025-10-31T19:49:14.177101] [DEBUG] [LOCAL ] MED: Loaded 20694 existing records from primary storage. [2025-10-31T19:49:14.308617] [INFO ] [MAIN ] MED: Loaded 20694 existing records. [2025-10-31T19:49:14.398901] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:49:14.458020] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-31T19:49:14.485138] [DEBUG] [LOCAL ] MDU: Loaded 48305 existing records from primary storage. [2025-10-31T19:49:14.500776] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-31T19:49:14.541346] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-31T19:49:14.547416] [INFO ] [MAIN ] MDU: Loaded 48305 existing records. [2025-10-31T19:49:14.580424] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-31T19:49:14.575103] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:49:14.585878] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-31T19:49:14.659423] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-31T19:49:14.778243] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-31T19:49:14.785484] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:49:14.797628] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-31T19:49:14.797955] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-31T19:49:14.847527] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-31T19:49:14.930514] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-31T19:49:14.990542] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-31T19:49:15.217438] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:49:15.369314] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-31T19:49:15.418083] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-31T19:49:15.496531] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-31T19:49:15.544319] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-31T19:49:15.702295] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:49:15.754687] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-31T19:49:15.987238] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:49:16.023019] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-31T19:49:16.289674] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:49:16.293380] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-31T19:49:16.321009] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-31T19:49:16.328303] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-31T19:49:16.386967] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:49:16.387357] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-31T19:49:16.756762] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-31T19:49:16.759985] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-31T19:49:16.775462] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-31T19:49:16.777458] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-31T19:49:17.165095] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-31T19:49:17.170128] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-31T19:49:17.248452] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-31T19:49:17.263232] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-31T19:49:17.625156] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-31T19:49:17.857619] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-31T19:49:17.944960] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-31T19:49:18.427861] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-31T19:49:18.657624] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-31T19:49:19.458734] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-31T19:49:19.457965] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-31T19:49:20.257698] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-31T19:49:20.651701] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T19:49:20.757553] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-31T19:49:21.057629] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-31T19:49:21.670279] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-31T19:49:21.857719] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-31T19:49:22.386749] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-31T19:49:22.657686] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-31T19:49:23.457688] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-31T19:49:23.949339] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T19:49:24.130264] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-31T19:49:24.257735] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-31T19:49:24.815402] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-31T19:49:25.057697] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-31T19:49:25.680045] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-31T19:49:25.857734] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-31T19:49:26.657715] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-31T19:49:27.027417] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-31T19:49:27.457685] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-31T19:49:27.509462] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-31T19:49:28.040309] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-31T19:49:28.257737] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-31T19:49:29.057684] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-31T19:49:29.556988] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-31T19:49:29.857625] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-31T19:49:29.896727] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-31T19:49:30.657747] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-31T19:49:31.115316] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-31T19:49:31.131236] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-31T19:49:31.457679] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-31T19:49:31.994094] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-31T19:49:32.257696] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-31T19:49:32.995506] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-31T19:49:33.057662] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-31T19:49:33.722268] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T19:49:33.857616] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-31T19:49:34.657624] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-31T19:49:34.703981] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-31T19:49:34.708838] [INFO ] [REMOTE ] MEC: Full fetch complete (23322 records). [2025-10-31T19:49:34.708946] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-31T19:49:35.119125] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-31T19:49:35.157083] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-31T19:49:35.157217] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-31T19:49:35.158451] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-31T19:49:35.158528] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-31T19:49:35.159815] [DEBUG] [LOCAL ] MEC: Trimmed 23322 records to 17311 (keeping 200 days of data) [2025-10-31T19:49:35.323838] [DEBUG] [LOCAL ] MEC: Primary data saved (17311 records). [2025-10-31T19:49:35.324101] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-31T19:49:35.324250] [INFO ] [MAIN ] Update Progress: 1321/2365 symbols completed. MEC took 22.0s. Estimated remaining: 2h 13m 58s. Rate: 7.8 symbols/min [2025-10-31T19:49:35.462928] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-31T19:49:35.617398] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:49:35.659869] [DEBUG] [LOCAL ] MEG: Loaded 31254 existing records from primary storage. [2025-10-31T19:49:35.660304] [INFO ] [MAIN ] MEG: Loaded 31254 existing records. [2025-10-31T19:49:35.904021] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:49:35.904284] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-31T19:49:35.904340] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-31T19:49:35.904674] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-31T19:49:35.904733] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-31T19:49:36.270968] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-31T19:49:36.350451] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:49:36.367098] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-31T19:49:37.057699] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-31T19:49:37.483633] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-31T19:49:37.639370] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-31T19:49:37.641465] [INFO ] [REMOTE ] MDV: Full fetch complete (11808 records). [2025-10-31T19:49:37.641538] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-31T19:49:37.862870] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-31T19:49:38.005264] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-31T19:49:38.005343] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-31T19:49:38.005638] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-31T19:49:38.005740] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-31T19:49:38.006186] [DEBUG] [LOCAL ] MDV: Trimmed 11808 records to 8341 (keeping 200 days of data) [2025-10-31T19:49:38.057291] [DEBUG] [LOCAL ] MDV: Primary data saved (8341 records). [2025-10-31T19:49:38.057478] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-31T19:49:38.057589] [INFO ] [MAIN ] Update Progress: 1322/2365 symbols completed. MDV took 24.8s. Estimated remaining: 2h 13m 47s. Rate: 7.8 symbols/min [2025-10-31T19:49:38.232801] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:49:38.253622] [DEBUG] [LOCAL ] MEGI: Loaded 19747 existing records from primary storage. [2025-10-31T19:49:38.253890] [INFO ] [MAIN ] MEGI: Loaded 19747 existing records. [2025-10-31T19:49:38.427852] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:49:38.428125] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-31T19:49:38.428194] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-31T19:49:38.428769] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-31T19:49:38.429039] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-31T19:49:38.662816] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-31T19:49:38.800408] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:49:39.183464] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-31T19:49:39.457637] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-31T19:49:39.518548] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T19:49:40.257736] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-31T19:49:40.615479] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T19:49:41.057615] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-31T19:49:41.237086] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-31T19:49:41.857672] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-31T19:49:42.355962] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-31T19:49:42.367514] [INFO ] [REMOTE ] MDU: Full fetch complete (70747 records). [2025-10-31T19:49:42.367639] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-31T19:49:42.664438] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-31T19:49:42.702484] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-31T19:49:42.783354] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-31T19:49:42.783429] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-31T19:49:42.784396] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-31T19:49:42.784457] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-31T19:49:42.785738] [DEBUG] [LOCAL ] MDU: Trimmed 70747 records to 48663 (keeping 200 days of data) [2025-10-31T19:49:43.076017] [DEBUG] [LOCAL ] MDU: Primary data saved (48663 records). [2025-10-31T19:49:43.076150] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-31T19:49:43.076228] [INFO ] [MAIN ] Update Progress: 1323/2365 symbols completed. MDU took 29.8s. Estimated remaining: 2h 13m 37s. Rate: 7.8 symbols/min [2025-10-31T19:49:43.249428] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:49:43.278309] [DEBUG] [LOCAL ] MEI: Loaded 31087 existing records from primary storage. [2025-10-31T19:49:43.278618] [INFO ] [MAIN ] MEI: Loaded 31087 existing records. [2025-10-31T19:49:43.456834] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:49:43.457043] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-31T19:49:43.457090] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-31T19:49:43.457339] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-31T19:49:43.457378] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-31T19:49:43.478141] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-31T19:49:43.658732] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-31T19:49:43.852579] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:49:44.257696] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-31T19:49:44.294892] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-31T19:49:45.020491] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-31T19:49:45.057616] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-31T19:49:45.858067] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-31T19:49:45.858218] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-31T19:49:45.864025] [INFO ] [REMOTE ] MED: Full fetch complete (31620 records). [2025-10-31T19:49:45.864102] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-31T19:49:46.252492] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-31T19:49:46.252564] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-31T19:49:46.253201] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-31T19:49:46.253261] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-31T19:49:46.254008] [DEBUG] [LOCAL ] MED: Trimmed 31620 records to 20827 (keeping 200 days of data) [2025-10-31T19:49:46.372274] [DEBUG] [LOCAL ] MED: Primary data saved (20827 records). [2025-10-31T19:49:46.372386] [INFO ] [MAIN ] MED: Full history saved. [2025-10-31T19:49:46.372460] [INFO ] [MAIN ] Update Progress: 1324/2365 symbols completed. MED took 33.1s. Estimated remaining: 2h 13m 26s. Rate: 7.8 symbols/min [2025-10-31T19:49:46.541274] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:49:46.591116] [DEBUG] [LOCAL ] MET: Loaded 53660 existing records from primary storage. [2025-10-31T19:49:46.591423] [INFO ] [MAIN ] MET: Loaded 53660 existing records. [2025-10-31T19:49:46.664302] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-31T19:49:46.770259] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:49:46.770591] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-31T19:49:46.770725] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-31T19:49:46.776380] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-31T19:49:46.784176] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-31T19:49:46.849130] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-31T19:49:47.139067] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:49:47.329383] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-31T19:49:47.457663] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-31T19:49:48.158956] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-31T19:49:48.257665] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-31T19:49:49.057677] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-31T19:49:49.350887] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-31T19:49:49.857627] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-31T19:49:49.929181] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-31T19:49:50.536957] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-31T19:49:50.657624] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-31T19:49:51.284788] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-31T19:49:51.457696] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-31T19:49:52.257691] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-31T19:49:52.631145] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-31T19:49:53.057685] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-31T19:49:53.279405] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-31T19:49:53.857686] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-31T19:49:54.377295] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-31T19:49:54.657711] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-31T19:49:54.730877] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-31T19:49:55.457626] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-31T19:49:55.629617] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-31T19:49:56.257632] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-31T19:49:56.293945] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T19:49:57.057612] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-31T19:49:57.126713] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-31T19:49:57.857712] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-31T19:49:58.131118] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-31T19:49:58.657633] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-31T19:49:58.694532] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-31T19:49:59.457616] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-31T19:49:59.643792] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-31T19:50:00.257696] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-31T19:50:00.319108] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-31T19:50:01.057722] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-31T19:50:01.616625] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-31T19:50:01.806245] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-31T19:50:01.857724] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-31T19:50:02.657691] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-31T19:50:03.056460] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-31T19:50:03.457670] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-31T19:50:03.557474] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-31T19:50:04.257688] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-31T19:50:04.479713] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-31T19:50:05.057714] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-31T19:50:05.198722] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-31T19:50:05.205418] [INFO ] [REMOTE ] MEI: Full fetch complete (45133 records). [2025-10-31T19:50:05.205510] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-31T19:50:05.582417] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-31T19:50:05.582498] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-31T19:50:05.583281] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-31T19:50:05.583343] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-31T19:50:05.584476] [DEBUG] [LOCAL ] MEI: Trimmed 45133 records to 31251 (keeping 200 days of data) [2025-10-31T19:50:05.766533] [DEBUG] [LOCAL ] MEI: Primary data saved (31251 records). [2025-10-31T19:50:05.766970] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-31T19:50:05.767066] [INFO ] [MAIN ] Update Progress: 1325/2365 symbols completed. MEI took 22.7s. Estimated remaining: 2h 13m 27s. Rate: 7.8 symbols/min [2025-10-31T19:50:05.867129] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-31T19:50:05.942451] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:50:05.982328] [DEBUG] [LOCAL ] MFA: Loaded 45446 existing records from primary storage. [2025-10-31T19:50:05.982702] [INFO ] [MAIN ] MFA: Loaded 45446 existing records. [2025-10-31T19:50:06.162530] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:50:06.162874] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-31T19:50:06.162952] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-31T19:50:06.169725] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-31T19:50:06.180913] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-31T19:50:06.213401] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-31T19:50:06.535996] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:50:06.642439] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-31T19:50:06.657625] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-31T19:50:07.457714] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-31T19:50:07.840289] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-31T19:50:08.114338] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-31T19:50:08.257665] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-31T19:50:09.057672] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-31T19:50:09.655731] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-31T19:50:09.857693] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-31T19:50:10.269842] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-31T19:50:10.277587] [INFO ] [REMOTE ] MEG: Full fetch complete (46993 records). [2025-10-31T19:50:10.277725] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-31T19:50:10.651672] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-31T19:50:10.651771] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-31T19:50:10.652572] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-31T19:50:10.652614] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-31T19:50:10.653574] [DEBUG] [LOCAL ] MEG: Trimmed 46993 records to 31540 (keeping 200 days of data) [2025-10-31T19:50:10.701384] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-31T19:50:10.842097] [DEBUG] [LOCAL ] MEG: Primary data saved (31540 records). [2025-10-31T19:50:10.842243] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-31T19:50:10.843011] [INFO ] [MAIN ] Update Progress: 1326/2365 symbols completed. MEG took 35.5s. Estimated remaining: 2h 13m 17s. Rate: 7.8 symbols/min [2025-10-31T19:50:11.027763] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:50:11.057333] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-31T19:50:11.060391] [DEBUG] [LOCAL ] MFAN: Loaded 4162 existing records from primary storage. [2025-10-31T19:50:11.070607] [INFO ] [MAIN ] MFAN: Loaded 4162 existing records. [2025-10-31T19:50:11.262018] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:50:11.262258] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-31T19:50:11.262306] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-31T19:50:11.262487] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-31T19:50:11.262544] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-31T19:50:11.462858] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-31T19:50:11.620333] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:50:11.806842] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-31T19:50:11.811430] [INFO ] [REMOTE ] MEGI: Full fetch complete (28967 records). [2025-10-31T19:50:11.811538] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-31T19:50:12.199387] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-31T19:50:12.199461] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-31T19:50:12.200134] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-31T19:50:12.200195] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-31T19:50:12.200926] [DEBUG] [LOCAL ] MEGI: Trimmed 28967 records to 19907 (keeping 200 days of data) [2025-10-31T19:50:12.259300] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-31T19:50:12.323400] [DEBUG] [LOCAL ] MEGI: Primary data saved (19907 records). [2025-10-31T19:50:12.323529] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-31T19:50:12.323604] [INFO ] [MAIN ] Update Progress: 1327/2365 symbols completed. MEGI took 34.3s. Estimated remaining: 2h 13m 5s. Rate: 7.8 symbols/min [2025-10-31T19:50:12.509003] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:50:12.515510] [DEBUG] [LOCAL ] MFAO: Loaded 3771 existing records from primary storage. [2025-10-31T19:50:12.515721] [INFO ] [MAIN ] MFAO: Loaded 3771 existing records. [2025-10-31T19:50:12.702697] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:50:12.702983] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-31T19:50:12.703058] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-31T19:50:12.703391] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-31T19:50:12.703447] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-31T19:50:13.003398] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-31T19:50:13.063776] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-31T19:50:13.094566] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:50:13.548838] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-31T19:50:13.857708] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-31T19:50:14.291000] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-31T19:50:14.324886] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-31T19:50:14.657671] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-31T19:50:15.457676] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-31T19:50:15.776253] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-31T19:50:15.885796] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-31T19:50:16.257698] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-31T19:50:17.057701] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-31T19:50:17.303878] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-31T19:50:17.517840] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-31T19:50:17.857723] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-31T19:50:18.657684] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-31T19:50:18.981221] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-31T19:50:19.457663] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-31T19:50:19.895574] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-31T19:50:20.257683] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-31T19:50:20.651115] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-31T19:50:21.057675] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-31T19:50:21.558709] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-31T19:50:21.857669] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-31T19:50:22.171374] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-31T19:50:22.245165] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-31T19:50:22.657665] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-31T19:50:23.014708] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-31T19:50:23.457708] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-31T19:50:23.790363] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-31T19:50:24.257691] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-31T19:50:24.639132] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-31T19:50:25.057664] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-31T19:50:25.512002] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-31T19:50:25.857726] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-31T19:50:26.232608] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-31T19:50:26.657871] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-31T19:50:27.063170] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-31T19:50:27.457682] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-31T19:50:28.257732] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-31T19:50:28.624849] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-31T19:50:28.776092] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-31T19:50:29.057671] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-31T19:50:29.857675] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-31T19:50:30.215733] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-31T19:50:30.485885] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-31T19:50:30.496097] [INFO ] [REMOTE ] MFA: Full fetch complete (65053 records). [2025-10-31T19:50:30.496232] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-31T19:50:30.666052] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-31T19:50:30.876816] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-31T19:50:30.876889] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-31T19:50:30.877857] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-31T19:50:30.877921] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-31T19:50:30.879104] [DEBUG] [LOCAL ] MFA: Trimmed 65053 records to 45786 (keeping 200 days of data) [2025-10-31T19:50:31.161343] [DEBUG] [LOCAL ] MFA: Primary data saved (45786 records). [2025-10-31T19:50:31.161466] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-31T19:50:31.161542] [INFO ] [MAIN ] Update Progress: 1328/2365 symbols completed. MFA took 25.4s. Estimated remaining: 2h 13m 6s. Rate: 7.8 symbols/min [2025-10-31T19:50:31.350078] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:50:31.402891] [DEBUG] [LOCAL ] MFC: Loaded 51219 existing records from primary storage. [2025-10-31T19:50:31.403310] [INFO ] [MAIN ] MFC: Loaded 51219 existing records. [2025-10-31T19:50:31.468154] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-31T19:50:31.593978] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:50:31.594183] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-31T19:50:31.594229] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-31T19:50:31.594707] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-31T19:50:31.594763] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-31T19:50:31.959777] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-31T19:50:31.979430] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:50:32.059286] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-31T19:50:32.257699] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-31T19:50:33.057701] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-31T19:50:33.398847] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-31T19:50:33.549833] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-31T19:50:33.857637] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-31T19:50:34.299732] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-31T19:50:34.311780] [INFO ] [REMOTE ] MET: Full fetch complete (77346 records). [2025-10-31T19:50:34.311921] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-31T19:50:34.668334] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-31T19:50:34.692562] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-31T19:50:34.692716] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-31T19:50:34.693896] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-31T19:50:34.693963] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-31T19:50:34.695461] [DEBUG] [LOCAL ] MET: Trimmed 77346 records to 54049 (keeping 200 days of data) [2025-10-31T19:50:35.011670] [DEBUG] [LOCAL ] MET: Primary data saved (54049 records). [2025-10-31T19:50:35.011815] [INFO ] [MAIN ] MET: Full history saved. [2025-10-31T19:50:35.011897] [INFO ] [MAIN ] Update Progress: 1329/2365 symbols completed. MET took 48.6s. Estimated remaining: 2h 12m 55s. Rate: 7.8 symbols/min [2025-10-31T19:50:35.119256] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-31T19:50:35.186572] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:50:35.228883] [DEBUG] [LOCAL ] MFG: Loaded 49743 existing records from primary storage. [2025-10-31T19:50:35.229164] [INFO ] [MAIN ] MFG: Loaded 49743 existing records. [2025-10-31T19:50:35.403162] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:50:35.403350] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-31T19:50:35.403419] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-31T19:50:35.403893] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-31T19:50:35.403951] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-31T19:50:35.464975] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-31T19:50:35.753700] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:50:35.894743] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-31T19:50:36.257671] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-31T19:50:36.593339] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-31T19:50:37.057682] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-31T19:50:37.507983] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-31T19:50:37.509566] [INFO ] [REMOTE ] MFAN: Full fetch complete (5997 records). [2025-10-31T19:50:37.509631] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-31T19:50:37.860523] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-31T19:50:37.861996] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-31T19:50:37.862051] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-31T19:50:37.862212] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-31T19:50:37.862250] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-31T19:50:37.862608] [DEBUG] [LOCAL ] MFAN: Trimmed 5997 records to 4264 (keeping 200 days of data) [2025-10-31T19:50:37.889219] [DEBUG] [LOCAL ] MFAN: Primary data saved (4264 records). [2025-10-31T19:50:37.889309] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-31T19:50:37.889384] [INFO ] [MAIN ] Update Progress: 1330/2365 symbols completed. MFAN took 27.0s. Estimated remaining: 2h 12m 44s. Rate: 7.8 symbols/min [2025-10-31T19:50:38.051869] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:50:38.065514] [DEBUG] [LOCAL ] MFM: Loaded 13509 existing records from primary storage. [2025-10-31T19:50:38.065724] [INFO ] [MAIN ] MFM: Loaded 13509 existing records. [2025-10-31T19:50:38.173423] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-31T19:50:38.243220] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:50:38.243408] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-31T19:50:38.243452] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-31T19:50:38.243620] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-31T19:50:38.243711] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-31T19:50:38.587078] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:50:38.657606] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-31T19:50:39.173254] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-31T19:50:39.457688] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-31T19:50:40.257671] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-31T19:50:40.518272] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-31T19:50:41.057674] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-31T19:50:41.476083] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-31T19:50:41.623216] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-31T19:50:41.857674] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-31T19:50:42.478582] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-31T19:50:42.657622] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-31T19:50:43.412883] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-31T19:50:43.457609] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-31T19:50:44.043606] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-31T19:50:44.257611] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-31T19:50:44.915710] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-31T19:50:45.057674] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-31T19:50:45.857676] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-31T19:50:46.230226] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-31T19:50:46.231586] [INFO ] [REMOTE ] MFAO: Full fetch complete (5361 records). [2025-10-31T19:50:46.231688] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-31T19:50:46.435363] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-31T19:50:46.631563] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-31T19:50:46.631638] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-31T19:50:46.631829] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-31T19:50:46.631871] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-31T19:50:46.632216] [DEBUG] [LOCAL ] MFAO: Trimmed 5361 records to 3807 (keeping 200 days of data) [2025-10-31T19:50:46.654458] [DEBUG] [LOCAL ] MFAO: Primary data saved (3807 records). [2025-10-31T19:50:46.654536] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-31T19:50:46.654617] [INFO ] [MAIN ] Update Progress: 1331/2365 symbols completed. MFAO took 34.3s. Estimated remaining: 2h 12m 37s. Rate: 7.8 symbols/min [2025-10-31T19:50:46.665421] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-31T19:50:46.825247] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:50:46.825439] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-31T19:50:46.825476] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-31T19:50:46.825584] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-31T19:50:46.825625] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-31T19:50:46.825706] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-31T19:50:46.825750] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-31T19:50:47.168322] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:50:47.366576] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-31T19:50:47.457626] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-31T19:50:47.960838] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-31T19:50:48.257708] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-31T19:50:49.057736] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-31T19:50:49.452561] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-31T19:50:49.857688] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-31T19:50:50.369320] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-31T19:50:50.444079] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-31T19:50:50.657660] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-31T19:50:51.457687] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-31T19:50:51.980465] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-31T19:50:52.149343] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-31T19:50:52.152764] [INFO ] [REMOTE ] MFM: Full fetch complete (19737 records). [2025-10-31T19:50:52.152836] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-31T19:50:52.262814] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-31T19:50:52.525726] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-31T19:50:52.525802] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-31T19:50:52.526228] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-31T19:50:52.526266] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-31T19:50:52.526831] [DEBUG] [LOCAL ] MFM: Trimmed 19737 records to 13662 (keeping 200 days of data) [2025-10-31T19:50:52.603343] [DEBUG] [LOCAL ] MFM: Primary data saved (13662 records). [2025-10-31T19:50:52.603471] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-31T19:50:52.603550] [INFO ] [MAIN ] Update Progress: 1332/2365 symbols completed. MFM took 14.7s. Estimated remaining: 2h 12m 28s. Rate: 7.8 symbols/min [2025-10-31T19:50:52.774220] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-23 to 2025-10-31. [2025-10-31T19:50:52.781572] [DEBUG] [LOCAL ] MFSG: Loaded 5974 existing records from primary storage. [2025-10-31T19:50:52.781772] [INFO ] [MAIN ] MFSG: Loaded 5974 existing records. [2025-10-31T19:50:52.957995] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-16 for 200 day retention. Performing full refresh. [2025-10-31T19:50:52.958224] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-31T19:50:52.958272] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-31T19:50:52.958441] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-31T19:50:52.958481] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-31T19:50:53.060239] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-31T19:50:53.322087] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2025-01-16 to 2025-10-31 (requires 10 months of data pull). [2025-10-31T19:50:53.340761] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-31T19:50:53.545686] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-31T19:50:53.857670] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-31T19:50:54.657619] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-31T19:50:55.114135] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-31T19:50:55.457675] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-31T19:50:55.795580] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-31T19:50:55.992527] [INFO ] [REMOTE ] MFC: Incremen